Skip to main content
JMIR Mental Health logoLink to JMIR Mental Health
. 2018 May 15;5(2):e10735. doi: 10.2196/10735

Public Attitudes Toward Guided Internet-Based Therapies: Web-Based Survey Study

Jennifer Apolinário-Hagen 1,, Mathias Harrer 2, Fanny Kählke 2, Lara Fritsche 1, Christel Salewski 1, David Daniel Ebert 2
Editor: Gunther Eysenbach
Reviewed by: Barbara Arnoldussen, Melissa Medich, Muhammad Imran Khan Almani
PMCID: PMC5974457  PMID: 29764797

Abstract

Background

Internet interventions have been proposed to improve the accessibility and use of evidence-based psychological treatments. However, little is known about attitudes toward such treatments, which can be an important barrier to their use.

Objective

This study aimed to (1) determine attitudes toward guided internet interventions, (2) assess its acceptability compared with other internet-based formats, and (3) explore predictors of acceptance.

Methods

A convenience-sample Web-based survey (N=646) assessed attitudes toward guided internet therapies (ie, perceived usefulness and helpfulness, and advantage relative to face-to-face therapy), preferences for delivery modes (ie, e-preference: guided internet interventions, unguided internet interventions, or videoconferencing psychotherapy), and potential predictors of attitudes and preferences: sociodemographics, help-seeking–related variables, attachment style, and perceived stress.

Results

Although most participants perceived internet interventions as useful or helpful (426/646, 65.9%), a few indicated their advantage relative to face-to-face therapy (56/646, 8.7%). Most participants preferred guided internet interventions (252/646, 39.0%) over videoconferencing psychotherapy (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), and not using internet interventions (121/646, 18.8%; missing data: 1/646, 0.2%). Attachment avoidance and stress were related to e-preference (all P<.05). Moreover, preference for therapist-guided internet interventions was higher for individuals who were aware of internet-based treatment (χ26=12.8; P=.046).

Conclusions

Participants assessed therapist-guided internet interventions as helpful, but not equivalent to face-to-face therapies. The vast majority (523/646, 81.0%) of the participants were potentially willing to use internet-based approaches. In lieu of providing patients with only one specific low-intensity treatment, implementation concepts should offer several options, including guided internet interventions, but not limited to them. Conversely, our results also indicate that efforts should focus on increasing public knowledge about internet interventions, including information about their effectiveness, to promote acceptance and uptake.

Keywords: mental health; eHealth; attitude to computers; patient preference; cognitive therapy; acceptability of health care; stress, psychological; object attachment

Introduction

Background

With 12-month prevalences ranging across countries from 9.8% to 19.1% [1], mental health disorders are widespread. Mental health disorders constitute one of the leading causes of disability [2] and are associated with low quality of life, increased risk of developing chronic physical conditions and related mortality [3,4], and an immense economic burden leading to productivity losses and substantial societal costs [5,6]. Yet fewer than half of individuals affected by mental health disorders are detected and receive professional treatment [7]. Untreated mental illness is estimated to account for 13% of the total global burden of disease [8]. Structural barriers such as limited access to treatment have been named as a reason for the insufficient uptake of individuals with mental health disorders [7]. Additionally, attitudinal barriers, such as personal stigma [9] or preferring to solve problems on one’s own, may be decisive in explaining insufficient treatment rates [10].

Using the internet as a delivery mode for self-help treatments has thus been discussed as a promising chance to inform the dissemination of professional treatment, as electronic mental health services (eMHSs) allow for mass deliverance of anonymous, low-threshold treatment options that may reach individuals for whom traditional face-to-face approaches are not an option [11,12]. In recent years, a large number of randomized controlled trials have shown that internet interventions can effectively treat various mental health disorders, such as depression [13,14], anxiety [15-17], insomnia [18], alcohol use disorder [19], comorbid mental health problems in chronic somatic diseases [20,21], and psychosomatic disorders [22]. The largest evidence base exists for the effectiveness of guided interventions [22,23], and research has shown that such approaches can be effective when delivered under routine care conditions [24-26]. In addition to guided or unguided internet interventions, videoconferencing psychotherapy (VCP) is considered as a further option to overcome regional barriers for a variety of patient populations [27]. However, the poor adoption of eMHSs worldwide indicates that low acceptability and intention to use might constitute a barrier in reaching the full potential of internet-based approaches (cf, [28-32]).

Public Acceptance Indicators for E-Mental Health Services

Determinants of intentions to use eMHSs are not well understood [28,29]. Yet there are indicators commonly discussed as influential for help-seeking intentions and acceptance of eMHSs, such as attitudes [33-35] and “e-preferences” [28].

Attitudes

Positive public attitudes could be an indicator of acceptance and adoption of internet interventions. Generally, attitudes can be characterized as an aggregate of subjective assessments about an object, ranging, for example, from harmful to helpful [36].

The theory of planned behavior [37] proposes that attitudes, among other factors, shape individuals’ intentions, which then lead to a certain behavior. Individuals’ personal expectancies are assumed to shape such attitudes and to thereby influence behavioral intentions [37]. In accordance with the unified theory of acceptance and use of technology [38], performance expectancy (ie, how useful an individual perceives an intervention to be for reaching a specific goal) might thus play an important role in the adoption and acceptance of internet interventions [39,40] and provide a guideline in overcoming the limitations in the acceptability of eMHSs [34,39,41,42].

E-Preference

Technology acceptance of eMHS can be operationalized by intentions to use these services [39], which can be affected by the individual preference for a specific delivery mode [28]. Treatment preference means to choose a treatment in favor of an alternative option. Research evidence suggests that considering patients’ preferences for a psychological treatment is associated with improved clinical outcomes [43]. However, little is known about preferences for specific delivery modes, such as therapist-guided treatment, unguided internet interventions, and VCP, and their impact on the willingness to use eMHSs. Some studies identified a preference for traditional (face-to-face) over internet-based treatment (eg, [28,29,31,44-47]) and for therapist-guided over unguided eMHSs (eg, [28,29,33]).

Determinants of Attitudes Toward and Preferences for Internet-Based Therapies

Potential determinants of attitudes and preferences for eMHS include sociodemographics such as age, region [45], or professional background [48-50]. Regarding health-related and help-seeking variables, using the internet for mental health information [45,51], previous use of eMHSs [31], a history of mental illness and help-seeking experience such as undergoing psychotherapy [29], knowledge about eMHSs or awareness of electronic therapies (“e-awareness”) [33,41,42], personality traits [28], and perceived stress [42,52] have been reported as predictors. Regarding the role of symptom severity, a recent study [12] illustrated a help-seeking behavior paradox in students, where individuals’ readiness to seek help from face-to-face services declined with increased perceived stress. In contrast, the same study also demonstrated a positive association between distress and seeking help online.

Attachment style may be a further predictor of eMHS uptake [52], since attachment theory [53] has been applied to predict intentions to use face-to-face help services (eg, [54]). Based on early infant-caregiver interactions, relatively stable internal working models of the self and others in terms of mental representations of close relationships are built. These implicit expectations regarding self-efficacy and reliance on significant others in stressful situations are manifested in adulthood [53]. Adult attachment style can play a role in preferences and attitudes toward seeking help in the context of emotionally relevant relationships, such as in mental health care [52,54]. While a secure attachment style (low attachment anxiety and avoidance; ie, positive models of the self and others) is associated with functional coping strategies, insecure attachment styles were identified as a global vulnerability factor for mental health [55,56] and are related to altered stress responses, symptom reporting, and less use of health care resources [57,58]. However, the role of attachment styles in the readiness to use eMHSs remains unclear [52], especially concerning different delivery modes of internet interventions that vary in the degree of human support.

Taken together, the identification of determinants of attitudes toward and preferences for eMHSs is at an early stage [34]. This study addressed this research gap.

Objective

The purpose of this study was to (1) explore attitudes toward guided internet interventions and to (2) assess the acceptability of guided internet interventions compared with other formats of internet-based delivery (ie, e-preference: unguided self-help interventions and VCP vs not using eMHSs in case of emotional problems). Another goal was to (3) identify determinants of the public acceptability of eMHSs by exploring associations between attitudes toward guided internet interventions, preferences for a specific delivery mode of eMHSs, and participant characteristics (ie, sociodemographics, help-seeking–related variables, attachment style, and perceived stress).

Methods

Study Design and Participants

We conducted a cross-sectional Web-based survey using a quasi-experimental study design. Data were collected between November 2015 and June 2016 using Unipark software (Enterprise Feedback Suite survey, version 10.6, Questback). We obtained a convenience sample (N=646) via the virtual laboratory and Moodle of the University of Hagen, Hagen, Germany, and social media websites (Facebook, Facebook Inc; and Xing, Xing AG). No ethical approval was required. Inclusion criteria were self-reported age over 18 years and written informed consent. Psychology students could receive credits for their participation.

Measures

Attitudes Toward Guided Internet Interventions

We used a modified 17-item version of an e-therapy attitudes measure (ETAM) [42] containing statements about typically cited benefits of internet therapy and its comparability with face-to-face psychotherapy, as well as subjective beliefs (eg, about data security). Participants were asked to rate their agreement with each statement on a 5-point rating scale ranging from 0 (“strongly disagree”) to 4 (“strongly agree”). To ensure comparability, participants were instructed to rate items regarding guided internet interventions (see Textbox 1). Based on previous exploratory factor analysis, we identified two factors, which we termed perceived usefulness and helpfulness, and advantage relative to face-to-face therapy. Multimedia Appendix 1 provides detailed information about the exploratory factor analysis. For classification of attitudes, we used predefined cutoffs in line with previous work using the ETAM [41,42]: mean scores <1.5 (a median score of 0 or 1) were defined as negative, values between 1.5 and 2.49 (median score of 2) as neutral, and scores ≥2.5 (median scores of 3 or 4) as positive attitudes toward guided internet interventions. Cronbach alpha was excellent in this survey (alpha=.92).

Preference for internet therapies illustrated by case vignettes. Options 1-3: internet therapies differentiated by the degree of professional support. The instruction was adapted and translated from German.

Internet-based psychotherapies include a broad spectrum of types of treatments for relatively well treatable, mild to moderate forms of depression and anxiety disorders. The following 3 examples illustrate distinct types of internet therapies:

  1. Unguided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program, including problem-specific tasks, exercises, and tutorials, via mobile phone or computer for several weeks without individual feedback.

  2. Therapist-guided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program with therapist guidance. Communication with the therapist consists of text-based feedback via email or chat provided on demand.

  3. Videoconferencing psychotherapy: The communication is mediated by a webcam. As with face-to-face psychotherapy, the treatment takes place within specified sessions with immediate verbal and nonverbal feedback.

In case of emotional problems, which of the described interventions would you most likely personally use? Please choose the internet therapy form you prefer most based on your current expectations.

  1. Unguided internet-based self-help treatment

  2. Therapist-guided internet-based self-help treatment

  3. Videoconferencing psychotherapy

  4. I would not use any internet therapy at all

Preference for Internet Interventions (E-Preference)

We operationalized preference (see Textbox 1) by assessing help-seeking intentions for different delivery modes of internet interventions (e-preference, options 1-3) in contrast to the disinclination to use internet interventions in case of emotional problems (non–e-preference, option 4).

Determinants of Attitudes Toward and Preferences for Internet Interventions

Sociodemographics and Help-Seeking–Related Variables

Sociodemographic characteristics were sex, age, marital status, native language, region, country of residence, educational level, employment status, and work in health care or the social sector.

We investigated participants’ awareness of electronic therapy (e-awareness) by asking them whether they had ever heard or read about internet-based therapies. We also asked participants to assess their subjective health status, experiences with online counseling or conventional inpatient or outpatient psychotherapy, and their frequency of seeking health information online.

Attachment Style

We considered attachment style as a potential determinant of the acceptance of guided internet interventions, since previous work indicated a connection between individual needs for interpersonal proximity versus distance in case of emotional problems and help-seeking intentions (cf, [54]). We measured adult attachment using the Experiences in Close Relationships-Relationship Structures questionnaire [59] 9-item global version to assess attachment anxiety and avoidance [60]. Participants were asked to rate the extent to which they believed each statement best described their feelings about close relationships on a 7-point Likert scale ranging from 1 (“strongly disagree”) to 7 (“strongly agree”). The intercorrelation of dimensions (ρ(646)=.272, P<.001) was comparable with other studies [61]. Cronbach alpha was good for attachment avoidance (alpha=.88) and excellent for attachment anxiety (alpha=.91).

Assessment of Stress Perceptions

Current Stress Level

We used a visual analog scale [62] to assess current perceived stress level on a scale with 2 end points: 0 (“not at all”) and 10 (“maximum”).

Perceived Stress (Past Month)

To measure stress perceptions during the past 4 weeks, the we used the Perceived Stress Questionnaire 20-item short version (PSQ-20) [63]. Participants were asked to indicate how often statements applied to themselves on a 4-point Likert scale ranging from 1 (“almost never”) to 4 (“usually”). Cronbach alpha was poor (alpha=.55).

Procedure

After entering the Web-based survey, participants were provided with the study information and consent form. Next, they were asked sociodemographic and help-seeking questions. Then, preference for specific forms of internet interventions, attitudes toward guided internet interventions, stress perceptions, and attachment style were assessed. The average completion time ranged from 10 to 15 minutes.

Statistical Analysis

We considered only completed surveys for data analyses. To ensure data quality, data validation checks were performed independently by 2 researchers prior to the statistical analyses. Descriptive analyses were used to classify attitudes toward and preference for a specific delivery mode of internet therapies. Regarding predictors of attitudes, we explored differences in variance (analysis of variance) in attitudes (overall mean score) based on sociodemographics, health variables, and e-preference. Due to the scarce theory base and questionable multivariate normal distribution, we used Spearman rank correlation (ρ coefficient) instead of multiple regression analysis to identify associations between attitudes, attachment style, and stress perceptions. Moreover, we explored differences using 1-way analysis of variance and Pearson chi-square tests in preferences based on the same predictors as for attitudes. Pairwise comparisons (post hoc tests) to examine mean differences (Mdiff) were conducted using Bonferroni adjustments in case of variance homogeneity (Levene test, P>.05) or Dunnett C test in case of variance heterogeneity. Statistical tests for significance (2-tailed hypotheses with alpha level of .05) were performed using IBM SPSS version 24 (IBM Analytics).

Results

Descriptive Analyses

Of 1300 respondents who accessed the platform, 778 provided informed consent, with 1 person declining and thus being excluded. We consequently analyzed the responses of 646 respondents who completed the survey. Tables 1 and 2 summarize the sample’s characteristics.

Table 1.

Sociodemographic characteristics (N=646).

Variables Data
Age (years)

Mean (SD) 31.18 (10.08)

Range (median) 18-64 (29)
Sex, n (%)

Female 493 (76.3)

Male 147 (22.8)

Other 3 (0.5)

Missing data 3 (0.5)
Native language, n (%)

German 568 (87.9)

Bilingual including German 40 (6.2)

Other than German 37 (5.7)

Missing data 1 (0.2)
Marital status, n (%)

Single 327 (50.6)

Married or living in a close relationship 288 (44.6)

Divorced or living separated 26 (4.0)

Other 3 (0.5)

Missing data 2 (0.3)
Employment statusa, n (%)

Employed 177 (27.4)

University student, part-time or full-time 345 (53.4)

Employee in trainingb 14 (2.2)

Self-employed 46 (7.1)

Unemployed 11 (1.7)

Parental leave 15 (2.3)

Retired 8 (1.2)

Current work incapability 3 (0.5)

Other employment (commentary section) 27 (4.2)
Employment in health care or social sector, n (%)

No 493 (76.3)

Yes, in a therapeutic field 57 (8.8)

Yes, in a nontherapeutic field 96 (14.9)
Education level attained, n (%)

No school certificate 3 (0.5)

Basic school qualificationc 10 (1.5)

Secondary school (Mittlere Reife)d 57 (8.8)

German Abitur or Fachabiture 329 (50.9)

University degree (Bachelor level) 86 (13.3)

University degree (Masters level) 143 (22.1)

Postgraduate or postdoctoral degree 9 (1.4)

Other degree (commentary section) 9 (1.4)
Country of residence, n (%)

Germany 585 (90.6)

Other countryf 60 (9.3)

Missing data 1 (0.2)
Region of residence, n (%)

Village or small town, with <5000 inhabitants 100 (15.5)

Provincial town, with 5000-19,999 inhabitants 99 (15.3)

Medium-sized city, with 20,000-100,000 inhabitants 124 (19.2)

Big city or metropolis, with >100,000 habitants 322 (49.8)

Missing data 1 (0.2)

aThe main employment was requested (if respondents had multiple roles, they were asked to choose in which role they spent most of their working time at the time of participation in this survey).

bGerman dual system: occupational trainee or pupil (secondary education).

cBasic school qualification with usually 9 school years of education in Germany (German Hauptschule).

dSecondary school (German Mittlere Reife), or 10 years of education in Germany.

eGerman Abitur or Fachabitur with 12-13 years of education in Germany. This education is necessary to get access to a college or university.

fMost of the subgroup of non-Germany residents indicated they lived in Austria (35/646, 5.5%).

Table 2.

Sample characteristics (N=646).

Help-seeking–related variables Data
Subjective health status, n (%)

Healthy or relatively healthy 492 (76.2)

Acute illness 39 (6.0)

Chronic illness 83 (12.8)

Other (commentary section) 30 (4.6)

Missing data 2 (0.3)
Experience with online counseling, n (%)

No, no experience with online counseling 578 (89.6)

Yes, experience with online counseling 67 (10.4)

Missing data 1 (0.2)
Experience with psychotherapya, n (%)

No, I have no experience and I have also no need for psychotherapeutic help 303 (46.9)

No, I have no experience, but I am seeking psychotherapeutic help from a therapist 35 (5.4)

Yes, I am in therapy 79 (12.2)

Yes, in the past (experience with psychotherapy) 228 (35.3)

Missing data 1 (0.2)
Web-based health information use (frequency), n (%)

Daily 15 (2.3)

Several times a week 49 (7.6)

Several times a month 146 (22.6)

Rarely or occasionally 369 (57.1)

Very rare or never 67 (10.4)
E-awareness (awareness of the existence of electronic therapies), n (%)

No (not aware) 343 (53.1)

Yes (aware) 214 (33.1)

Not sure 87 (13.8)

Missing data 2 (0.4)
Attachment style (ECR-RSb), mean (SD), median, range

Attachment avoidance 3.61 (1.38), 3.50 (1.00-7.17)

Attachment anxiety 3.46 (1.77), 3.33 (0.00-7.00)
Stress perceptions, mean (SD), median (range)

Current stress (visual analog scale) 5.67 (2.96), 6.0 (0-10)

Perceived stress (Perceived Stress Questionnaire 20-item short version) 47.00 (19.60), 46.67 (3.33-95.00)

aExperience with psychotherapy or current need or demand for professional psychological help.

bECR-RS: Experiences in Close Relationships-Relationships Structures questionnaire.

Attitudes Toward Guided Internet Interventions

Analysis of attitudes toward guided internet interventions indicated an overall moderate acceptance (ETAM overall mean score, Table 3). As Table 4 shows, descriptive analyses further showed that, although most participants (426/646, 65.9%) perceived internet approaches as useful or helpful, only a few participants (56/646, 8.7%) also indicated that guided internet-based approaches had a relative advantage over or comparability with conventional face-to-face approaches.

Table 3.

Summary of attitude assessment results with the e-therapy attitudes measurea (ETAM; N=646).

ETAM Mean (SD) Median Range
Overall score attitude assessment (ETAM mean score) 1.93 (0.72) 1.94 0-4
Perceived usefulness and helpfulness (PU) scale 2.72 (0.79) 2.86 0-4
Relative advantage and comparability (RA) scale 1.37 (0.78) 1.33 0-4
Scale itemb

1./PU Internet-based therapies are modern and in line with our modern times. 2.84 (1.04) 3.0 0-4

2./RA Internet-based therapies will replace conventional face-to-face psychotherapy in the future. 0.94 (0.93) 1.0 0-4

3./PU Internet-based therapy is more compatible with work and private life than conventional face-to-face therapy. 2.73 (1.05) 3.0 0-4

4./RA It makes no difference to me whether psychotherapy is conducted through the internet or in a psychotherapy practice in a clinic. 0.69 (0.96) 0.0 0-4

5./PU Internet-based therapies will reach more individuals with mental health problems. 2.77 (1.09) 3.0 0-4

6./PU Health insurance companies should cover the costs for internet-based therapies. 2.77 (1.16) 3.0 0-4

7./RA Internet-based therapy programs are as effective as conventional face-to-face psychotherapies. 1.39 (0.99) 1.0 0-4

8./RA Trust in a therapist can be just as easily built on the internet as in conventional face-to-face psychotherapy. 1.39 (1.14) 1.0 0-4

9./RA Internet-based therapies are an appropriate alternative to conventional face-to-face psychotherapy. 1.82 (1.10) 2.0 0-4

10./RA In case of mental health problems, I would attend an internet-based therapy. 1.70 (1.34) 2.0 0-4

11./RA I would prefer an internet-based therapy to a conventional face-to-face psychotherapy. 1.03 (1.16) 1.0 0-4

12./PU Internet-based therapies will reach more patients and help them. 2.55 (1.10) 3.0 0-4

13./RA I’m not particularly worried about data security in internet therapies. 1.29 (1.33) 1.0 0-4

14./PU The anonymity in internet therapies decreases the threshold to speak openly and honestly about important issues. 2.69 (1.19) 3.0 0-4

15./PU Through the dissemination of internet therapies, persons will get professional help earlier. 2.75 (1.04) 3.0 0-4

16./RA Misunderstandings occur in internet therapies as often as in conventional psychotherapies. 1.96 (1.23) 2.0 0-4

17./RA Internet therapies are suitable for most patients, regardless of their personal background (age, sex, education, etc). 1.54 (1.18) 1.0 0-4

aThe ETAM rating scale ranged from 0 (“strongly disagree”) to 4 (“strongly agree”).

bAll items were translated from German to English. Item 1 refers to expectations and can be interpreted best in connection to other attitudinal items (compared with the previous version with 14 items, items 1-12 remained and items 13-17 are novel items of the 17-item version).

Table 4.

Classification of attitudes toward guided internet interventions assessed by the e-therapy attitudes measure (ETAM; N=646).

ETAM Classification of ETAM scoresa

Low acceptance, negative
attitude, n (%)
Moderate acceptance, neutral
attitude, n (%)
High acceptance, positive
attitude, n (%)
Overall mean score (attitudes) 168 (26.0) 324 (50.2) 124 (23.8)
Perceived usefulness and helpfulness 44 (6.8) 175 (27.1) 426 (65.9)
Relative advantage and comparability 364 (56.3) 226 (35.0) 56 (8.7)

aLow acceptance, negative attitude: scale mean score range 0-1.49; moderate acceptance, neutral attitude: scale mean score range 1.5-2.49; high acceptance, positive attitude: scale mean score range 2.5-4.0.

Overall, participants agreed with 7 of the 17 positive statements about internet interventions made in ETAM items (Table 3). Those positively attributed beliefs about internet therapies involved modernity (item 1), compatibility with everyday life (item 3), accessibility (item 5), coverage of costs by health insurance providers (item 6), helpfulness (item 12), anonymity (item 14), and a chance to get help earlier (item 15).

Furthermore, 7 of the 17 items were classified as negative. Participants rather disagreed with the possibility of replacing face-to-face therapies (item 2), the equivalence of delivery modes (item 4), comparability of effectiveness (item 7) and therapeutic relationships (item 8), preference for internet therapy over face-to-face therapy (item 11), data security (item 13) and suitability for diverse populations (item 17).

Participants classified 3 items as neutral or undecided. These statements addressed internet therapies as an alternative to face-to-face therapies (item 9), willingness to use internet therapies (item 10), and the occurrence of misunderstandings (item 16).

Preference for Different Delivery Modes

As Figure 1 shows, most respondents indicated that they preferred guided internet interventions (252/646, 39.0%) over VCP (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), or no Web-based treatment (121/646, 18.8%; missing data: 1/646, 0.2%). Thus, the vast majority were “e-preferers” (523/646, 81.0%).

Figure 1.

Figure 1

Participants' stated preference for a specific delivery mode of internet interventions (N=646).

Determinants of Attitudes

Sociodemographic Variables

Attitudes and age were significantly and positively correlated (ρ(643)=.079, P=.045), with older participants displaying more favorable attitudes than younger participants toward internet-based guided self-help. Unemployed participants (mean 2.30, SD 0.69) showed more positive attitudes than employees in training (mean 1.37, SD 0.37, Mdiff 0.93, SE 0.288, 95% CI 0.003-1.85). We found no significant differences in attitudes for sex, marital status, region, native language, education level, or work in the health care or social sector (all P>.05).

Help-Seeking–Related Variables

Frequency of seeking health information online was associated with differences in internet intervention attitudes (F4,641=6.675; P<.001, ηp2=.040), with more positive attitudes reported by individuals who sought information weekly (mean 2.01, SD 0.61, Mdiff –0.36, SE 0.112, 95% CI –0.67 to –0.04), several times a month (mean 2.11, SD 0.78, Mdiff –0.45, SE 0.097, 95% CI –0.72 to –0.18), or rarely (mean 1.91, SD=0.59, Mdiff –0.26, SE 0.080, 95% CI –0.48 to –0.04; all P<.05) than by those who never did (mean 1.66, SD 0.59). This was not the case for participants who reported seeking information daily (mean 1.46, SD 0.99); both groups (never, daily) expressed rather negative attitudes. There was a significant positive correlation between attitudes toward guided internet interventions and perceived stress on the PSQ-20 (ρ(643)=.092, P=.020). No significant differences in attitudes were identified for any of the other help-seeking–related variables (eg, e-awareness, attachment style, all P>.05).

Determinants of E-Preference

Sociodemographic Variables

We found no significant differences in e-preferences (preference for guided or unguided internet interventions and VCP) based on age, sex, marital status, region, native language, education level, employment status, or work in the health care or social sector (all P>.05).

Help-Seeking–Related Variables

E-awareness significantly predicted a preference for different forms of internet-based therapy (χ26=12.8; P=.046). Individuals who were aware of internet therapies (97/214, 45.5%) or not sure (40/87, 46.0%) were more likely to prefer guided internet interventions than were those who were not aware (115/343, 33.5%).

We found differences in e-preference based on experience with online counseling (χ23=13.8; P=.003); persons with experience were less likely to prefer unguided interventions (7/68, 10.6%) than were those without (117/578, 20.2%).

Experience with psychotherapy also predicted e-preference (χ29=21.6; P=.01). A preference for guided internet interventions was most common among persons without experience who were currently seeking a therapist (20/35, 57.1%) and persons with experience with psychotherapy (99/228, 43.4%). All subgroups were nonetheless most likely to prefer guided internet interventions.

Attachment Style

Attachment avoidance significantly predicted e-preference (F3,640=6.315; P<.001, ηp2=.029). Participants with higher attachment avoidance were less likely to prefer VCP than other formats (unguided internet interventions: Mdiff –0.579, SE 0.166, 95% CI –1.020 to –0.139; guided internet interventions: Mdiff –0.426, SE 0.142, 95% CI –0.801 to –0.051; non–e-preference: Mdiff –0.651, SE 0.166, 95% CI –1.095 to –0.208). There was no significant association between preference and attachment anxiety (F3,640=2.247; P=.08).

Perceived Stress

Current perceived stress was associated with e-preference (visual analog scale: F3,640=3.855; P=.009, ηp2=.018), with participants who experienced higher stress being more likely to prefer guided interventions than VCP (Mdiff 0.86, SE 0.277, 95% CI 0.13-1.60). Scores for current stress were lowest in non–e-preferers (mean 5.26, SD 2.80) and highest in those who preferred guided internet intervention (mean 5.90, SD 2.60). Another significant difference between the preference groups was shown for perceived stress in the past month (PSQ-20: F3,638=2.943; P=.03, ηp2=.014). Pairwise comparisons were not significant. PSQ-20 scores were lowest for non–e-preference (mean 44.39, SD 20.81) and highest for therapist-guided intervention preference (mean 49.67, SD=19.14).

The other help-seeking–related variables were not associated with significant differences in preferences (all P>.05).

Discussion

Principal Findings

Attitudes Toward Guided Internet Interventions

This study identified an overall moderate public acceptance, or moderately positive attitudes, toward guided internet interventions in a German sample. This tendency is in line with another study on a psychoeducational intervention using an adapted ETAM version [41]. Participants supported health care insurance coverage of costs for guided internet-based therapies and endorsed the helpfulness of such approaches, their perceived anonymity, and the chance to receive help earlier compared with traditional health care. At the same time, participants disagreed with the supposed comparability of guided internet interventions with face-to-face psychotherapy, for example, with regard to their effectiveness and possibility to develop a good therapeutic relationship. Our findings are, furthermore, consistent with earlier research with respect to a general preference for face-to-face therapies over internet interventions [28,29,44], data security concerns [64,65], and perceived higher compatibility of internet interventions with everyday life [11,29].

We found no relevant differences for sociodemographics as predictors of attitudes toward internet-based guided self-help. Interestingly, neither education level nor sex was associated with attitudes. These results are in line with a study on the acceptance of internet-based interventions in chronic pain [66]. Replication of this finding might indicate that the often-reported overrepresentation of woman and highly educated participants in randomized controlled trials evaluating internet interventions [13,67-72] might not be due to lower acceptance of digital health interventions in general, but due to other relevant barriers such as lower willingness to seek help. Future research should try to shed light on low utilization rates among persons with low education and men.

Moreover, participants with higher levels of perceived stress in the past month tended to express a more positive attitude toward internet interventions, which is consistent with a prior study using the same instrument to assess attitudes [42]. This might point to improved acceptance of such guided internet interventions among participants in a stressful situation with an actual need for support.

Preference for Specific Delivery Formats

This study identified a clear preference for guided over unguided internet interventions, which only few studies have investigated before [34]. Interestingly, guided internet interventions were also preferred over VCP. Approximately four-fifths of the participants were willing to use internet-based approaches for emotional problems, indicating a broad applicability of internet interventions for mental health care.

High e-awareness was associated with a preference for guided internet interventions. Overall, e-awareness in our sample was low (33.1%), which could be, for instance, seen in context of the early stage of implementation of eMHSs in Germany [50,73] and might rise further in the future. This is supported by previous German surveys reporting even lower rates of e-awareness (14.0%-27.3%; [42,52,64]), including a representative socioeconomic panel (SOEP-Innovation Modules 2016, N=4802) showing 24.4% e-awareness (D Richter, written communication, May 2017). Experience with seeking psychological help formats was also a determinant of preferences, which is consistent with other studies [29,31]. Results also suggest that attachment avoidance was associated with a higher preference for guided and unguided self-help via internet interventions, and very low preference for VCP. This finding contributes to research on links between attachment styles and face-to-face health care use readiness [52,57,58] and might indicate that internet-based (guided) self-help approaches could help to reach individuals for whom attitudinal and other psychological barriers such as attachment avoidance might be a drawback for use of an intervention [74].

Furthermore, participants with higher levels of perceived stress showed a higher preference for internet-based guided self-help than for VCP. This might indicate that individuals with stressful lives have problems adhering to fixed synchronous therapy sessions, and that providing asynchronous treatments might help them to get access to psychological treatments, which they would otherwise not use. Such an assumption is supported by studies that found high proportions of first-time help seekers in internet-based stress management programs [75-79]. However, future research is needed to confirm such an assumption.

Implications

This study provides several important implications for research and practice.

Providing Asynchronous Treatment Formats to Increase Health Care Utilization

First, results indicate that, although internet-based approaches are not an option for some individuals, a large proportion of participants in this study were potentially inclined to use eMHSs for treatment. However, e-preference rates were lowest for VCP, which, as a synchronous delivery format, is the most similar to conventional face-to-face psychotherapy [27]. Results also indicated that individuals with high attachment avoidance were least inclined to use this synchronous format to seek help, but were more willing to use asynchronous internet-based interventions. Perceived stigma and a preference for managing mental health problems on one’s own are known barriers to seeking synchronous treatment [10], and personal characteristics such as attachment style may contribute [57,58]. This suggests that provision of asynchronous treatment options, such as guided or unguided internet interventions, could be a feasible way to reach larger proportions of the general population, especially individuals who would not use synchronous options such as face-to-face psychotherapy or VCP. Matched-care models have been proposed before (cf, [80]), allocating internet-based or face-to-face treatment based on symptom severity; findings in this study, however, pointed out that various asynchronous as well as synchronous treatment formats should be provided simultaneously to reach as many individuals affected by mental health problems as possible.

Second, these results also suggested that offering guidance alongside internet-based self-help internet interventions in routine care could, from a public health perspective, have a major influence on their effects on a population level. Whether to offer guided or unguided interventions in routine care has been debated in the literature since internet-based self-help has emerged. This discussion has since predominately focused on potential differences in adherence, effects, and costs [22,81-83]. Meta-analytic findings clearly indicate that stand-alone guided self-help interventions can be effective in the prevention and treatment of a range of mental health problems, including depression [68], anxiety [72], and stress [77]. However, although more patients could potentially be treated for the same costs using unguided self-help, a basic prerequisite to exploiting the potential of any effective treatment is that affected individuals are willing to use it [84]. This study showed that approximately twice as many participants preferred guided interventions over unguided interventions. Thus, with evidence showing guided interventions to be comparable with face-to-face psychotherapy, for example for depression and anxiety [17,85], and with large effect sizes of guided formats when delivered under routine care conditions [25,86-88], preference should be given at the moment, whenever possible, to guided self-help in routine care. However, it should also be acknowledged that almost 20% of participants preferred unguided self-help; hence, future studies should clarify whether offering both guided and unguided interventions could lead to greater effects on a population level due to higher overall utilization rates, compared with offering only one of the two options.

Raising E-Awareness and Knowledge

Awareness about internet-based treatment was rather low in this sample, but was positively associated with higher preference for guided internet interventions. Furthermore, participants did not find internet interventions to be equal in effectiveness and therapeutic relationship to face-to-face therapies. Previous research, however, has shown that the effects of guided internet interventions are comparable with face-to-face therapies [17,85] and that therapeutic relationships are of the same quality as in conventional treatment [1-4]. This finding points to the importance of developing measures to increase awareness of and knowledge about the efficacy of internet-based treatment in the public to raise its acceptance. Acceptance-facilitating interventions using brief, highly scalable educational videos have been shown to be a valid strategy to enhance the acceptability of internet interventions in clinical practice [66,71,84]. As acceptance-facilitating interventions may be easily disseminated through official health care information channels, they might be an auspicious approach to increase e-awareness and knowledge concerning internet interventions, and thus raise their public acceptance.

Limitations

First, the early stage of validation of the ETAM and the application of a heuristic rule to classify attitudes are a limitation that might have biased results regarding the categorization of attitudes with mainly neutral or undecided views. Future efforts should try to develop data-based cutoff values using representative samples. Second, the prior presentation of the case vignette regarding e-preferences might have led to more positive attitudes toward internet interventions, considering that a previous study using the ETAM without this case vignette revealed overall negative views [42]. Hence, these results might only be generalizable to situations in which potential participants receive minimal information about internet interventions. Third, we investigated determinants of attitudes toward and preferences for internet therapies based on self-reports, with most respondents (492/646, 75.2%) rating themselves as relatively healthy. It may be the case that attitudes toward digital mental health approaches change with current symptomatology, help-seeking wishes, and the availability of other formats for preferable treatments in routine care. Since the study was conducted in Germany, results may only be applicable to countries with similar economies or health care systems. Fourth, e-preferences were operationalized only regarding preferences for a specific treatment, and we do not know whether patients were nevertheless willing to use an alternative treatment format, if their preference would not be available in routine care, which should be tested in future studies. Moreover, with regard to non–e-preferers, we only assessed whether somebody would not prefer guided and unguided self-help or VCP, but we did not assess preference for face-to-face psychotherapy and pharmacotherapy, which should also be tested in subsequent studies.

Conclusions

This study revealed moderately positive attitudes toward guided internet interventions and a clear public preference for guided over unguided internet-based treatment and VCP. Results of this survey indicated that increasing awareness about the existence of effective internet-based treatment options should be a key priority to raise their acceptability, and that guided internet-based programs should be implemented in routine care along with conventional face-to-face treatment to account for different patient preferences and help-seeking characteristics.

Acknowledgments

We thank Viktor Vehreschild, MSc, Dipl-Math, for advice regarding data analyses and Melanie Allerding, MSc, for assistance in recruiting participants.

Abbreviations

ECR-RS

Experiences in Close Relationships-Relationships Structures questionnaire

eMHS

electronic mental health service

ETAM

e-therapy attitudes measure

Mdiff

mean difference

PSQ-20

Perceived Stress Questionnaire 20-item short version

PU

perceived usefulness and helpfulness

RA

relative advantage and comparability

SOEP

socioeconomic panel

VCP

videoconferencing psychotherapy

Multimedia Appendix 1

Exploratory factor analysis for the e-therapy attitudes measure (including pattern and structure matrices).

Footnotes

Conflicts of Interest: None declared.

References

  • 1.Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, Ustün TB, Wang PS. The global burden of mental disorders: an update from the WHO World Mental Health (WMH) surveys. Epidemiol Psichiatr Soc. 2009;18(1):23–33. doi: 10.1017/s1121189x00001421. http://europepmc.org/abstract/MED/19378696 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, Burstein R, Murray CJL, Vos T. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. 2013 Nov 09;382(9904):1575–86. doi: 10.1016/S0140-6736(13)61611-6.S0140-6736(13)61611-6 [DOI] [PubMed] [Google Scholar]
  • 3.Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, Lönnqvist J. Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry. 2007 Apr;190:326–32. doi: 10.1192/bjp.bp.106.025106. doi: 10.1192/bjp.bp.106.025106.190/4/326 [DOI] [PubMed] [Google Scholar]
  • 4.Cuijpers P, Smit F. Excess mortality in depression: a meta-analysis of community studies. J Affect Disord. 2002 Dec;72(3):227–36. doi: 10.1016/s0165-0327(01)00413-x.S016503270100413X [DOI] [PubMed] [Google Scholar]
  • 5.Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de GR, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy Econ. 2006 Dec;9(4):193–200. [PubMed] [Google Scholar]
  • 6.Greenberg PE, Birnbaum HG. The economic burden of depression in the US: societal and patient perspectives. Expert Opin Pharmacother. 2005 Mar;6(3):369–76. doi: 10.1517/14656566.6.3.369.EOP060302 [DOI] [PubMed] [Google Scholar]
  • 7.Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004 Nov;82(11):858–66. http://www.scielosp.org/scielo.php?script=sci_arttext&pid=S0042-96862004001100011&lng=en&nrm=iso&tlng=en .S0042-96862004001100011 [PMC free article] [PubMed] [Google Scholar]
  • 8.World Health Organization Executive Board . Global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at the country level: Report by the Secretariat. Geneva, Switzerland: WHO; 2012. [2018-05-07]. http://apps.who.int/gb/ebwha/pdf_files/EB130/B130_9-en.pdf . [Google Scholar]
  • 9.Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, Morgan C, Rüsch N, Brown JSL, Thornicroft G. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. 2015 Jan;45(1):11–27. doi: 10.1017/S0033291714000129.S0033291714000129 [DOI] [PubMed] [Google Scholar]
  • 10.Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, Bromet E, Bruffaerts R, de Girolamo G, de Graaf R, Florescu S, Gureje O, Hinkov HR, Hu C, Huang Y, Hwang I, Jin R, Karam EG, Kovess-Masfety V, Levinson D, Matschinger H, O'Neill S, Posada-Villa J, Sagar R, Sampson NA, Sasu C, Stein DJ, Takeshima T, Viana MC, Xavier M, Kessler RC. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2014 Apr;44(6):1303–17. doi: 10.1017/S0033291713001943. http://europepmc.org/abstract/MED/23931656 .S0033291713001943 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med. 2014 Nov;44(15):3137–50. doi: 10.1017/S0033291714000245.S0033291714000245 [DOI] [PubMed] [Google Scholar]
  • 12.Ryan ML, Shochet IM, Stallman HM. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health. 2014 Dec 17;9(1):73–83. doi: 10.5172/jamh.9.1.73. [DOI] [Google Scholar]
  • 13.Josephine K, Josefine L, Philipp D, David E, Harald B. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord. 2017 Dec 01;223:28–40. doi: 10.1016/j.jad.2017.07.021.S0165-0327(17)30725-5 [DOI] [PubMed] [Google Scholar]
  • 14.Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012 Jun;32(4):329–42. doi: 10.1016/j.cpr.2012.02.004.S0272-7358(12)00027-X [DOI] [PubMed] [Google Scholar]
  • 15.Ebert DD, Zarski A, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, Riper H. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895. doi: 10.1371/journal.pone.0119895. http://dx.plos.org/10.1371/journal.pone.0119895 .PONE-D-14-33759 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. 2012 Dec;12(6):745–64. doi: 10.1586/erp.12.67. [DOI] [PubMed] [Google Scholar]
  • 17.Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2015 Mar 05;(3):CD011565. doi: 10.1002/14651858.CD011565. [DOI] [PubMed] [Google Scholar]
  • 18.Zachariae R, Lyby MS, Ritterband LM, O'Toole MS. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia – a systematic review and meta-analysis of randomized controlled trials. Sleep Med Rev. 2016 Dec;30:1–10. doi: 10.1016/j.smrv.2015.10.004.S1087-0792(15)00148-3 [DOI] [PubMed] [Google Scholar]
  • 19.Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, Ebert D, Cuijpers P. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912. doi: 10.1371/journal.pone.0099912. http://dx.plos.org/10.1371/journal.pone.0099912 .PONE-D-14-12620 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ebert DD, Nobis S, Lehr D, Baumeister H, Riper H, Auerbach RP, Snoek F, Cuijpers P, Berking M. The 6-month effectiveness of Internet-based guided self-help for depression in adults with type 1 and 2 diabetes mellitus. Diabet Med. 2017 Dec;34(1):99–107. doi: 10.1111/dme.13173. [DOI] [PubMed] [Google Scholar]
  • 21.van Bastelaar KMP, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care. 2011 Feb;34(2):320–5. doi: 10.2337/dc10-1248. http://europepmc.org/abstract/MED/21216855 .dc10-1248 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. 2014 Oct;13(3):288–95. doi: 10.1002/wps.20151. doi: 10.1002/wps.20151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on internet-based mental health interventions — a systematic review. Internet Intervent. 2014 Oct;1(4):205–215. doi: 10.1016/j.invent.2014.08.003. [DOI] [Google Scholar]
  • 24.El Alaoui S, Hedman E, Ljótsson B, Lindefors N. Long-term effectiveness and outcome predictors of therapist-guided internet-based cognitive-behavioural therapy for social anxiety disorder in routine psychiatric care. BMJ Open. 2015 Jun 23;5(6):e007902. doi: 10.1136/bmjopen-2015-007902. http://bmjopen.bmj.com/cgi/pmidlookup?view=long&pmid=26105031 .bmjopen-2015-007902 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Hedman E, Ljótsson B, Kaldo V, Hesser H, El Alaoui S, Kraepelien M, Andersson E, Rück C, Svanborg C, Andersson G, Lindefors N. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord. 2014 Feb;155:49–58. doi: 10.1016/j.jad.2013.10.023.S0165-0327(13)00765-9 [DOI] [PubMed] [Google Scholar]
  • 26.Hedman E, Ljótsson B, Rück C, Bergström J, Andersson G, Kaldo V, Jansson L, Andersson E, Andersson E, Blom K, El Alaoui S, Falk L, Ivarsson J, Nasri B, Rydh S, Lindefors N. Effectiveness of internet-based cognitive behaviour therapy for panic disorder in routine psychiatric care. Acta Psychiatr Scand. 2013 Dec;128(6):457–67. doi: 10.1111/acps.12079. [DOI] [PubMed] [Google Scholar]
  • 27.Backhaus A, Agha Z, Maglione ML, Repp A, Ross B, Zuest D, Rice-Thorp NM, Lohr J, Thorp SR. Videoconferencing psychotherapy: a systematic review. Psychol Serv. 2012 May;9(2):111–31. doi: 10.1037/a0027924.2012-14616-001 [DOI] [PubMed] [Google Scholar]
  • 28.Klein B, Cook S. Preferences for e-mental health services amongst an online Australian sample? Electron J Appl Psychol. 2010 May 25;6(1):27–38. doi: 10.7790/ejap.v6i1.184. [DOI] [Google Scholar]
  • 29.Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. 2014 Apr 11;14:109. doi: 10.1186/1471-244X-14-109. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/1471-244X-14-109 .1471-244X-14-109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Wahbeh H, Svalina MN, Oken BS. Group, one-on-one, or internet? Preferences for mindfulness meditation delivery format and their predictors. Open Med J. 2014;1:66–74. doi: 10.2174/1874220301401010066. http://europepmc.org/abstract/MED/27057260 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Wallin EEK, Mattsson S, Olsson EMG. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health. 2016 Jun 14;3(2):e25. doi: 10.2196/mental.5324. http://mental.jmir.org/2016/2/e25/ v3i2e25 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Mohr DC, Riper H, Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry. 2018 Feb 01;75(2):113–114. doi: 10.1001/jamapsychiatry.2017.3838.2664967 [DOI] [PubMed] [Google Scholar]
  • 33.Casey LM, Joy A, Clough BA. The impact of information on attitudes toward e-mental health services. Cyberpsychol Behav Soc Netw. 2013 Aug;16(8):593–8. doi: 10.1089/cyber.2012.0515. [DOI] [PubMed] [Google Scholar]
  • 34.Apolinário-Hagen J, Kemper J, Stürmer C. Public acceptability of e-mental health treatment services for psychological problems: a scoping review. JMIR Ment Health. 2017 Apr 03;4(2):e10. doi: 10.2196/mental.6186. http://mental.jmir.org/2017/2/e10/ v4i2e10 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.March S, Day J, Ritchie G, Rowe A, Gough J, Hall T, Yuen CYJ, Donovan CL, Ireland M. Attitudes toward e-mental health services in a community sample of adults: online survey. J Med Internet Res. 2018 Feb 19;20(2):e59. doi: 10.2196/jmir.9109. http://www.jmir.org/2018/2/e59/ v20i2e59 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Ajzen I. Nature and operation of attitudes. Annu Rev Psychol. 2001;52:27–58. doi: 10.1146/annurev.psych.52.1.27.52/1/27 [DOI] [PubMed] [Google Scholar]
  • 37.Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Processes. 1991 Dec;50(2):179–211. doi: 10.1016/0749-5978(91)90020-T. [DOI] [Google Scholar]
  • 38.Venkatesh. Morris. Davis. Davis User acceptance of information technology: toward a unified view. MIS Q. 2003;27(3):425. doi: 10.2307/30036540. [DOI] [Google Scholar]
  • 39.Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res. 2016 Dec 23;18(12):e337. doi: 10.2196/jmir.6003. http://www.jmir.org/2016/12/e337/ v18i12e337 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Dockweiler C, Kupitz A, Hornberg C. [Acceptance of online-based therapy by patients with light to moderate depressive disorders] Gesundheitswesen. 2017 Nov 10; doi: 10.1055/s-0043-119287. (forthcoming) [DOI] [PubMed] [Google Scholar]
  • 41.Apolinário-Hagen J, Fritsche L, Bierhals C, Salewski C. Improving attitudes toward e-mental health services in the general population via psychoeducational information material: a randomized controlled trial. Internet Intervent. 2018 Jan 5; doi: 10.1016/j.invent.2017.12.002. (forthcoming) https://www.sciencedirect.com/science/article/pii/S221478291730074X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-mental health: an exploratory survey study for understanding public attitudes toward internet-based psychotherapy in Germany. JMIR Ment Health. 2017 Feb 23;4(1):e8. doi: 10.2196/mental.6375. http://mental.jmir.org/2017/1/e8/ v4i1e8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Williams R, Farquharson L, Palmer L, Bassett P, Clarke J, Clark DM, Crawford MJ. Patient preference in psychological treatment and associations with self-reported outcome: national cross-sectional survey in England and Wales. BMC Psychiatry. 2016 Jan 15;16:4. doi: 10.1186/s12888-015-0702-8. https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-015-0702-8 .10.1186/s12888-015-0702-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Kayrouz R, Dear BF, Johnston L, Keyrouz L, Nehme E, Laube R, Titov N. Intergenerational and cross-cultural differences in emotional wellbeing, mental health service utilisation, treatment-seeking preferences and acceptability of psychological treatments for Arab Australians. Int J Soc Psychiatry. 2015 Aug;61(5):484–91. doi: 10.1177/0020764014553004.0020764014553004 [DOI] [PubMed] [Google Scholar]
  • 45.Eichenberg C, Wolters C, Brähler E. The internet as a mental health advisor in Germany--results of a national survey. PLoS One. 2013;8(11):e79206. doi: 10.1371/journal.pone.0079206. http://dx.plos.org/10.1371/journal.pone.0079206 .PONE-D-13-09176 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Choi I, Sharpe L, Li S, Hunt C. Acceptability of psychological treatment to Chinese- and Caucasian-Australians: internet treatment reduces barriers but face-to-face care is preferred. Soc Psychiatry Psychiatr Epidemiol. 2015 Jan;50(1):77–87. doi: 10.1007/s00127-014-0921-1. [DOI] [PubMed] [Google Scholar]
  • 47.Mohr DC, Siddique J, Ho J, Duffecy J, Jin L, Fokuo JK. Interest in behavioral and psychological treatments delivered face-to-face, by telephone, and by internet. Ann Behav Med. 2010 Aug;40(1):89–98. doi: 10.1007/s12160-010-9203-7. http://europepmc.org/abstract/MED/20652466 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Wells M, Mitchell KJ, Finkelhor D, Becker-Blease KA. Online mental health treatment: concerns and considerations. Cyberpsychol Behav. 2007 Jun;10(3):453–9. doi: 10.1089/cpb.2006.9933. [DOI] [PubMed] [Google Scholar]
  • 49.Wangberg SC, Gammon D, Spitznogle K. In the eyes of the beholder: exploring psychologists' attitudes towards and use of e-therapy in Norway. Cyberpsychol Behav. 2007 Jun;10(3):418–23. doi: 10.1089/cpb.2006.9937. [DOI] [PubMed] [Google Scholar]
  • 50.Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, Cieslak R, Ebert DD, Etchmendy E, Herrero R, Kleiboer A, Krieger T, García-Palacios A, Cerga-Pashoja A, Smoktunowicz E, Urech A, Vis C, Andersson G. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Intervent. 2017 Jun;8:1–9. doi: 10.1016/j.invent.2017.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Weaver JB, Mays D, Weaver SS, Hopkins GL, Eroglu D, Bernhardt JM. Health information-seeking behaviors, health indicators, and health risks. Am J Public Health. 2010 Aug;100(8):1520–5. doi: 10.2105/AJPH.2009.180521.AJPH.2009.180521 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Apolinário-Hagen J, Trachsel DA, Anhorn A, Holsten B, Werner V, Krebs S. Exploring individual differences in online and face-to-face help-seeking intentions in case of impending mental health problems: the role of adult attachment, perceived social support, psychological distress and self-stigma. J Health Soc Sci. 2016;1(3):223–240. doi: 10.19204/2016/xplr24. http://journalhss.com/wp-content/uploads/JHHS13_223-240.pdf . [DOI] [Google Scholar]
  • 53.Bowlby J. Attachment and Loss. New York, NY: Basic Books; 1980. [Google Scholar]
  • 54.Vogel DL, Wei M. Adult attachment and help-seeking intent: the mediating roles of psychological distress and perceived social support. J Couns Psychol. 2005 Jul;52(3):347–357. doi: 10.1037/0022-0167.52.3.347. [DOI] [Google Scholar]
  • 55.Maunder RG, Hunter JJ. Attachment and psychosomatic medicine: developmental contributions to stress and disease. Psychosom Med. 2001;63(4):556–67. doi: 10.1097/00006842-200107000-00006. [DOI] [PubMed] [Google Scholar]
  • 56.Wulf M, Machado AJ, Tress W. [The influence of the attachment dimensions “anxiety” and “avoidance” on psychosomatic complaints] Z Psychosom Med Psychother. 2012;58(4):374–84. doi: 10.13109/zptm.2012.58.4.374. [DOI] [PubMed] [Google Scholar]
  • 57.Ciechanowski PS, Walker EA, Katon WJ, Russo JE. Attachment theory: a model for health care utilization and somatization. Psychosom Med. 2002;64(4):660–7. doi: 10.1097/01.psy.0000021948.90613.76. [DOI] [PubMed] [Google Scholar]
  • 58.Maunder RG, Hunter JJ. Assessing patterns of adult attachment in medical patients. Gen Hosp Psychiatry. 2009;31(2):123–30. doi: 10.1016/j.genhosppsych.2008.10.007.S0163-8343(08)00214-4 [DOI] [PubMed] [Google Scholar]
  • 59.Fraley RC, Heffernan ME, Vicary AM, Brumbaugh CC. The Experiences in Close Relationships-Relationship Structures questionnaire: a method for assessing attachment orientations across relationships. Psychol Assess. 2011 Sep;23(3):615–25. doi: 10.1037/a0022898.2011-06119-001 [DOI] [PubMed] [Google Scholar]
  • 60.Fraley C. Relationship Structures (ECR-RS) Questionnaire. 2014. Aug, [2017-08-03]. http://internal.psychology.illinois.edu/~rcfraley/measures/relstructures.htm .
  • 61.Ehrenthal JC, Dinger U, Lamla A, Funken B, Schauenburg H. [Evaluation of the German version of the attachment questionnaire “Experiences in Close Relationships--Revised” (ECR-RD)] Psychother Psychosom Med Psychol. 2009 Jun;59(6):215–23. doi: 10.1055/s-2008-1067425. [DOI] [PubMed] [Google Scholar]
  • 62.Bond A, Lader M. The use of analogue scales in rating subjective feelings. Br J Med Psychol. 1974;47(3):211–218. doi: 10.1111/j.2044-8341.1974.tb02285.x. [DOI] [Google Scholar]
  • 63.Fliege H, Rose M, Arck P, Levenstein S, Klapp BF. Validierung des “Perceived Stress Questionnaire“ (PSQ) an einer deutschen Stichprobe. Diagnostica. 2001 Jul;47(3):142–152. doi: 10.1026//0012-1924.47.3.142. [DOI] [Google Scholar]
  • 64.Apolinário-Hagen J, Groenewold SD, Fritsche L, Kemper J, Krings L, Salewski C. Die Gesundheit Fernstudierender stärken. Präv Gesundheitsf. 2017 Oct 17;13(2):151–158. doi: 10.1007/s11553-017-0620-3. [DOI] [Google Scholar]
  • 65.Gieselmann A, Böckermann M, Pietrowsky R. Internetbasierte Gesundheitsinterventionen. Psychotherapeut. 2015 Jun 20;60(5):433–440. doi: 10.1007/s00278-015-0038-3. [DOI] [Google Scholar]
  • 66.Baumeister H, Seifferth H, Lin J, Nowoczin L, Lüking M, Ebert D. Impact of an acceptance facilitating intervention on patients’ acceptance of internet-based pain interventions: a randomized controlled trial. Clin J Pain. 2015 Jun;31(6):528–35. doi: 10.1097/AJP.0000000000000118. [DOI] [PubMed] [Google Scholar]
  • 67.Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev. 2016 Feb;43:1–16. doi: 10.1016/j.cpr.2015.11.004.S0272-7358(15)00154-3 [DOI] [PubMed] [Google Scholar]
  • 68.Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, Mackinnon A, Meyer B, Botella C, Littlewood E, Andersson G, Christensen H, Klein JP, Schröder J, Bretón-López J, Scheider J, Griffiths K, Farrer L, Huibers MJH, Phillips R, Gilbody S, Moritz S, Berger T, Pop V, Spek V, Cuijpers P. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017 Apr 01;74(4):351–359. doi: 10.1001/jamapsychiatry.2017.0044.2604310 [DOI] [PubMed] [Google Scholar]
  • 69.Melioli T, Bauer S, Franko DL, Moessner M, Ozer F, Chabrol H, Rodgers RF. Reducing eating disorder symptoms and risk factors using the internet: a meta-analytic review. Int J Eat Disord. 2016 Jan;49(1):19–31. doi: 10.1002/eat.22477. [DOI] [PubMed] [Google Scholar]
  • 70.Späth C, Hapke U, Maske U, Schröder J, Moritz S, Berger T, Meyer B, Rose M, Nolte S, Klein JP. Characteristics of participants in a randomized trial of an internet intervention for depression (EVIDENT) in comparison to a national sample (DEGS1) Internet Intervent. 2017 Sep;9:46–50. doi: 10.1016/j.invent.2017.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Baumeister H, Nowoczin L, Lin J, Seifferth H, Seufert J, Laubner K, Ebert DD. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res Clin Pract. 2014 Jul;105(1):30–9. doi: 10.1016/j.diabres.2014.04.031.S0168-8227(14)00214-9 [DOI] [PubMed] [Google Scholar]
  • 72.Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2016 Mar 12;3:CD011565. doi: 10.1002/14651858.CD011565.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Baumeister H, Lin J, Ebert DD. Internet- and mobile-based approaches: psycho-social diagnostics and treatment in medical rehabilitation. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2017 Apr;60(4):436–444. doi: 10.1007/s00103-017-2518-9.10.1007/s00103-017-2518-9 [DOI] [PubMed] [Google Scholar]
  • 74.Ebert D, Van Daele T, Nordgreen T, Karekla M, Compare T, Zarbo C, Brugnera A, Oeverland S, Trebbi G, Jensen K, Kaehlke F, on behalf of the EFPA E-Health Taskforce. Baumeister H. Internet and mobile-based psychological interventions: applications, efficacy and potential for improving mental health: a report of the EFPA e-health taskforce. Eur Psychol. 2018 (forthcoming) [Google Scholar]
  • 75.Ebert DD, Lehr D, Smit F, Zarski A, Riper H, Heber E, Cuijpers P, Berking M. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. 2014 Aug 07;14:807. doi: 10.1186/1471-2458-14-807. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-14-807 .1471-2458-14-807 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Ebert DD, Heber E, Berking M, Riper H, Cuijpers P, Funk B, Lehr D. Self-guided internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med. 2016 May;73(5):315–23. doi: 10.1136/oemed-2015-103269.oemed-2015-103269 [DOI] [PubMed] [Google Scholar]
  • 77.Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, Riper H. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res. 2017 Feb 17;19(2):e32. doi: 10.2196/jmir.5774. http://www.jmir.org/2017/2/e32/ v19i2e32 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Heber E, Lehr D, Ebert DD, Berking M, Riper H. Web-based and mobile stress management intervention for employees: a randomized controlled tria. J Med Internet Res. 2016 Jan 27;18(1):e21. doi: 10.2196/jmir.5112. http://www.jmir.org/2016/1/e21/ v18i1e21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, Cuijpers P, Kessler RC, Berking M, Lehr D, Ebert DD. Effectiveness of an internet- and app-based intervention for college students with elevated stress: results of a randomized controlled trial. J Med Internet Res. 2018 Apr 23;20(4):e136. doi: 10.2196/jmir.9293. http://www.jmir.org/2018/4/e136/ v20i4e136 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med. 2015 Jan;45(2):231–46. doi: 10.1017/S0033291714000701.S0033291714000701 [DOI] [PubMed] [Google Scholar]
  • 81.Muñoz RF. Using evidence-based internet interventions to reduce health disparities worldwide. J Med Internet Res. 2010 Dec 17;12(5):e60. doi: 10.2196/jmir.1463. http://www.jmir.org/2010/5/e60/ v12i5e60 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, Newby JM. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. 2018 Apr;55:70–78. doi: 10.1016/j.janxdis.2018.01.001. https://linkinghub.elsevier.com/retrieve/pii/S0887-6185(17)30447-4 .S0887-6185(17)30447-4 [DOI] [PubMed] [Google Scholar]
  • 83.Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med. 2006 Dec;36(12):1737–46. doi: 10.1017/S0033291706008695.S0033291706008695 [DOI] [PubMed] [Google Scholar]
  • 84.Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. 2015 May 1;176:9–17. doi: 10.1016/j.jad.2015.01.056.S0165-0327(15)00069-5 [DOI] [PubMed] [Google Scholar]
  • 85.Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018 Jan;47(1):1–18. doi: 10.1080/16506073.2017.1401115. [DOI] [PubMed] [Google Scholar]
  • 86.Newby JM, Mewton L, Williams AD, Andrews G. Effectiveness of transdiagnostic Internet cognitive behavioural treatment for mixed anxiety and depression in primary care. J Affect Disord. 2014 Aug;165:45–52. doi: 10.1016/j.jad.2014.04.037.S0165-0327(14)00231-6 [DOI] [PubMed] [Google Scholar]
  • 87.Nordgreen T, Gjestad R, Andersson G, Carlbring P, Havik OE. The implementation of guided Internet-based cognitive behaviour therapy for panic disorder in a routine-care setting: effectiveness and implementation efforts. Cogn Behav Ther. 2018 Jan;47(1):62–75. doi: 10.1080/16506073.2017.1348389. [DOI] [PubMed] [Google Scholar]
  • 88.Titov N, Dear BF, Staples LG, Bennett-Levy J, Klein B, Rapee RM, Shann C, Richards D, Andersson G, Ritterband L, Purtell C, Bezuidenhout G, Johnston L, Nielssen OB. MindSpot Clinic: an accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatr Serv. 2015 Oct;66(10):1043–50. doi: 10.1176/appi.ps.201400477. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Exploratory factor analysis for the e-therapy attitudes measure (including pattern and structure matrices).


Articles from JMIR Mental Health are provided here courtesy of JMIR Publications Inc.

RESOURCES