Skip to main content
JMIR Formative Research logoLink to JMIR Formative Research
. 2022 Sep 16;6(9):e39787. doi: 10.2196/39787

Waiting Lists for Psychotherapy and Provider Attitudes Toward Low-Intensity Treatments as Potential Interventions: Survey Study

Allison Peipert 1, Anne C Krendl 1, Lorenzo Lorenzo-Luaces 1,
Editor: Amaryllis Mavragani
Reviewed by: Stephen Schueller, Kazuki Matsumoto
PMCID: PMC9526124  PMID: 36112400

Abstract

Background

Common mental disorders, including depression and anxiety, are leading causes of disability worldwide. Digital mental health interventions, such as web-based self-help and other low-intensity treatments (LITs) that are not digital (eg, bibliotherapy), have the potential to reach many individuals by circumventing common barriers present in traditional mental health care. It is unclear how often LITs are used in clinical practice, or whether providers would be interested in their use for treatment waiting lists.

Objective

The aims of this study were to (1) describe current practices for treatment waiting lists, (2) describe providers’ attitudes toward digital and nondigital LITs for patients on a waiting list, and (3) explore providers’ willingness to use digital and nondigital LITs and their decisions to learn about them.

Methods

We surveyed 141 practicing mental health care providers (eg, therapists and psychologists) and provided an opportunity for them to learn about LITs.

Results

Most participants reported keeping a waiting list. Few participants reported currently recommending digital or nondigital LITs, though most were willing to use at least one for patients on their waiting list. Attitudes toward digital and nondigital LITs were neutral to positive. Guided digital and nondigital LITs were generally perceived to be more effective but less accessible, and unguided interventions were perceived to be less effective but more accessible. Most participants selected to access additional information on LITs, with the most popular being web-based self-help.

Conclusions

Results suggest providers are currently not recommending LITs for patients on treatment waiting lists but would be willing to recommend them. Future work should explore barriers and facilitators to implementing digital and nondigital LITs for patients on treatment waiting lists.

Keywords: psychotherapy, CBT, cognitive behavioral therapy, behavior therapy, digital mental health, self-help, support group, mental health, digital health, eHealth, low-intensity intervention, survey, waiting list, health system, health care delivery, health care professional, care provider, bibliotherapy, attitude, perception, digital intervention, web-based intervention, depression, anxiety, mental disorder

Introduction

Common mental disorders (CMDs), such as depression, anxiety, and insomnia, are leading causes of disability worldwide [1-3] and a significant burden to the health care system [4]. Mental health needs have increased with the COVID-19 pandemic, such that approximately 3 in 10 adults in the United States report clinically elevated anxiety or depression symptoms—a number that may have tripled since 2019 [5]. Effective treatments exist for CMDs, including psychotherapy and pharmacotherapy. However, despite the prevalence of CMDs and the efficacy of existing treatments, few people with mental health concerns receive any form of treatment [6,7].

Barriers related to receiving traditional psychotherapy or other forms of treatment include time availability, lack of financial resources (including insurance coverage), stigma, and low provider availability [6,8]. During the COVID-19 pandemic, many of these barriers have been amplified, particularly provider availability and waiting time for treatment. Increased delays in treatment have been reported across a number of health service areas, including oncology, elective surgery, and general health care [9,10]. Waiting lists are used by providers as the demand for services often surpasses provider capacity. Generally, this involves individuals seeking treatment to be placed on a list prior to receiving a scheduled appointment or scheduling appointments far in the future. Existing work suggests that treatment waiting lists are commonly used for mental health services, but there is substantial variability in their design and management [11]. A relatively agreed-upon feature of waiting lists is that they are associated with a rather long time waiting for psychological services, raising a number of ethical issues, and forcing individuals to seek out alternate services.

Waiting to receive treatment for mental health specifically can have detrimental effects. For example, waiting for treatment can be associated with increased symptom severity, including symptom deterioration [12]. Additionally, a greater waiting time is associated with a lower likelihood of ultimately engaging with the treatment [13]. Finally, the pretreatment waiting times may also be associated to worse patient engagement even once patients initiate treatment [14,15], decreased probability of improvement with treatment, and increased risk of dropout [13,16]. Patients themselves also identify waiting for treatment as a barrier to care, with some studies reporting negative psychological and behavioral outcomes when placed on treatment waiting lists for mental health care [17].

Current efforts to address barriers to mental health treatment have made little impact on the burden of mental health. For example, research in places where the number of mental health providers has increased show public health burdens of mental illness remain unchanged [18]. Furthermore, some researchers report the public health burden of CMDs, such as mood and anxiety disorders, would show little reduction even if the number of providers doubled instantly [6]. These findings suggest that the current model of mental health care needs to change in order to accommodate the burden of CMDs [7].

Various low-intensity treatments (LITs) exist that are relatively scalable and have demonstrated efficacy for depression, anxiety, and other CMDs. Many of these LITs can be used with additional guidance by a professional or paraprofessional (ie, guided) or can be self-guided by the individual user (ie, unguided) and can be accessed through a digital or nondigital platform. Although face-to-face therapy is one of the most well-studied treatments for CMDs, both guided and unguided LITs have been proven to be effective relative to controls like waiting lists and care as usual [19-22]. In general, unguided self-help is better than control groups (eg, sham internet applications and care as usual), and guided self-help is more efficacious than both controls and unguided self-help [23], with guided self-help appearing to have similar efficacy to face-to-face therapy [24]. One commonly studied nondigital LIT is bibliotherapy, a form of self-help using print materials [25]. Meta-analyses of randomized controlled trials of bibliotherapy for depression support its efficacy, yielding large mean effect sizes [19,20]. Guided and unguided digital mental health interventions (DMHIs), including internet-based cognitive behavioral therapy (iCBT) or mental health apps, are effective at treating depression relative to controls like waiting lists and care as usual [24,26]. Together, these studies suggest that LITs provide a tenable and effective treatment alternative for people with CMDs.

Despite research supporting the efficacy of digital and nondigital LITs, it is unclear to what extent they are used in clinical practice [27]. We propose that one place where digital and nondigital LITs may be impactful is in the provision of services to individuals waiting for treatment [28]. The period in which people are waiting for psychological services is an important time for intervention because individuals have already overcome some barriers to treatment seeking, including stigma and the lack of contact with a mental health provider, only to be faced with another barrier (ie, time waiting without receiving services). Schleider et al [28] made a similar observation in a small open trial, where they offered a nondigital LIT to patients on a waiting list. We could not identify a study where provider attitudes toward digital or nondigital LITs for patients on waiting lists were explored.

There is limited research on the use of LITs for patients on waiting lists; however, preliminary studies have supported the feasibility of implementing mental health apps for patients waiting for treatment [29,30]. Other researchers have explored barriers and facilitators of DMHI implementation in clinical practice more broadly. In one study comparing implementers and nonimplementers of iCBT, the two groups differed significantly in their perceived knowledge, confidence in when to recommend iCBT, perception of technical problems, organizational resources, and patient referral process allowing for iCBT inclusion [27]. Thus, there may be differences in the perceptions and attitudes of those who choose to implement versus those who choose not to implement digital and nondigital LITs, such as iCBT, in their practice. However, we know little about general attitudes toward LITs and, specifically, their potential to be implemented in clinical practice for patients on a waiting list. This is important for two reasons. First, extensive work has shown that attitudes predict behavior [31]; thus, negative attitudes toward digital and nondigital LITs may predict reduced willingness to endorse them. Second, identifying the factors that dissociate between willingness and unwillingness to implement digital and nondigital LITs could inform how future work should shape interventions to promote providers’ LIT use, particularly for practices with prohibitively long wait lists.

The aims of our study were the following: (1) describing current practices surrounding waiting lists, including how often they are used and what providers do with individuals on their waiting lists (aim 1); (2) describing providers’ attitudes toward digital and nondigital LITs for patients on their waiting lists (aim 2); and (3) exploring predictors of providers’ willingness to use digital and nondigital LITs and their decisions to learn more about them (aim 3).

Methods

We surveyed currently practicing mental health care providers on their attitudes toward LITs, including guided and unguided bibliotherapy and DMHIs. Additionally, we included a behavioral task that provided an option for participants to receive additional information about LITs.

Recruitment and Eligibility

Participants were recruited using a survey link posted via emails to professional organization listserves, specifically the American Psychological Association Division 29—Society for the Advancement of Psychotherapy, the Association for Behavioral and Cognitive Therapies, and social media (ie, Twitter). The survey, which was advertised as a survey on “waiting lists and possible resources,” began with a Study Information Sheet outlining the purpose of the research, eligibility criteria, limits of confidentiality, risks and benefits, and compensation. Participants were eligible to participate if they identified as being (1) over the age of 18 years, (2) a practicing licensed mental health care professional, and (3) currently providing at least 1 hour of clinical services per week. We required participants to have to conduct at least an hour of clinic work to ensure participants were currently providing at least some clinical services, but we did not limit the study to those whose only duties were clinical work.

We received 145 survey responses. Two responses were removed after being determined to be from the same individual. Two responses were removed for not providing responses to all questions. The remaining 141 participants were included in data analysis.

Ethics Approval

Study procedures were approved by Indiana University Bloomington’s Human Subjects and Institutional Review Board (10503).

Data

The survey, which can be found in the Open Science Framework website [32], was divided into 4 sections. Section 1 collected demographic information (eg, age, gender, race, and ethnicity) and clinical background (eg, state or country of licensure, level of education, clinical practice setting, psychotherapy theoretical orientation, satisfaction with clinical work, years of clinical experience, and average hours of clinical services provided per week).

Section 2 was designed to address aim 1 of our study. In this section, participants were asked to provide information on their current waiting list practices. This included whether their current clinical setting kept a treatment waiting list (vs not keeping a waiting list or scheduling appointments several months in advance), the estimated time patients spent on a waiting list, the effect of the COVID-19 pandemic on waiting time, and current actions taken for patients on a treatment waiting list.

In section 3, participants were provided with a brief description of the following LITs: unguided bibliotherapy, guided bibliotherapy, unguided web-based self-help, guided web-based self-help, and patient support groups. We chose these LITs because they have been relatively well researched, and research suggests they are effective. Descriptions of each LIT type were provided to ensure that respondents were equally familiar with each intervention. To address aim 2 of our study, for each LIT, respondents were asked to rate their perceived effectiveness (eg, “I believe this option would be effective for patients on a treatment waiting list”), availability (eg, “I believe this option is available and accessible to use with patients on my waiting list”), and willingness to use LIT (eg, “I am willing to use this modality for patients on a waiting list”). Responses were given on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree).

Section 4 addressed aim 3 of our study by asking respondents if they would like to receive any additional information about the following LITs: bibliotherapy, web-based self-help, or patient support groups. They were subsequently offered information on each LIT, and we tracked which participants chose to receive more information (ie, whether they engaged in information-seeking behavior).

Missing Data

Missingness in demographic and clinical variables was relatively low (0%-1.4%), with the exception of age (13.5%). Missingness in the attitude variables was greater (10.6%-12.1%), reflecting survey dropout (ie, participants who answered no subsequent questions). We completed regression analyses with the original data set and an imputed data set. The latter imputed missing values for all variables included in the regression analyses using a machine learning algorithm with random forests using the R package “missForest” [33].

Statistical Analysis

Analyses were conducted using the R programming language (version 4.2.1; the R Core Team) [34]. To describe waiting list practices, we present response frequencies and descriptive statistics (aim 1). We compared descriptive statistics and response frequencies of providers’ perceived efficacy, availability and accessibility, as well as willingness to use the different LITs (aim 2).

To explore predictors of willingness to use digital and nondigital LITs (aim 3), we ran 5 linear regressions, one for each LIT under consideration. Willingness to use each specific intervention was regressed on demographic information (ie, gender, age, and education), professional background (ie, theoretical orientation and practice setting), and clinical variables (ie, the use of a waiting list, clinical satisfaction, and clinical hours per week). In these models, an average “willingness” response variable was included in the regression to control for participant willingness to use other interventions, excluding the one being predicted. Regressions were completed using the original data set and the imputed data set.

To explore predictors of information seeking for digital and nondigital LITs (aim 3), we conducted a series of regressions to explore demographic, professional background and attitudinal predictors of requesting additional information. Specifically, we conducted 3 binomial logistic regressions with the dependent variables of requesting additional information (ie, selecting information vs not selecting information) on the following: (1) web-based self-help, (2) bibliotherapy, and (3) patient support groups. Each model included demographic information (eg, gender, education, and age), clinical variables (eg, theoretical orientation, clinical satisfaction, years of experience, clinical hours, and presence of a waiting list), modality-specific attitudes (eg, willingness to use the specific intervention and perceived availability and accessibility of the specific intervention), and controls for overall rating tendency (eg, average willingness to use other interventions and average availability or accessibility of other interventions).

Transparency and Openness

We report how we determined our sample, all data exclusions, all manipulations, and all measures in the study. All data, analysis code, and research materials are available on the Open Science Framework website [32]. This study’s design and its analysis were not preregistered. No other papers currently use these data.

Results

Sample Characteristics

Demographic and clinical variables of the sample are summarized in Table 1. The sample primarily included female, non-Hispanic, White participants. Participants’ average age was about 39 years. Most participants in the sample had a PhD degree and were prescribed to an orientation (eg, cognitive or third-wave behavioral therapy) related to cognitive behavioral therapy (CBT). About half of the participants were employed in a private practice setting with an average of 10 (SD=10.4) years of clinical experience.

Table 1.

Demographic and clinical variables of 141 providers who responded to a survey of waiting lists and low-intensity treatments.

Demographics Values
Age (years), mean (SD) 39.2 (10.1)
Gender, n (%)

Female 92 (65.2)

Male 45 (31.9)

Nonbinary 2 (1.4)

No answer 2 (1.4)
Race or ethnicity, n (%)

Non-Hispanic White 115 (81.5)

Non-Hispanic Black 1 (0.7)

Hispanic 7 (5)

Asian 6 (4.3)

AIANa, MENAb, NHPIc, or other 6 (4.3)

Multiracial 6 (4.3)
Education, n (%)

Associate of Arts degree 1 (0.7)

Bachelor of Arts degree 3 (2.1)

Master of Arts degree 17 (12.1)

PhD 99 (70.2)

PsyD 18 (12.8)

Other 3 (2.1)
Private practice (vs no private practice), n (%) 71 (50.7)
Clinical orientation—CBTd (vs other), n (%) 125 (88.7)
Clinical satisfaction, n (%)

Not satisfied 0 (0)

Slightly satisfied 7 (5)

Neutral 23 (16.4)

Very satisfied 80 (57.1)

Extremely satisfied 30 (21.4)
Clinical experience (years), mean (SD) 10.4 (10.4)
Clinical hours per week, mean (SD) 18.3 (10.9)

aAIAN: American Indian or Alaska Native.

bMENA: Middle Eastern or North African.

cNHPI: Native Hawaiian or Pacific Islander.

dCBT: cognitive behavioral therapy.

Waiting List Characteristics

The majority of survey respondents (n=94, 69.1%) endorsed keeping a formal treatment waiting list (Table 2) with the estimated waiting time averaging about 13 weeks. Others reported not keeping a waiting list but scheduling patients “a couple of months in advance” (n=23, 16.9%). Most of the respondents who endorsed keeping a waiting list also noted their estimated waiting time had been impacted by the COVID-19 pandemic (n=68, 73%) and estimated waiting times around 9 weeks prior to the pandemic.

Table 2.

Features of treatment waiting lists for 141 providers who responded to our survey on waiting lists and low-intensity treatments.

Characteristics Values Missing values, n (%)
Waiting list kept, n (%) 5 (3.5)

Yes 94 (69.1)

No 23 (16.9)

No, but scheduling appointments months in advance 19 (14)
Impacted by COVID-19, n (%) 1 (1.1)

Yes 68 (73.1)

No 25 (26.9)
Wait time, mean (SD)

Current wait time (weeks) 12.8 (10.6)

PreCOVID-19 wait time (weeks) 9.4 (11.7)
Waiting list resources used by therapists who kept a waiting list (n=106), n (%) 7 (6.2)

Name or contact information 101 (95)

Unstructured assessment 77 (72.6)

Structured assessment 24 (22.6)

Referrals (psychology or psychiatry) 88 (83)

Brief psychoeducation 29 (27.4)

Books 17 (16)

Apps 13 (12.3)

Support groups 20 (18.9)

Other 9 (8.5)

The majority of participants who kept a waiting list or scheduled patients for months in advance endorsed taking names or contact information, completing an unstructured brief assessment, and providing referrals. Few reported completing a structured assessment or provided brief psychoeducation, and even fewer (n=13-20, <20%) reported providing information on apps, books, or support groups.

Attitudes Toward Digital and Nondigital Low-Intensity Treatments

Figure 1 shows respondents’ ratings of willingness to use, perceived efficacy, and availability of different interventions. Average responses were generally between 3 (“neutral”) and 4 (“somewhat agree”). The exception to this was the perceived low accessibility and availability of patient support groups (mean 2.9, SD 1.2). Average attitudes were highly correlated; specifically, the willingness to use LITs was related to its perceived efficacy (r122= 0.76, 95% CI 0.67-0.83; P<.001).

Figure 1.

Figure 1

Willingness to use, perceived availability, and perceived efficacy of different low-intensity interventions presented to 141 mental health providers. Box plot indicates median and interquartile range. Triangle and error bars indicate mean values and 95% CI. Violin plot shows distribution of the data.

Predictors of Willingness to Use an Intervention

We used multiple linear regressions to identify demographic, clinical, waiting list, and attitude variables predicting participants’ ratings of willingness to use a LIT (Table S1 in Multimedia Appendix 1). Across models, averaged willingness to use other LITs predicted the specific likelihood of willingness to use another LIT. For example, the willingness to use unguided bibliotherapy was strongly predicted by the average willingness to use support groups, guided bibliotherapy, and web-based self-help (β=.65, 95% CI 0.45-0.84).

Other predictors of willingness to use a LIT varied across the LITs probed. Compared to individuals in other practice settings, individuals in private practice were more willing to use unguided bibliotherapy (β=.22, 95% CI 0.02-0.42) and less willing to use guided bibliotherapy (β=–.20, 95% CI –0.35 to –0.04). Additionally, individuals who reported a CBT theoretical orientation (vs not reporting one) were more willing to use unguided web-based self-help (β=.22, 95% CI 0.08-0.35). There were no consistent significant predictors of willingness to use support groups. More detailed information is presented in Table S1 in Multimedia Appendix 1.

Information Seeking About Digital and Nondigital Low-Intensity Treatments

Most (n=85, 70%) respondents indicated they would like to receive additional information about at least one of these modalities: web-based self-help (n=78, 63%), bibliotherapy (n=66, 53%), or support groups (n=61, 50%). We explored demographic, clinical, waiting list, and attitude variables predicting participants’ responses to receive additional information. Overall, there were few strong predictors of information seeking for LITs (Table 3 and Table 4). Willingness to use the specific LIT was predictive of information seeking for web-based self-help (odds ratio [OR]=2.20, 95% CI 1.20-4.28) and bibliotherapy (OR=1.66, 95% CI 1.02-2.80). Relative to individuals in other practice settings, individuals in private practice were more likely to seek information for web-based self-help (OR=5.33, 95% CI 1.48-23.42). There were no consistent predictors of seeking information about support groups.

Table 3.

Logistic regression analyses predicting providers’ information seeking for low-intensity interventions from demographic, clinical, and practice predictors in original data sets.

Original data (N=104) Web-based self-help Bibliotherapy Support groups

ORa (95% CI) Zb P value OR (95% CI) Z P value OR (95% CI) Z P value
Intercept 0.16 (0.00-8.08) –0.91 .36 0.56 (0.01-31.65) –0.28 .78 0.11 (0.00-5.37) –1.10 .27
Availability (specific) 0.71 (0.41-1.20) –1.23 .22 0.94 (0.55-1.58) –0.23 .82 0.98 (0.66-1.43) –0.12 .90
Willingness (specific) 2.20 (1.20-4.28) 2.45 .01c 1.66 (1.02-2.80) 1.99 .05c 1.24 (0.77-2.01) 0.87 .38
Availability (general) 1.51 (0.77-3.04) 1.19 .23 1.08 (0.55-2.14) 0.22 .83 0.97 (0.52-1.79) –0.11 .91
Willingness (general) 1.29 (0.59-2.84) 0.65 .51 1.64 (0.84-3.38) 1.41 .16 1.70 (0.88-3.44) 1.54 .12
Age 0.97 (0.92-1.01) –1.36 .17 0.99 (0.94-1.04) –0.46 .64 0.97 (0.93-1.02) –1.13 .26
Female (vs male) 0.41 (0.12-1.20) –1.57 .12 0.84 (0.31-2.24) –0.35 .73 0.69 (0.27-1.75) –0.78 .44
Doctorate (vs AA/BA/MAd) 1.50 (0.30-6.76) 0.52 .60 1.38 (0.33-5.55) 0.45 .65 2.20 (0.56-9.21) 1.12 .26
Keeps a waitlist (vs not) 2.52 (0.64-10.25) 1.33 .18 1.36 (0.41-4.64) 0.50 .62 0.51 (0.14-1.72) –1.07 .29
Clinical satisfaction (1-5) 0.84 (0.39-1.77) –0.46 .65 0.56 (0.27-1.10) –1.64 .10 1.00 (0.51-1.99) 0.01 .99
Clinical hours 1.00 (0.96-1.05) 0.20 .84 1.00 (0.96-1.05) 0.20 .85 0.99 (0.95-1.03) –0.50 .62
Private practice (vs other) 5.33 (1.48-23.46) 2.40 .01c 2.52 (0.84-8.32) 1.60 .11 2.14 (0.72-6.84) 1.34 .18
CBTe (vs other orientation) 0.95 (0.20-4.42) –0.06 .95 0.41 (0.09-1.74) –1.18 .24 1.75 (0.41-8.28) 0.74 .46

aOR: odds ratio.

bZ statistic from specific model term in logistic regression.

cP values are significant when P<.05.

dAA/BA/MA: Associate of Art degree/ Bachelor of Arts degree/Master of Arts degree.

eCBT: cognitive behavioral therapy.

Table 4.

Logistic regression analyses predicting providers’ information seeking for low-intensity interventions from demographic, clinical, and practice predictors in imputed data sets.

Imputed data (N=141) Eb-based self-help Bibliotherapy Support groups

ORa (95% CI) Z b P value OR (95% CI) Z P value OR (95% CI) Z P value
Intercept 0.05 (0.00-1.23) –1.79 .07 0.12 (0.00-3.20) –1.25 .21 0.17 (0.01-3.42) –1.15 .25
Availability (specific) 0.79 (0.47-1.27) –0.96 .34 1.01 (0.62-1.61) 0.03 .98 0.96 (0.67-1.36) –0.25 .8
Willingness (specific) 1.95 (1.17-3.38) 2.48 .01c 1.50 (0.98-2.32) 1.87 .06 1.45 (0.98-2.19) 1.81 .07
Availability (general) 1.74(0.95-3.27) 1.78 .08 1.42 (0.76-2.73) 1.10 .27 1.13 (0.65-1.97) 0.42 .68
Willingness (general) 1.14 (0.59-2.17) 0.40 .69 1.48 (0.81-2.77) 1.27 0.20 1.24 (0.69-2.27) 0.42 .48
Age 0.98 (0.93-1.02) –1.06 .29 1.00 (0.95-1.04) –0.15 .88 0.98 (0.94-1.02) –0.92 .36
Female (vs male) 0.57 (0.21-1.44) –1.16 .24 1.00 (0.41-2.42) 0.01 .99 0.75 (0.34-1.64) –0.71 .48
Doctorate (vs AA/BA/MAd) 0.79 (0.28-2.14) –0.46 .65 0.84 (0.33-2.06) –0.39 .70 0.96 (0.40-2.26) –0.09 .93
Keeps a waitlist (vs not) 3.32 (1.10-10.30) 2.12 .03c 2.63 (0.94-7.73) 1.81 .07 0.91 (0.33-2.47) –0.18 .86
Clinical satisfaction (1-5) 1.21 (0.66-2.25) 0.62 .54 0.79 (0.44-1.40) –0.81 .42 1.18 (0.69-2.01) 0.60 .55
Clinical hours 1.00 (0.96-1.05) 0.14 .89 1.01 (0.97-1.05) 0.28 .78 0.99 (0.95-1.03) –0.55 .58
Private practice (vs other) 2.85 (1.06-8.42) 2.00 .05c 1.34 (0.55-3.38) 0.64 .52 1.18 (0.50-2.86) 0.37 .71
CBTd (vs other orientation) 0.75 (0.19-2.59) –0.45 .65 0.37 (0.09-1.30) –1.48 .14 1.07 (0.33-3.39) 0.12 .90

aOR: odds ratio.

bZ statistic from specific model term in logistic regression.

cP values are significant when P<.05.

dAA/BA/MA: Associate of Art degree/ Bachelor of Arts degree/Master of Arts degree.

dCBT: cognitive behavioral therapy.

Discussion

Principal Findings

The aims of this study were to describe current waiting list practices (aim 1), describe providers’ attitudes toward digital and nondigital LITs for patients on their waiting lists (aim 2), and explore predictors of providers’ willingness to use digital and nondigital LITs and their decisions to learn more about them (aim 3). Most providers (n=94, 69%) endorsed keeping a treatment waiting list. Among those who said they do not, nearly half (n=19, 45%) reported scheduling patients in the “distant future,” for example, 2-3 months away. Thus, most (n=113, 83%) providers in this sample had an opportunity to use LITs with people waiting for treatment. However, fewer than 20% (n=13-20) reported having recommended books, apps, or support groups for patients on a waiting list. The majority of those who endorsed maintaining a waiting list noted the estimated waiting time for their patients to access treatment was high and had increased since the COVID-19 pandemic. The difference in the average estimated waiting time currently and prior to the pandemic was on average about a month, with a significant increase, suggesting patients have experienced an increased delay in accessing mental health care since the onset of the pandemic.

This study has a number of limitations to consider. First, the generalizability of the study results may be limited due to the relatively small sample size and the representativeness of our study sample, which consisted primarily of CBT-oriented providers. However, our sample was relatively similar to the gender and racial or ethnic demographic characteristics of the psychology workforce in the United States [35], and CBT theoretical orientations have become the most popular among providers [36,37]. Additionally, it is possible that providers who are more interested in digital or nondigital LITs may have been more likely to participate in the study, resulting in a biased rating of attitudes relative to the population of mental health providers. Provider estimates of waiting times may likewise be biased or inaccurate in other ways. Previous research on waiting times for psychological services suggests that average waiting time ranges from 2-3 weeks to 2-3 months [38,39], but this varies across studies. Future studies could explore alternative methods, including the “secret shopper” methods, to get more accurate data on waiting lists and estimated waiting times. Lastly, this study assessed providers’ limited attitudes toward the listed interventions, specifically their perceptions of the intervention efficacy, accessibility, and their willingness to use it. Future research should investigate more detailed perceptions of these interventions through, for example, qualitative interviews to identify specific barriers and facilitators to digital and nondigital LIT implementation and use.

Despite its limitations, this study has notable strengths. To our knowledge, this is the first survey of providers to assess attitudes toward digital and nondigital LITs for patients on a waiting list. Additionally, beyond assessing attitudes, we also provided an opportunity to learn more about digital and nondigital LITs and assessed participants’ decisions to request additional information. Most providers were not currently recommending digital or nondigital LITs for patients on their waiting list, but attitudes toward the interventions were neutral to positive. Most were willing to use at least one intervention for patients on their waiting list. We found no evidence that providers had more positive attitudes regarding digital versus nondigital interventions. Generally, guided interventions were seen as more effective but less accessible than unguided interventions, which, in turn, were seen as less effective but more accessible. Together, these findings support our proposal that dissemination and implementation of digital and nondigital LITs (eg, bibliotherapy or DMHIs) while patients are on waiting lists could be a promising strategy to reduce the burden of untreated CMDs.

Although we found few significant predictors of attitudes and information seeking, we found that practice setting (ie, private practice vs other settings) was a predictor of attitudes and behaviors toward LITs. Individuals in private practice were more willing to use unguided bibliotherapy compared to individuals in other practice settings but were less willing to use guided bibliotherapy and unguided web-based self-help. Interestingly, at the end of our survey, individuals in private practice were more willing to learn about web-based self-help resources compared to individuals in other practice settings. These findings may reflect a knowledge gap wherein individuals in private practice currently do not perceive themselves to know which DMHIs to turn to, a barrier reported by other mental health providers [27,40,41], and hence they are less willing to use them. In addition to private practice setting, CBT theoretical orientation was predictive of willingness to use unguided web-based self-help. This finding may reflect the recent increase in iCBTs in research and practice settings, many of which are self-guided [42,43]. Increasing knowledge about digital and nondigital LITs and disseminating the interventions that individual providers are willing to use may be a useful way of increasing the reach of LITs [44]. One strategy to increase the use of LITs on treatment waiting lists would be to target the dissemination and implementation of digital and nondigital LITs to individuals who already have positive attitudes toward them—in our study, CBT practitioners and people with private practices. Alternatively, researchers could study interventions to increase the willingness to use digital and nondigital LITs by those not predisposed to using them, for example people who are not CBT practitioners.

Conclusions

We investigated treatment waiting lists and attitudes toward LITs for patients in waiting lists. Most providers appear to keep a waiting list, but most of them do not provide LITs to individuals on their waiting lists. In general, attitudes toward using LITs for patients in waiting lists were positive. Future research should investigate manipulating attitudes toward digital and nondigital LITs as well as structural barriers that may influence their use. For example, regarding individuals in private practice, who may be less likely to recommend guided LITs, qualitative data from our participants and from other studies [45] highlight questions about providers’ legal and ethical liability related to giving LIT guidance for participants on their waiting lists (eg, “I think one might assume a level of risk if participating in guided exercises but not therapy associated with their office”). Additionally, providers may be more, rather than less, likely to recommend LITs to patients with different features (eg, less severe symptoms) [46]. The perceived efficacy of an intervention also seems to be a major correlate of its use, so interventions that educate providers about LIT research are also worth exploring. Future work should clarify the nature of liability when recommending digital and nondigital LITs, as this may be an obstacle to uptake.

Acknowledgments

The authors would like to thank the participants for their time and thoughtful responses to the survey questions.

This research was partially funded by the National Institute of Mental Health (grant T32MH103213; PI: Hetrick), which provided support for AP and grants (KL2TR002530 and UL1TR002529; PI: Shekhar) from the National Institutes of Health, National Center for Advancing Translational Sciences, Clinical and Translational Sciences Award, which provided support for LLL, as well as the National Institute on Aging (R01AG070931-02; PI: ACK).

Abbreviations

CBT

cognitive behavioral therapy

CMD

common mental disorder

DMHI

digital mental health intervention

iCBT

internet-based cognitive behavioral therapy

LIT

low-intensity treatment

OR

odds ratio

Multimedia Appendix 1

Supplementary Table S1.

Data Availability

No other papers currently use these data. Study data, code, and survey materials can be accessed on the Open Science Framework website [32].

Footnotes

Conflicts of Interest: LLL has received consulting fees from Happify Health Inc, who had no role in this study. The funders had no role in the drafting of the manuscript.

References

  • 1.Baxter AJ, Vos T, Scott KM, Ferrari AJ, Whiteford HA. The global burden of anxiety disorders in 2010. Psychol Med. 2014 Jan 22;44(11):2363–2374. doi: 10.1017/s0033291713003243. [DOI] [PubMed] [Google Scholar]
  • 2.James Sl, Abate D, Abate Kh, Abay Sm, Abbafati C, Abbasi N, Abbastabar H, Abd-Allah F, Abdela J, Abdelalim A, Abdollahpour I, Abdulkader Rs, Abebe Z, Abera Sf, Abil Oz, Abraha Hn, Abu-Raddad Lj, Abu-Rmeileh Nme, Accrombessi Mmk, Acharya D, Acharya P, Ackerman In, Adamu Aa, Adebayo Om, Adekanmbi V, Adetokunboh Oo, Adib Mg, Adsuar Jc, Afanvi Ka, Afarideh M, Afshin A, Agarwal G, Agesa Km, Aggarwal R, Aghayan Sa, Agrawal S, Ahmadi A, Ahmadi M, Ahmadieh H, Ahmed Mb, Aichour An, Aichour I, Aichour Mte, Akinyemiju T, Akseer N, Al-Aly Z, Al-Eyadhy A, Al-Mekhlafi Hm, Al-Raddadi Rm, Alahdab F, Alam K, Alam T, Alashi A, Alavian Sm, Alene Ka, Alijanzadeh M, Alizadeh-Navaei R, Aljunid Sm, Alkerwi A, Alla F, Allebeck P, Alouani Mml, Altirkawi K, Alvis-Guzman N, Amare At, Aminde Ln, Ammar W, Amoako Ya, Anber Nh, Andrei Cl, Androudi S, Animut Md, Anjomshoa M, Ansha Mg, Antonio Cat, Anwari P, Arabloo J, Arauz A, Aremu O, Ariani F, Armoon B, Ärnlöv J, Arora A, Artaman A, Aryal Kk, Asayesh H, Asghar Rj, Ataro Z, Atre Sr, Ausloos M, Avila-Burgos L, Avokpaho Efga, Awasthi A, Ayala Quintanilla Bp, Ayer R, Azzopardi Ps, Babazadeh A, Badali H, Badawi A, Bali Ag, Ballesteros Ke, Ballew Sh, Banach M, Banoub Jam, Banstola A, Barac A, Barboza Ma, Barker-Collo Sl, Bärnighausen Tw, Barrero Lh, Baune Bt, Bazargan-Hejazi S, Bedi N, Beghi E, Behzadifar M, Behzadifar M, Béjot Y, Belachew Ab, Belay Ya, Bell Ml, Bello Ak, Bensenor Im, Bernabe E, Bernstein Rs, Beuran M, Beyranvand T, Bhala N, Bhattarai S, Bhaumik S, Bhutta Za, Biadgo B, Bijani A, Bikbov B, Bilano V, Bililign N, Bin Sayeed Ms, Bisanzio D, Blacker Bf, Blyth Fm, Bou-Orm Ir, Boufous S, Bourne R, Brady Oj, Brainin M, Brant Lc, Brazinova A, Breitborde Njk, Brenner H, Briant Ps, Briggs Am, Briko An, Britton G, Brugha T, Buchbinder R, Busse R, Butt Za, Cahuana-Hurtado L, Cano J, Cárdenas R, Carrero Jj, Carter A, Carvalho F, Castañeda-Orjuela Ca, Castillo Rivas J, Castro F, Catalá-López F, Cercy Km, Cerin E, Chaiah Y, Chang Ar, Chang H, Chang J, Charlson Fj, Chattopadhyay A, Chattu Vk, Chaturvedi P, Chiang Pp, Chin Kl, Chitheer A, Choi Jj, Chowdhury R, Christensen H, Christopher Dj, Cicuttini Fm, Ciobanu Lg, Cirillo M, Claro Rm, Collado-Mateo D, Cooper C, Coresh J, Cortesi Pa, Cortinovis M, Costa M, Cousin E, Criqui Mh, Cromwell Ea, Cross M, Crump Ja, Dadi Af, Dandona L, Dandona R, Dargan Pi, Daryani A, Das Gupta R, Das Neves J, Dasa Tt, Davey G, Davis Ac, Davitoiu Dv, De Courten B, De La Hoz Fp, De Leo D, De Neve J, Degefa Mg, Degenhardt L, Deiparine S, Dellavalle Rp, Demoz Gt, Deribe K, Dervenis N, Des Jarlais Dc, Dessie Ga, Dey S, Dharmaratne Sd, Dinberu Mt, Dirac Ma, Djalalinia S, Doan L, Dokova K, Doku Dt, Dorsey Er, Doyle Ke, Driscoll Tr, Dubey M, Dubljanin E, Duken Ee, Duncan Bb, Duraes Ar, Ebrahimi H, Ebrahimpour S, Echko Mm, Edvardsson D, Effiong A, Ehrlich Jr, El Bcheraoui C, El Sayed Zaki M, El-Khatib Z, Elkout H, Elyazar Irf, Enayati A, Endries Ay, Er B, Erskine He, Eshrati B, Eskandarieh S, Esteghamati A, Esteghamati S, Fakhim H, Fallah Omrani V, Faramarzi M, Fareed M, Farhadi F, Farid Ta, Farinha Cses, Farioli A, Faro A, Farvid Ms, Farzadfar F, Feigin Vl, Fentahun N, Fereshtehnejad S, Fernandes E, Fernandes Jc, Ferrari Aj, Feyissa Gt, Filip I, Fischer F, Fitzmaurice C, Foigt Na, Foreman Kj, Fox J, Frank Td, Fukumoto T, Fullman N, Fürst T, Furtado Jm, Futran Nd, Gall S, Ganji M, Gankpe Fg, Garcia-Basteiro Al, Gardner Wm, Gebre Ak, Gebremedhin At, Gebremichael Tg, Gelano Tf, Geleijnse Jm, Genova-Maleras R, Geramo Ycd, Gething Pw, Gezae Ke, Ghadiri K, Ghasemi Falavarjani K, Ghasemi-Kasman M, Ghimire M, Ghosh R, Ghoshal Ag, Giampaoli S, Gill Ps, Gill Tk, Ginawi Ia, Giussani G, Gnedovskaya Ev, Goldberg Em, Goli S, Gómez-Dantés H, Gona Pn, Gopalani Sv, Gorman Tm, Goulart Ac, Goulart Bng, Grada A, Grams Me, Grosso G, Gugnani Hc, Guo Y, Gupta Pc, Gupta R, Gupta R, Gupta T, Gyawali B, Haagsma Ja, Hachinski V, Hafezi-Nejad N, Haghparast Bidgoli H, Hagos Tb, Hailu Gb, Haj-Mirzaian A, Haj-Mirzaian A, Hamadeh Rr, Hamidi S, Handal Aj, Hankey Gj, Hao Y, Harb Hl, Harikrishnan S, Haro Jm, Hasan M, Hassankhani H, Hassen Hy, Havmoeller R, Hawley Cn, Hay Rj, Hay Si, Hedayatizadeh-Omran A, Heibati B, Hendrie D, Henok A, Herteliu C, Heydarpour S, Hibstu Dt, Hoang Ht, Hoek Hw, Hoffman Hj, Hole Mk, Homaie Rad E, Hoogar P, Hosgood Hd, Hosseini Sm, Hosseinzadeh M, Hostiuc M, Hostiuc S, Hotez Pj, Hoy Dg, Hsairi M, Htet As, Hu G, Huang Jj, Huynh Ck, Iburg Km, Ikeda Ct, Ileanu B, Ilesanmi Os, Iqbal U, Irvani Ssn, Irvine Cms, Islam Sms, Islami F, Jacobsen Kh, Jahangiry L, Jahanmehr N, Jain Sk, Jakovljevic M, Javanbakht M, Jayatilleke Au, Jeemon P, Jha Rp, Jha V, Ji Js, Johnson Co, Jonas Jb, Jozwiak Jj, Jungari Sb, Jürisson M, Kabir Z, Kadel R, Kahsay A, Kalani R, Kanchan T, Karami M, Karami Matin B, Karch A, Karema C, Karimi N, Karimi Sm, Kasaeian A, Kassa Dh, Kassa Gm, Kassa Td, Kassebaum Nj, Katikireddi Sv, Kawakami N, Karyani Ak, Keighobadi Mm, Keiyoro Pn, Kemmer L, Kemp Gr, Kengne Ap, Keren A, Khader Ys, Khafaei B, Khafaie Ma, Khajavi A, Khalil Ia, Khan Ea, Khan Ms, Khan Ma, Khang Y, Khazaei M, Khoja At, Khosravi A, Khosravi Mh, Kiadaliri Aa, Kiirithio Dn, Kim C, Kim D, Kim P, Kim Y, Kim Yj, Kimokoti Rw, Kinfu Y, Kisa A, Kissimova-Skarbek K, Kivimäki M, Knudsen Aks, Kocarnik Jm, Kochhar S, Kokubo Y, Kolola T, Kopec Ja, Kosen S, Kotsakis Ga, Koul Pa, Koyanagi A, Kravchenko Ma, Krishan K, Krohn Kj, Kuate Defo B, Kucuk Bicer B, Kumar Ga, Kumar M, Kyu Hh, Lad Dp, Lad Sd, Lafranconi A, Lalloo R, Lallukka T, Lami Fh, Lansingh Vc, Latifi A, Lau Km, Lazarus Jv, Leasher Jl, Ledesma Jr, Lee Ph, Leigh J, Leung J, Levi M, Lewycka S, Li S, Li Y, Liao Y, Liben Ml. doi: 10.1016/S0140-6736(18)32279-7. [DOI] [Google Scholar]
  • 3.Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, Charlson FJ, Norman RE, Flaxman AD, Johns N, Burstein R, Murray CJ, Vos T. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. The Lancet. 2013 Nov;382(9904):1575–1586. doi: 10.1016/s0140-6736(13)61611-6. [DOI] [PubMed] [Google Scholar]
  • 4.Greenberg PE, Fournier A, Sisitsky T, Pike CT, Kessler RC. The economic burden of adults with major depressive disorder in the United States (2005 and 2010) J Clin Psychiatry. 2015 Feb 25;76(02):155–162. doi: 10.4088/jcp.14m09298. [DOI] [PubMed] [Google Scholar]
  • 5.Prevention C. Anxiety and depression, household pulse survey. CDC. [2021-12-14]. https://www.cdc.gov/nchs/covid19/pulse/mental-health.htm .
  • 6.Kazdin AE, Blase SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci. 2011 Jan 03;6(1):21–37. doi: 10.1177/1745691610393527.6/1/21 [DOI] [PubMed] [Google Scholar]
  • 7.Kazdin AE. Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther. 2017 Jan;88:7–18. doi: 10.1016/j.brat.2016.06.004.S0005-7967(16)30099-7 [DOI] [PubMed] [Google Scholar]
  • 8.Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, Bromet E, Bruffaerts R, de Girolamo G, de Graaf R, Florescu S, Gureje O, Hinkov HR, Hu C, Huang Y, Hwang I, Jin R, Karam EG, Kovess-Masfety V, Levinson D, Matschinger H, O'Neill S, Posada-Villa J, Sagar R, Sampson NA, Sasu C, Stein DJ, Takeshima T, Viana MC, Xavier M, Kessler RC. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. 2013 Aug 09;44(6):1303–1317. doi: 10.1017/s0033291713001943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Uimonen M, Kuitunen I, Paloneva J, Launonen AP, Ponkilainen V, Mattila VM. The impact of the COVID-19 pandemic on waiting times for elective surgery patients: a multicenter study. PLoS One. 2021 Jul 6;16(7):e0253875. doi: 10.1371/journal.pone.0253875. https://dx.plos.org/10.1371/journal.pone.0253875 .PONE-D-21-12922 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Kutikov A, Weinberg DS, Edelman MJ, Horwitz EM, Uzzo RG, Fisher RI. A war on two fronts: cancer care in the time of COVID-19. Ann Intern Med. 2020 Jun 02;172(11):756–758. doi: 10.7326/m20-1133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Brown SA, Parker JD, Godding PR. Administrative, clinical, and ethical issues surrounding the use of waiting lists in the delivery of mental health services. J Behav Health Serv Res. 2002 May;29(2):217–28. doi: 10.1007/BF02287708. [DOI] [PubMed] [Google Scholar]
  • 12.Cuijpers P, Karyotaki E, Ciharova M, Miguel C, Noma H, Furukawa TA. The effects of psychotherapies for depression on response, remission, reliable change, and deterioration: a meta-analysis. Acta Psychiatr Scand. 2021 Sep 04;144(3):288–299. doi: 10.1111/acps.13335. https://europepmc.org/abstract/MED/34107050 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Krendl AC, Lorenzo-Luaces L. Identifying peaks in attrition after clients initiate mental health treatment in a university training clinic. Psychol Serv. 2022 Aug;19(3):519–526. doi: 10.1037/ser0000469.2021-59090-001 [DOI] [PubMed] [Google Scholar]
  • 14.Swift JK, Whipple JL, Sandberg P. A prediction of initial appointment attendance and initial outcome expectations. Psychotherapy (Chic) 2012 Dec;49(4):549–56. doi: 10.1037/a0029441.2012-21490-001 [DOI] [PubMed] [Google Scholar]
  • 15.Reitzel LR, Stellrecht NE, Gordon KH, Lima EN, Wingate LR, Brown JS, Wolfe AS, Zenoz LM, Joiner TE. Does time between application and case assignment predict therapy attendance or premature termination in outpatients? Psychol Serv. 2006 Feb;3(1):51–60. doi: 10.1037/1541-1559.3.1.51. [DOI] [Google Scholar]
  • 16.Steinert C, Stadter K, Stark R, Leichsenring F. The effects of waiting for treatment: a meta-analysis of waitlist control groups in randomized controlled trials for social anxiety disorder. Clin Psychol Psychother. 2017 May 22;24(3):649–660. doi: 10.1002/cpp.2032. [DOI] [PubMed] [Google Scholar]
  • 17.Punton G, Dodd AL, McNeill A. 'You're on the waiting list': an interpretive phenomenological analysis of young adults' experiences of waiting lists within mental health services in the UK. PLoS One. 2022 Mar 18;17(3):e0265542. doi: 10.1371/journal.pone.0265542. https://dx.plos.org/10.1371/journal.pone.0265542 .PONE-D-21-20611 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Jorm AF, Patten SB, Brugha TS, Mojtabai R. Has increased provision of treatment reduced the prevalence of common mental disorders? Review of the evidence from four countries. World Psychiatry. 2017 Mar 26;16(1):90–99. doi: 10.1002/wps.20388. doi: 10.1002/wps.20388. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Cuijpers P. Bibliotherapy in unipolar depression: a meta-analysis. J Behav Ther Exp Psychiatry. 1997 Jun;28(2):139–147. doi: 10.1016/s0005-7916(97)00005-0. [DOI] [PubMed] [Google Scholar]
  • 20.Gregory RJ, Schwer Canning S, Lee TW, Wise JC. Cognitive bibliotherapy for depression: a meta-analysis. Prof Psychol Res Pr. 2004 Jun;35(3):275–280. doi: 10.1037/0735-7028.35.3.275. [DOI] [Google Scholar]
  • 21.Andersson G, Carlbring P, Titov N, Lindefors N. Internet interventions for adults with anxiety and mood disorders: a narrative umbrella review of recent meta-analyses. Can J Psychiatry. 2019 Jul 16;64(7):465–470. doi: 10.1177/0706743719839381. https://europepmc.org/abstract/MED/31096757 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf Erik. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. 2018 Jan 07;47(1):1–18. doi: 10.1080/16506073.2017.1401115. [DOI] [PubMed] [Google Scholar]
  • 23.Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med. 2010 Apr 21;40(12):1943–1957. doi: 10.1017/s0033291710000772. [DOI] [PubMed] [Google Scholar]
  • 24.Cuijpers P, Noma H, Karyotaki E, Cipriani A, Furukawa TA. Effectiveness and acceptability of cognitive behavior therapy delivery formats in adults with depression: a network meta-analysis. JAMA Psychiatry. 2019 Jul 01;76(7):700–707. doi: 10.1001/jamapsychiatry.2019.0268. https://europepmc.org/abstract/MED/30994877 .2730724 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Williams C. Use of written cognitive–behavioural therapy self-help materials to treat depression. Adv psychiatr treat. 2018 Jan 02;7(3):233–240. doi: 10.1192/apt.7.3.233. [DOI] [Google Scholar]
  • 26.Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, Mackinnon A, Meyer B, Botella C, Littlewood E, Andersson G, Christensen H, Klein JP, Schröder J, Bretón-López J, Scheider J, Griffiths K, Farrer L, Huibers MJH, Phillips R, Gilbody S, Moritz S, Berger T, Pop V, Spek V, Cuijpers P. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017 May 01;74(4):351–359. doi: 10.1001/jamapsychiatry.2017.0044.2604310 [DOI] [PubMed] [Google Scholar]
  • 27.Brantnell A, Woodford J, Baraldi E, van Achterberg T, von Essen L. Views of implementers and nonimplementers of internet-administered cognitive behavioral therapy for depression and anxiety: survey of primary care decision makers in Sweden. J Med Internet Res. 2020 Aug 12;22(8):e18033. doi: 10.2196/18033. https://www.jmir.org/2020/8/e18033/ v22i8e18033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Schleider JL, Sung J, Bianco A, Gonzalez A, Vivian D, Mullarkey M. Open pilot trial of a single-session consultation service for clients on psychotherapy wait-lists. PsyArXiv. doi: 10.31234/osf.io/fdwqk. Preprint published online in Jan 15, 2021. [DOI] [Google Scholar]
  • 29.Levin ME, Hicks ET, Krafft J. J Am Coll Health. 2022 Jan 09;70(1):165–173. doi: 10.1080/07448481.2020.1728281. [DOI] [PubMed] [Google Scholar]
  • 30.Hentati A, Forsell E, Ljótsson B, Lindefors N, Kraepelien M. A self-guided and monitored digital problem-solving intervention for patients with symptoms of depression or anxiety on the waiting list for treatment in routine psychiatric care: feasibility study. BJPsych Open. 2022 Feb 08;8(2):e43. doi: 10.1192/bjo.2022.14. https://www.cambridge.org/core/product/identifier/S205647242200014X/type/journal_article .S205647242200014X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991 Dec;50(2):179–211. doi: 10.1016/0749-5978(91)90020-t. [DOI] [Google Scholar]
  • 32.Peipert A. Waiting lists for psychotherapy and provider attitudes towards low-intensity interventions. PsyArXiv. doi: 10.31234/osf.io/63gfs. Preprint posted online May 3, 2022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Tang F, Ishwaran H. Random forest missing data algorithms. Stat Anal Data Min. 2017 Dec 13;10(6):363–377. doi: 10.1002/sam.11348. https://europepmc.org/abstract/MED/29403567 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.The R language and environment for statistical computing. R Core Team; 2017. [2022-05-22]. https://www.R-project.org . [Google Scholar]
  • 35.Lin L, Stamm K, Christidis P. Demographics of the US psychology workforce: findings from the 2007-16 American Community Survey. APA. 2018:3–12. doi: 10.1037/e506742018-001. [DOI] [Google Scholar]
  • 36.Norcross JC, Karpiak CP. Clinical psychologists in the 2010s: 50 years of the APA division of clinical psychology. Clin Psychol. 2012 Mar;19(1):1–12. doi: 10.1111/j.1468-2850.2012.01269.x. [DOI] [PubMed] [Google Scholar]
  • 37.Norcross JC, Sayette MA, Pomerantz AM. Doctoral training in clinical psychology across 23 years: Continuity and change. J Clin Psychol. 2018 Mar 20;74(3):385–397. doi: 10.1002/jclp.22517. [DOI] [PubMed] [Google Scholar]
  • 38.Steinman KJ, Shoben AB, Dembe AE, Kelleher KJ. How long do adolescents wait for psychiatry appointments? Community Ment Health J. 2015 Oct 25;51(7):782–9. doi: 10.1007/s10597-015-9897-x.10.1007/s10597-015-9897-x [DOI] [PubMed] [Google Scholar]
  • 39.Blech B, West JC, Yang Z, Barber KD, Wang P, Coyle C. Availability of network psychiatrists among the largest health insurance carriers in Washington, D.C. Psychiatr Serv. 2017 Oct 01;68(9):962–965. doi: 10.1176/appi.ps.201600454. [DOI] [PubMed] [Google Scholar]
  • 40.Miller KE, Kuhn E, Yu J, Owen JE, Jaworski BK, Taylor K, Blonigen DM, Possemato K. Use and perceptions of mobile apps for patients among VA primary care mental and behavioral health providers. Prof Psychol Res Pr. 2019 Jun;50(3):204–209. doi: 10.1037/pro0000229. [DOI] [Google Scholar]
  • 41.Cliffe B, Croker A, Denne M, Stallard P. Clinicians' use of and attitudes towards technology to provide and support interventions in child and adolescent mental health services. Child Adolesc Ment Health. 2020 May 11;25(2):95–101. doi: 10.1111/camh.12362. [DOI] [PubMed] [Google Scholar]
  • 42.Aguilera A, Muench F. There's an app for that: information technology applications for cognitive behavioral practitioners. Behav Ther (N Y N Y) 2012 May;35(4):65–73. https://europepmc.org/abstract/MED/25530659 . [PMC free article] [PubMed] [Google Scholar]
  • 43.Wasil AR, Palermo EH, Lorenzo-Luaces L, DeRubeis RJ. Is there an app for that? A review of popular apps for depression, anxiety, and well-being. Cogn Behav Pract. 2021 Oct; doi: 10.1016/j.cbpra.2021.07.001. (forthcoming) [DOI] [Google Scholar]
  • 44.Michie S, Atkins L, West R. The Behaviour Change Wheel: A guide to Designing Interventions. Great Britain: Silverback Publishing; 2014. [Google Scholar]
  • 45.Borgueta AM, Purvis CK, Newman MG. Navigating the ethics of Internet-guided self-help interventions. Clin Psychol (New York) 2018 Jul;25(2):e12235. doi: 10.1111/cpsp.12235. https://europepmc.org/abstract/MED/33664555 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Lorenzo-Luaces L, DeRubeis RJ, Bennett IM. Primary care physicians' selection of low-intensity treatments for patients with depression. Fam Med. 2015;47(7):511–6. [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Supplementary Table S1.

Data Availability Statement

No other papers currently use these data. Study data, code, and survey materials can be accessed on the Open Science Framework website [32].


Articles from JMIR Formative Research are provided here courtesy of JMIR Publications Inc.

RESOURCES