Abstract
Purpose:
Parent coaching is a complex, psychosocial intervention with multiple core components. Clinicians’ use of these core components may be influenced by distinct factors; no research has examined whether clinician perceptions of parent coaching vary across core coaching components. This study aimed to examine the extent to which clinicians working with families of young autistic children in publicly funded early intervention intend to use core parent coaching components, and to examine how closely psychological factors relate to providers’ intentions to use each component.
Methods:
Using the Theory of Planned Behavior as a framework, this study compared the strength of clinicians’ intentions across five core parent coaching components: collaboration with parents, delivering the intervention within daily routines, demonstrating the intervention, providing in-vivo feedback, and reflection and problem solving. We examined the associations between intentions and psychological determinants of intentions (i.e., attitudes, norms, and self-efficacy) for each component.
Results:
Clinicians’ average intentions varied by core component, with strongest intentions for demonstrating the intervention strategy for a parent. The associations between intentions and psychological determinants also varied by core component. Attitudes, injunctive norms, and self-efficacy, but not descriptive norms, significantly related to clinicians’ intentions to use collaboration and daily routines, whereas attitudes and descriptive norms, but not injunctive norms and self-efficacy, significantly related to clinicians’ intentions to use feedback and reflection and problem solving.
Conclusions:
These results suggest that implementation strategies should be tailored to the specific intervention component to be most efficient and effective. The results also provide examples of potentially malleable factors that implementation strategies can strategically target.
Keywords: Parent coaching, early intervention, intentions
Most psychosocial interventions, from cognitive behavioral therapy (Wolk et al., 2019) to applied behavior analytic (ABA) autism intervention (Pellecchia et al., 2015), are considered complex in that they include multiple, interacting core components. Although many complex psychosocial interventions have demonstrated efficacy, they often are applied inconsistently or with low fidelity in practice (Becker et al., 2013; Kazdin, 2017). In response to this gap, research efforts have focused on developing and testing implementation strategies to enhance their implementation (Proctor et al., 2013). The complexity of these interventions makes it challenging to implement them with high fidelity in routine practice settings (González-Valderrama et al., 2015). Within each intervention, intervention core components may vary in their efficacy, the fidelity with which they tend to be implemented, and the extent to which providers intend to use them.
To better understand the efficacy of core intervention components, several recent studies have dismantled complex psychosocial interventions such as Acceptance and Commitment Therapy (Levin et al., 2020) and Mindfulness-Based Stress Reduction (Hunt et al., 2018) by testing the efficacy of individual intervention components, as well as the full intervention. This work could lead to developing more efficient psychosocial interventions by identifying which individual components are necessary and sufficient for the intervention to be effective.
Some components of complex interventions may be more likely to be implemented as designed than others. For example, Pellecchia and colleagues (2015) found that teachers’ fidelity to an ABA-based autism intervention delivered in schools varied by intervention component. Other studies have found that providers’ intentions to use a complex intervention vary by core component. For example, Wolk et al. (2019) found that clinicians’ intentions to implement cognitive behavioral therapy varied significantly by component, with strongest intentions for reviewing homework and weakest intentions for using exposure. Similarly, Fishman et al. (2018) found that teachers of students with autism reported the strongest intentions to use positive reinforcement and weakest intentions to use daily one-to-one instruction. Examining provider perceptions of individual intervention components may inform the development of implementation strategies tailored to specific intervention components.
This is particularly important given the identified need for specifying and testing mechanistic implementation strategies. Specifically, there is an identified need to link implementation strategies to their hypothesized mechanisms (i.e., underlying causal processes through which the strategy affects the desired implementation outcome), and to empirically test these linkages in trials of implementation strategies (Lewis et al., 2018; Williams, 2016). Doing so has the potential to expedite the development of more effective and efficient implementation strategies and to improve the tailoring of implementation strategies to meet the needs of heterogeneous contexts (Lewis et al., 2021).
Parent Coaching
One example of a complex psychosocial intervention is parent coaching for the treatment of young children with autism spectrum disorders (ASD). Parent coaching is an evidence-based practice (EBP) for ASD, and results in improved child outcomes across a range of developmental domains, improved parental self-efficacy, treatment engagement, and reduced parental stress (Estes et al., 2014; Kasari et al., 2014; Rogers et al., 2012). Children with disabilities, including ASD, are eligible to receive publicly-funded early intervention services through Part C of the Individuals with Disabilities Education Act (IDEA, 2004). Increasingly, early intervention research, policy, and practice recommendations highlight the importance of including caregivers as partners in their child’s treatment (Hanft, Rush & Sheldon, 2004; Rush, Shelden & Hanft, 2003) . Providing early intervention programs that encompass the entire family, not only the child aligns with the family-centered practices the Division for Early Childhood recommends for Part C early intervention (DEC, 2017) and guidelines for Part C services set forth in the Individuals with Disabilities Education Act (IDEA, 2004).
An important aspect of parent-mediated early intervention is that the clinician coaches the parent in how to use intervention strategies with their child (Oono et al., 2013). Evidence-based parent coaching techniques used in the treatment of young children with ASD apply principles of adult learning theory (Dunst & Trivette, 2009) to motivate and enable parents to use intervention strategies. Parent coaching includes several distinct core components (Friedman et al., 2012). Specifically, the clinician: 1) delivers coaching within the family’s daily routines; 2) demonstrates the intervention strategy to the parents; 3) collaborates with parents on intervention goals and strategy selection; 4) provides the parent with in-vivo feedback about their use of the intervention strategies; and 5) engages the parent in reflection and problem solving around barriers to using the intervention strategies (Dunst & Trivette, 2009; Friedman et al., 2012; Tomeny, McWilliam & Tomeny, 2020). Previous research has found that early intervention providers demonstrate substantial variability in their use of these parent coaching components during their usual practice with families of young autistic children, meaning they used some parent coaching components but did not use others (Pellecchia et al., 2022). Clinicians’ use of these core components may be influenced by distinct, factors; to date, however no research has examined whether provider perceptions of parent coaching are similar or different across core coaching components.
Theory of Planned Behavior
The Theory of Planned Behavior (TPB; Ajzen, 1991), a causal model of behavior prediction, may be useful for understanding clinicians’ use of parent coaching. The TPB posits that an individual’s intentions closely predict their behavior, under circumstances that permit the individual to act on their intentions. The theory also posits that several psychological factors affect an individual’s intentions to engage in a given behavior. Specifically, attitudes (perceptions of the relative advantages or disadvantages of performing the behavior), descriptive normative pressure (perceptions of the extent to which others do the behavior), injunctive normative pressure (perceptions of the extent to which others want the individual to do the behavior), and perceived behavioral control, also referred to as self-efficacy (confidence the individual can perform the behavior if desired) shape intentions for any given behavior (Ajzen, 1991). This model has been empirically supported for a number of health behaviors (Armitage & Conner, 2001). It has also been widely applied to understand the clinical behavior of healthcare professionals (Godin et al., 2008), and the implementation of evidence-based mental health interventions (e.g., Fishman et al., 2018; Maddox et al., 2019; Wolk et al., 2019).
A recent systematic review of studies examining mechanisms of implementation strategies found that the Theory of Planned Behavior was among the most widely applied theory in studies examining mechanisms of implementation in health (Lewis et al., 2020). The TPB may be useful in studies of implementation behavior for several reasons. First, TPB constructs (i.e., attitudes, norms, self-efficacy) provide potential targets for novel implementation strategies. For example, Beliefs and Attitudes for Successful Implementation in Schools (BASIS), is a blended pre-implementation strategy, grounded in the TPB, that aims to strengthen providers’ intentions to implement an EBP by targeting factors such as provider attitudes, perceived subjective norms, and self-efficacy (Larson et al., 2021; Lyon et al., 2019).
Second, the TPB may be useful for tailoring implementation strategies to contexts, providers, and EBPs. For example, implementation strategies targeting attitudes, norms, and self-efficacy may be most important in contexts where provider intentions to use parent coaching are weak. Further, if one specific psychological factor (e.g., attitudes) is most strongly linked to provider intentions, it may be particularly important and efficient for implementation strategies to target that specific factor (Fishman et al., 2021). On the other hand, if provider intentions to use parent coaching are strong, but implementation is rare, strategies should target the factors that prevent providers from acting on their strong intentions, such as skills or environmental constraints (Fishman et al., 2018).
Clinicians’ intentions, attitudes, normative pressure, and self-efficacy as well as the associations among these constructs, may vary across the core components of parent coaching. Elucidating these relationships specific to each component could lead to targeted implementation strategies that are tailored for specific core components of complex, psychosocial interventions (Fishman et al., 2020).
Current study
The goal of the current study was to examine individual-level factors that may be important for early intervention clinicians’ use of parent coaching, using the Theory of Planned Behavior as a framework. Among early intervention clinicians (“clinicians”), we measured their strength of intention to use each of the five core components of parent coaching: collaboration with parents (“collaboration”), delivering intervention within daily routines (“daily routines”), demonstrating the intervention strategy for a parent (“demonstration”), providing a parent in-vivo feedback (“feedback”), and asking a parent to reflect on the use of an intervention strategy and problem solve regarding potential barriers (“reflection/problem solving”). For each core component, we also measured four theoretical psychological determinants of intentions (i.e., potential individual-level mechanisms): attitudes, descriptive norms, injunctive norms, and self-efficacy.
We used these data to address three primary research questions. First, how strong are clinicians’ intentions, to use each component of parent coaching, and to what extent do attitudes, norms, and self-efficacy for each component vary? Finally, how do attitudes, descriptive normative pressure, injunctive normative pressure, and self-efficacy relate to clinicians’ intentions to use parent coaching, and do these relations vary by parent coaching component?
Method
Procedures
We invited early intervention clinicians from 44 agencies that were in one of two different areas of the United States to participate in this study. Agency recruitment occurred through the study team and their academic colleagues engaged in community-based early autism research. Community partners at the agency and system levels shared information about the study opportunity to their networks of early intervention agency leadership. We administered the surveys in person at 3 agencies during group staff meetings, from which we collected 37 surveys. At the other 41 agencies, agency leaders distributed information about the survey to all clinicians in their agency. Interested clinicians contacted the study team, which provided them with a secure, unique survey link via email. The survey included questions about clinicians’ demographic information and professional background, and questions about their intentions to use each of the five core components of parent coaching (collaboration with parents; delivering intervention within daily routines; demonstrating the intervention strategy for a parent; providing a parent in-vivo feedback; and asking a parent to reflect on the use of an intervention strategy and problem solve regarding potential barriers). It also included questions about clinicians’ attitudes, norms and self-efficacy regarding these components. Participants who completed the survey received a $45 electronic gift card. All procedures were approved by the Institutional Review Boards of the University of Pennsylvania and the City of Philadelphia.
Participants
A total of 264 clinicians from 37 agencies, out of 358 clinicians who were invited (74% response rate), consented to participate in the survey. The analytic sample consists of 256 clinicians from 35 agencies who provided data on at least one intentions or psychological determinant variable. Data from 8 clinicians, who consented to the survey but did not provide data on any of the variables used in the current analyses were discarded. Table 1 provides demographic characteristics of the sample. The sample was majority White and female, and most participants in the sample had obtained a graduate/professional degree. Participants in the sample had, on average, 7.7 years of experience working in early intervention (SD = 8.3), and more than half of the participants (56%) reported receiving specialized training in parent coaching independent of the current study.
Table 1.
Participant Demographics and Professional Characteristics (N = 256)
Variables | % |
---|---|
Gender: | |
Female | 94.5% |
Male | 4.3% |
Missing | 1.2% |
Race: | |
White | 77.0% |
African-American or Black | 8.2% |
Asian | 8.2% |
American Indian/Alaska Native | 1.6% |
Pacific Islander | .8% |
Middle Eastern | .8% |
Other | 6.6% |
Ethnicity: Latino/Hispanic/Spanish | 15.2% |
State: | |
PA | 70.3% |
CA | 27.0% |
DE | 2.3% |
OH | .4% |
Job title: | |
Speech and Language Pathologist | 24.2% |
Occupational Therapist | 18.0% |
Special Instructor | 26.6% |
ABA Therapist | 14.5% |
Physical therapist | 9.8% |
Other | 12.9% |
Employee Type: | |
Full-time employee | 26.2% |
Part-time employee | 7.4% |
Independent contractor | 67.2% |
Other | 1.2% |
Highest Level of Education: | |
Some College | 1.2% |
College | 18.0% |
Graduate/Professional Degree | 79.7% |
Other | .8% |
Missing | .4% |
Specialized training with ASD? Yes | 62.0% |
Specialized training in parent coaching? Yes | 56.1% |
Measures
Demographics and background characteristics
The survey asked questions about clinicians’ socio-demographic and professional background characteristics including gender, race, ethnicity, job title, employment type (i.e., full time, part time, independent contractor), years’ experience working in early intervention, and specialized training.
Intentions
Participants were asked to rate their strength of intention to use each of the five core components of parent coaching at almost every parent session (Table 2). The items used validated stems (Fishbein & Ajzen, 2010) for each core component (e.g., “How likely are you to collaboratively make decisions with parents at almost every session?”). Each item was rated on a 7-point scale (1 = Extremely unlikely to 7 = Extremely likely) with higher numbers representing stronger intentions. To ensure that respondents had a clear understanding of the coaching components when completing the survey, precise definitions for each coaching component and examples were included in the survey in bolded print and presented before the survey questions for each component.
Table 2.
Intentions and Psychological Determinants of Intentions for Five Component Practices of Parent Coaching
Collaboration | Daily Routines | Demonstration | Feedback | Reflection and Problem Solving | ||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
M | SD | M | SD | M | SD | M | SD | M | SD | |
Intentions (1-7) | 5.98 | 1.19 | 5.67 | 1.31 | 6.15 | 1.20 | 5.86 | 1.14 | 5.93 | 1.15 |
Attitudes (0-10) | 8.12 | 1.64 | 8.02 | 1.67 | 8.51 | 1.41 | 7.93 | 1.66 | 8.32 | 1.48 |
Descriptive Norms (1-5) | 3.82 | .84 | 3.78 | .90 | 4.21 | .71 | 3.89 | .79 | 3.89 | .78 |
Injunctive Norms (1-5) | 4.49 | .57 | 4.41 | .62 | 4.40 | .65 | 4.32 | .62 | 4.39 | .61 |
Self-efficacy (1-5) | 4.38 | .81 | 4.27 | .78 | 4.52 | .60 | 4.34 | .72 | 4.36 | .66 |
Note. Daily Routines were defined as “work with parents during their usual daily routines at almost every parent session;” Feedback was defined as: “How likely are you to “give immediate feedback to parents after they attempt a technique at almost every parent session;” Collaboration was defined as: “collaboratively make decisions with parents at almost every parent session;” Reflection and Problem Solving was defined as: “reflect and problem solve with parents regarding technique use at almost every parent session;” Demonstration was defined as: “Demonstrate an intervention strategy for a parent at almost every parent session.”
Psychological determinants of intentions
Participants reported their attitudes about each core component of parent coaching (i.e., “Think about what it would be like if you almost always work with parents during their usual daily routines during sessions. Would that feel…”) using four items (i.e., inappropriate-appropriate; stressful-calm; inconvenient-convenient; useless-helpful) rated on a scale from 0 to 10 for each item (Fishbein & Ajzen, 2010). In the current sample, the scales had high internal consistency for each parent coaching component (α’s between .84 and .88). A composite score was calculated by averaging these four items.
Participants also reported descriptive norms using two items (i.e., “At my organization, most practitioners will do this”; “Most practitioners who work with similar parents are willing to do this.”) on a 5-point scale from 1 = Strongly disagree to 5 = Strongly agree for each of the coaching components. Correlation between these items ranged from Spearman’s Rho = .68 to .80. A composite score was calculated by averaging these two items.
Injunctive norms were measured using the question stem: “If you almost always collaboratively made decisions with parents during a parent session, how would the following groups of people feel about you doing that?”, with a 5-point scale ranging from 1 = Strongly disapprove to 5 = Strongly approve for three potential groups of people: “My boss/supervisor,” “The parents being collaborated with,” and “Colleagues who are important to me.” Because ratings regarding “my boss/supervisor” and “colleagues who are important to me” were substantially correlated with each other (all Spearman’s Rhos > .5), but correlations between ratings regarding “my boss/supervisor” and “the parents being collaborated with” were lower (Spearman’s Rho’s ranging from .27 to .44), a composite score was calculated by averaging ratings for “boss/supervisor” and “colleagues who are important to me.”
Finally, participants reported on self-efficacy for each core component of parent coaching using the item “I am confident that, if I wanted to, I could do this” rated on a 5-point scale ranging from 1 = Strongly disagree to 5 = Strongly agree.
Analytic Approach
Because data were collected from clinicians nested within 35 agencies, we also used intraclass correlation coefficients (ICCs) to examine the amount of variation in intentions that can be accounted for by agency.
For. the whole sample, we calculated means, standard deviations, and response frequency distributions to describe clinicians’ intentions, attitudes, norms, and self-efficacy regarding the five parent coaching components.
We then used independent sample t-tests to determine whether intentions for each parent coaching component varied between job type (i.e., full-time employee, part-time employee independent contractors), as well as by job title (i.e., speech and language pathologist, occupational therapist, special instructor, ABA therapist, physical therapist, other).
Finally, we used linear mixed models (one for each parent coaching component) to examine the relationship between the four psychological determinants of intentions (i.e., attitudes, descriptive norms, injunctive norms, self-efficacy) and early intervention clinicians’ intentions to use each of the parent coaching components. The models included attitudes, descriptive norms, injunctive norms and self-efficacy as fixed effects, random intercepts for agency, and intentions to use the core component of parent coaching as the dependent variable. For ease of comparison across scales, we computed standardized regression coefficients by multiplying the unstandardized coefficient by the standard deviation of the X variable and dividing by the standard deviation of the Y variable (Snijders and Bosker 2012).
Results
Strength of Intentions and Psychological Determinants of Intentions
Intraclass correlation coefficients (ICCs) for clinician intentions to use each of the five core components of parent coaching ranged from .01 (for demonstration) to .08 (for collaboration), indicating that 8% or less of the total variation in intentions for each core component could be accounted for by agency.
Means and standard deviations of intentions, attitudes, descriptive norms, injunctive norms, and self-efficacy regarding the use of the five parent coaching components are shown in Table 2. Across the five parent coaching components, mean intentions scores ranged from 5.67 (for daily routines, between “Slightly Likely and Quite Likely”) to 6.15 (for demonstration, between “Quite Likely and “Extremely Likely.”). Attitude composite scores ranged from 7.93 (for feedback) to 8.51 (for demonstration). The mean descriptive norm scores ranged from 3.78 (for daily routines) and 3.89 (for feedback and reflection and problem solving; all between “Neither Agree nor Disagree” and “Agree”). Injunctive norm composite scores ranged from 4.32 (for feedback) to 4.49 (for collaboration; both between “Approve” and “Strongly Approve”), and self-efficacy scores ranged from 4.27 (for daily routines) to 4.52 (for demonstration; both between “Agree” and “Strongly Agree”).
The Role of Job Type and Job Title
Clinician intentions to use each of the parent coaching components did not significantly differ based on whether the provider was a full-time employee, part-time employee, or independent contractor. Similarly, intentions to use most practices did not differ based on provider job title. The only exception was intentions to use Demonstration, which were significantly higher for physical therapists (M = 6.48, SD = .65) than for other clinicians (p = .022). These results should be interpreted with caution give the number of comparisons tested.
Associations between Psychological Determinants and Intentions
Results of linear mixed models predicting intentions from attitudes, descriptive norms, injunctive norms, and self-efficacy are displayed in Table 3.
Table 3.
Linear mixed models with attitudes, descriptive norms, injunctive norms and self-efficacy as fixed effects, random intercepts for agency, and intentions to use parent coaching components as the dependent variable (separate models for each component)
Collaboration | Daily Routines | Demonstration | Feedback | Reflection and Problem Solving | ||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
β | p | β | p | β | p | β | p | β | p | |
Attitudes | .30 | < .001 | .27 | < .001 | .31 | < .001 | .42 | < .001 | .49 | < .001 |
Descriptive Norms | .09 | .15 | .10 | .11 | .08 | .22 | .14 | .04 | .18 | .003 |
Injunctive Norms | .18 | .005 | .21 | < .001 | .20 | .007 | .10 | .17 | .02 | .74 |
Self-efficacy | .21 | < .001 | .30 | < .001 | .02 | .76 | .05 | .40 | .02 | .71 |
For collaboration, attitudes (b = .22, p < .001), injunctive norms (b = .38, p = .005), and self-efficacy (b = .31, p < .001), but not descriptive norms, significantly predicted clinicians’ intentions. Similarly, for daily routines, attitudes (b = .21, p < .001), injunctive norms (b = .45, p < .001), and self-efficacy (b = .51, p < .001), but not descriptive norms, significantly predicted clinicians’ intentions.
For demonstration, only attitudes (b = .26, p < .001), and injunctive norms (b = .36, p = .007) predicted intentions.
For feedback, attitudes (b = .29, p < .001) and descriptive norms (b = .20, p = .04), but not injunctive norms and self-efficacy, predicted clinician intentions. Similarly, for reflection and problem solving, attitudes (b = .38, p < .001) and descriptive norms (b = .27, p = .003), but not injunctive norms and self-efficacy, predicted intentions.
Discussion
Although they often are treated as monolithic, psychosocial interventions usually have many components, and clinicians’ motivation and ability to implement each of these components may vary. To date, however, few implementation strategies have taken the multifaceted quality of these interventions into account. The present study adds to the small but growing body of evidence suggesting that implementation strategies should be tailored to the specific intervention component to be most efficient and effective.
Clinicians’ average intentions were strongest for demonstrating the intervention strategy for a parent. This is perhaps not surprising, given that demonstrating interventions is the component closest to working directly with the child, the activity and skillset with which clinicians often have most comfort (Campbell & Halbert, 2002; Fleming et al., 2011). Intentions were weakest for delivering interventions within daily routines. This component may depend on whether the visit coincides with a relevant routine and also require more clinician creativity. These results varied little by whether the clinician was a fulltime employee, part-time employee or a contractor, or by their discipline.
The intervention components showed distinct patterns about which psychological determinants were associated with intentions. For collaboration and daily routines, clinicians’ attitudes (whether the clinician perceived that component as a good or bad thing to use), injunctive norms (whether the clinicians perceived that others want them to use the component), and self-efficacy (whether the clinician was confident that they can use the component), but not descriptive norms (whether clinicians perceived that other clinicians like them used that component), all were associated with their intentions. For feedback and reflection and problem solving, only attitudes and descriptive norms were associated with intentions. Finally, for demonstration, attitudes and injunctive norms predicted intentions. The finding that clinician attitudes were important for all components is consistent with findings that attitudes toward innovation can be important predictors of whether the innovation is adopted (Aarons, 2005; Nelson et al., 2006). In contrast, descriptive norms were associated only with providing parents feedback and engaging in reflection and problem solving, two related components that often are paired during coaching. One possible explanation for why these specific components were associated with descriptive norms is that many clinicians may not view providing parents feedback as within the scope of their roles (Tomczuk et al., 2022). Furthermore, clinicians working within early intervention systems have reported a preference for intervening directly with the child, instead of providing feedback to parents (Sawyer & Campbell, 2012), which may make descriptive norms important for feedback and reflection and problem solving in particular. This finding suggests that implementation strategies focused on changing clinicians’ perceptions of the extent to which others are using an innovation or components of an innovation, like delivering feedback or reflecting and problem solving, could be important for improving their intentions to implement those components.
Components of complex interventions may also differ in their feasibility and acceptability for implementation. It is possible that providers viewed components of parent coaching as more acceptable or more feasible to implement within publicly funded early intervention, which would influence their intentions and determinants of intentions to use those components. A more in-depth qualitative exploration into providers’ perspectives about the feasibility, acceptability, and usability of the parent coaching components can greatly inform large scale implementation efforts.
We note several study limitations. First, participating agencies were recruited via outreach to community partner agencies and word of mouth, which may have led to a sample that was not representative of EI agencies in the regions overall. Similarly, the sample of clinicians who responded to the survey may have not been representative of clinicians in the agency overall, and information is not available about the clinicians who did not respond. This is a common limitation among community-based survey research, and our 74% response rate was quite high (Baruch & Holtom, 2008). Second, the current study focused exclusively on individual-level clinician factors. The importance of examining potential implementation mechanisms at multiple levels is increasingly recognized (Williams, 2016), and it is possible that organizational and system level factors affect providers’ intentions to use parent coaching. We argue, however, that to the extent organizational variables are important, they likely are mediated through the clinician-level psychological characteristics we measure here (Fishman et al., 2018, 2020). Moreover, given the observed ICCs, the most variance in clinician intentions that could be accounted for by agency-level variables is 8%. Nevertheless, the incorporation of organization- and system-level factors is an important future direction. Finally, we do not have data regarding clinicians’ actual use of the parent coaching components. Although intentions have predicted practitioner behavior in a variety of settings (Godin et al., 2008; Presseau et al., 2014), it would have been potentially useful to collect data regarding the providers’ use of these intervention components during sessions with families of young children with ASD. Direct observation of usual practice was beyond the scope of this study although existing literature cites poor implementation of evidence-based parent coaching (Pellecchia et al., 2022; Salisbury et al., 2012), which makes it important to identify specific factors for implementation strategies to target.
Despite these limitations, there are important implications related to our findings. The current results provide evidence for potential individual-level targets for implementation strategies (i.e., attitudes, norms, self-efficacy), which can inform needed work to specify mechanistic implementation strategies (Lewis et al., 2018; Williams, 2016); moreover the results suggest that key implementation strategy targets may vary by intervention component. These results suggest that efficient and effective implementation strategies will address several issues concurrently. First, they will address components of complex interventions separately, recognizing that what drives successful implementation of one component may differ from what drives implementation of others. Second, strategies should differ when intentions to implement are strong, compared with when they are weak. When intentions are weak, strategies should leverage psychological determinants of intentions to strengthen them. When they are strong, strategies should focus on removing barriers to practitioners acting on strong intentions (Fishman et al., 2018, 2020). Choosing strategies could involve examining average strength of intentions for a particular group of practitioners, but also opens the possibility of individualized implementation strategies that address implementation barriers specific to the individual.
Finally, to the extent that intentions are an important predictor of implementation, effective implementation strategies will target different determinants of intention to increase the strength of those intentions. This could involve offering incentives or changing clinicians’ understanding of the value of a particular component to improve attitudes; increasing the effectiveness of supervisor or parent messaging or using peer comparisons to strengthen norms; or using training or coaching to improve self-efficacy. Indeed, recently-developed implementation strategies, such as the BASIS strategy (Larson et al., 2021; Lyon et al., 2019) target these potential mechanisms. The current results suggest the importance of developing and testing similar strategies to strengthen early intervention clinicians’ intentions to use parent coaching.
Furthermore, our results suggest that at least for parent coaching, a suite of potential strategies should be developed depending on the intervention component. This is likely the case for other complex psychosocial interventions as well, and is consistent with recent efforts to improve the tailoring of implementation strategies (e.g., Highfield et al., 2018; Krause et al., 2014; Powell et al., 2017). The consideration of intervention component in the selection and tailoring of implementation strategies for complex, psychosocial interventions delineates a new path forward in developing flexible, efficient and effective strategies to increase use of evidence-based practices.
Funding:
This work was supported by the National Institute of Mental Health under Grants R21MH118489 and K23MH122577.
Footnotes
Declaration of Conflicting Interests: The Author(s) declare(s) that there is no conflict of interest
Compliance with Ethical Standards: This study was approved by the Institutional Review Boards of the University of Pennsylvania and the City of Philadelphia., and was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments. Informed consent was obtained from all individual participants included in the study.
References
- Aarons GA (2005). Measuring provider attitudes toward evidence-based practice: Consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America, 14(2), 255–271. 10.1016/j.chc.2004.04.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ajzen A (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50 (2). 179–211. [Google Scholar]
- Armitage CJ, & Conner M (2001). Efficacy of the Theory of Planned Behaviour: A meta-analytic review. British Journal of Social Psychology, 40(4), 471–499. 10.1348/014466601164939 [DOI] [PubMed] [Google Scholar]
- Baruch Y, & Holtom BC (2008). Survey response rate levels and trends in organizational research. Human Relations, 61(8), 1139–1160. 10.1177/0018726708094863 [DOI] [Google Scholar]
- Becker EM, Smith AM, & Jensen-Doss A (2013). Who’s using treatment manuals? A national survey of practicing therapists. Behaviour Research and Therapy, 51(10), 706–710. 10.1016/j.brat.2013.07.008 [DOI] [PubMed] [Google Scholar]
- Campbell PH, & Halbert J (2002). Between research and practice: Provider perspectives on Early Intervention. Topics in Early Childhood Special Education, 22(4), 213–226. 10.1177/027112140202200403 [DOI] [Google Scholar]
- Dunst CJ, & Trivette CM (2009). Let’s Be PALS: An evidence-based approach to professional development. Infants & Young Children, 22(3), 164–176. 10.1097/IYC.0b013e3181abe169 [DOI] [Google Scholar]
- Estes A, Vismara L, Mercado C, Fitzpatrick A, Elder L, Greenson J … & Rogers S (2014) The impact of parent-delivered intervention on parents of very young children with Autism. Journal of Autism and Developmental Disorders, 44 (2) 353–365 10.1007/s10803-013-1874-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fishbein M, & Ajzen I (2010). Predicting and changing behavior: The reasoned action approach. Psychology Press. [Google Scholar]
- Fishman J, Beidas R, Reisinger E, & Mandell DS (2018). The utility of measuring intentions to use best practices: A longitudinal study among teachers supporting students with Autism. Journal of School Health, 88(5), 388–395. 10.1111/josh.12618 [DOI] [PubMed] [Google Scholar]
- Fishman J, Lushin V, & Mandell DS (2020). Predicting implementation: Comparing validated measures of intention and assessing the role of motivation when designing behavioral interventions. Implementation Science Communications, 1(1), 81. 10.1186/s43058-020-00050-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fishman J, Yang C, & Mandell D (2021). Attitude theory and measurement in implementation science: A secondary review of empirical studies and opportunities for advancement. Implementation Science, 16(1), 87. 10.1186/s13012-021-01153-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming JL, Sawyer LB, & Campbell PH (2011). Early Intervention providers’ perspectives about implementing participation-based practices. Topics in Early Childhood Special Education, 30(4), 233–244. 10.1177/0271121410371986 [DOI] [Google Scholar]
- Friedman M, Woods J, & Salisbury C (2012). Caregiver coaching strategies for Early Intervention providers: Moving toward operational definitions. Infants & Young Children, 25(1), 62–82. 10.1097/IYC.0b013e31823d8f12 [DOI] [Google Scholar]
- Godin G, Bélanger-Gravel A, Eccles M, & Grimshaw J (2008). Healthcare professionals’ intentions and behaviours: A systematic review of studies based on social cognitive theories. Implementation Science, 3(1). 10.1186/1748-5908-3-36 [DOI] [PMC free article] [PubMed] [Google Scholar]
- González-Valderrama A, Mena C, Undurraga J, Gallardo C, & Mondaca P (2015). Implementing psychosocial evidence-based practices in mental health: Are we moving in the right direction? Frontiers in Psychiatry, 6. 10.3389/fpsyt.2015.00051 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanft BE, Rush DD, Shelden ML. (2014). Coaching Families and Colleagues in Early Childhood. Brookes Publishing Company. [Google Scholar]
- Highfield L, Valerio MA, Fernandez ME, & Eldridge-Bartholomew LK (2018). Development of an implementation intervention using intervention mapping to increase mammography among low income women. Frontiers in Public Health, 6, 300. 10.3389/fpubh.2018.00300 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunt M, Al-Braiki F, Dailey S, Russell R, & Simon K (2018). Mindfulness training, yoga, or both? Dismantling the active components of a Mindfulness-Based Stress Reduction intervention. Mindfulness, 9(2), 512–520. 10.1007/s12671-017-0793-z [DOI] [Google Scholar]
- Individuals with Disabilities Education Act, 20 U.S.C. § 1400 (2004).
- Kasari C, Lawton K, Shih W, Barker TV, Landa R, Lord C, Orlich F, King B, Wetherby A, & Senturk D (2014). Caregiver-mediated intervention for low-resourced preschoolers with Autism: An RCT. Pediatrics, 134(1), 8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kazdin AE (2017). Addressing the treatment gap: A key challenge for extending evidence-based psychosocial interventions. Behaviour Research and Therapy, 88, 7–18. 10.1016/j.brat.2016.06.004 [DOI] [PubMed] [Google Scholar]
- Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, Jaeger C, Steinhaeuser J, Godycki-Cwirko M, Kowalczyk A, Agarwal S, Wensing M, & Baker R (2014). Identifying determinants of care for tailoring implementation in chronic diseases: An evaluation of different methods. Implementation Science, 9(1), 102. 10.1186/s13012-014-0102-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larson M, Cook CR, Brewer SK, Pullmann MD, Hamlin C, Merle JL, Duong M, Gaias L, Sullivan M, Morrell N, Kulkarni T, Weeks M, & Lyon AR (2021). Examining the effects of a brief, group-based motivational implementation strategy on mechanisms of teacher behavior change. Prevention Science, 22(6), 722–736. 10.1007/s11121-020-01191-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levin ME, Krafft J, & Twohig MP (2020). Examining processes of change in an online acceptance and commitment therapy dismantling trial with distressed college students. Journal of Contextual Behavioral Science, 17, 10–16. 10.1016/j.jcbs.2020.05.001 [DOI] [Google Scholar]
- Lewis CC, Boyd MR, Walsh-Bailey C, Lyon AR, Beidas R, Mittman B, Aarons GA, Weiner BJ, & Chambers DA (2020). A systematic review of empirical studies examining mechanisms of implementation in health. Implementation Science, 15(1), 21. 10.1186/s13012-020-00983-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lewis CC, Klasnja P, Powell BJ, Lyon AR, Tuzzio L, Jones S, Walsh-Bailey C, & Weiner B (2018). From Classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6. 10.3389/fpubh.2018.00136 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lewis CC, Powell BJ, Brewer SK, Nguyen AM, Schriger SH, Vejnoska SF, Walsh-Bailey C, Aarons GA, Beidas RS, Lyon AR, Weiner B, Williams N, & Mittman B (2021). Advancing mechanisms of implementation to accelerate sustainable evidence-based practice integration: Protocol for generating a research agenda. BMJ Open, 11(10), e053474. 10.1136/bmjopen-2021-053474 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyon AR, Cook CR, Duong MT, Nicodimos S, Pullmann MD, Brewer SK, Gaias LM, & Cox S (2019). The influence of a blended, theoretically-informed pre-implementation strategy on school-based clinician implementation of an evidence-based trauma intervention. Implementation Science, 14(1). 10.1186/s13012-019-0905-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maddox BB, Crabbe SR, Fishman JM, Beidas RS, Brookman-Frazee L, Miller JS, Nicolaidis C, & Mandell DS (2019). Factors influencing the use of cognitive–behavioral therapy with Autistic adults: A survey of community mental health clinicians. Journal of Autism and Developmental Disorders, 49(11), 4421–4428. 10.1007/s10803-019-04156-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson TD, Steele RG, & Mize JA (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges. Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 398–409. 10.1007/s10488-006-0044-4 [DOI] [PubMed] [Google Scholar]
- Oono IP, Honey EJ, & McConachie H (2013). Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Cochrane Database of Systematic Reviews. 10.1002/14651858.CD009774.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pellecchia M, Connell JE, Beidas RS, Xie M, Marcus SC, & Mandell DS (2015). Dismantling the active ingredients of an intervention for children with Autism. Journal of Autism and Developmental Disorders, 45(9), 2917–2927. 10.1007/s10803-015-2455-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pellecchia M, Mandell DS, Beidas RS, Dunst CJ, Tomczuk L, Newman J, Zeigler L, & Stahmer AC (2022). Parent coaching in Early Intervention for Autism Spectrum Disorder: A brief report. Journal of Early Intervention, 105381512210958. 10.1177/10538151221095860 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, Proctor EK, & Mandell DS (2017). Methods to improve the selection and tailoring of implementation strategies. The Journal of Behavioral Health Services & Research, 44(2), 177–194. 10.1007/s11414-015-9475-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Presseau J, Johnston M, Francis JJ, Hrisos S, Stamp E, Steen N, Hawthorne G, Grimshaw JM, Elovainio M, Hunter M, & Eccles MP (2014). Theory-based predictors of multiple clinician behaviors in the management of diabetes. Journal of Behavioral Medicine, 37(4), 607–620. 10.1007/s10865-013-9513-x [DOI] [PubMed] [Google Scholar]
- Proctor EK, Powell BJ, & McMillen JC (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(1), 139. 10.1186/1748-5908-8-139 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rogers SJ, Estes A, Lord C, Vismara L, Winter J, Fitzpatrick A, Guo M, & Dawson G (2012). Effects of a brief Early Start Denver Model (ESDM)–Based parent intervention on toddlers at risk for Autism Spectrum Disorders: A randomized controlled trial. Journal of the American Academy of Child & Adolescent Psychiatry, 51(10), 1052–1065. 10.1016/j.jaac.2012.08.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rush DD, Shelden ML, Hanft BE (2003). Coaching Families and Colleagues: A Process for Collaboration in Natural Settings. Infants Young Child. 6(1):33–47. [Google Scholar]
- Salisbury C, Cambray-Engstrom E, & Woods J (2012). Providers’ reported and actual use of coaching strategies in natural environments. Topics in Early Childhood Special Education, 32(2), 88–98. 10.1177/0271121410392802 [DOI] [Google Scholar]
- Sawyer BE, & Campbell PH (2012). Early Interventionists’ perspectives on teaching caregivers. Journal of Early Intervention, 34(2), 104–124. 10.1177/1053815112455363 [DOI] [Google Scholar]
- Snijders TAB, & Bosker RJ (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks: Sage Publishing. [Google Scholar]
- Tomczuk L, Stewart RE, Beidas RS, Mandell DS, & Pellecchia M (2022). Who gets coached? A qualitative inquiry into community clinicians’ decisions to use caregiver coaching. Autism, 26(3), 575–585. 10.1177/13623613211059499 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tomeny KR, McWilliam RA, & Tomeny TS (2020) Caregiver-implemented intervention for young children with Autism Spectrum Disorder: A systematic review of coaching components. Review Journal of Autism and Developmental Disorders, 7(2), 168–181. 10.1007/s40489-019-00186-7 [DOI] [Google Scholar]
- Williams NJ (2016). Multilevel mechanisms of implementation strategies in mental health: Integrating theory, research, and practice. Administration and Policy in Mental Health and Mental Health Services Research, 43(5), 783–798. 10.1007/s10488-015-0693-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wolk CB, Becker-Haimes EM, Fishman J, Affrunti NW, Mandell DS, & Creed TA (2019). Variability in clinician intentions to implement specific cognitive-behavioral therapy components. BMC Psychiatry, 19(1), 406. 10.1186/s12888-019-2394-y [DOI] [PMC free article] [PubMed] [Google Scholar]