Skip to main content
JAMA Network logoLink to JAMA Network
. 2023 Jan 9;177(3):231–239. doi: 10.1001/jamapediatrics.2022.5204

Telehealth Treatment of Behavior Problems in Young Children With Developmental Delay

A Randomized Clinical Trial

Daniel M Bagner 1,2,, Michelle D Berkovits 3, Stefany Coxe 1,2, Natalie Frech 4, Dainelys Garcia 3, Alexandra Golik 5, Brynna H Heflin 1,2, Perrine Heymann 1,2, Natalie Javadi 1,2, Amanda L Sanchez 6, Maria K Wilson 7, Jonathan S Comer 1,2
PMCID: PMC9857733  PMID: 36622653

This randomized clinical trial investigates the effects of an internet-delivered parent-child interaction therapy for children aged 3 years with developmental delay.

Key Points

Question

What are the effects of a telehealth format of parent-child interaction therapy (PCIT), ie, internet-delivered PCIT (iPCIT), for children aged 3 years with developmental delay?

Findings

In this randomized clinical trial that included 150 children with developmental delay and their primary caregiver, iPCIT led to improvements in child behavior that were maintained across follow-up visits.

Meaning

Against a backdrop of considerable barriers to mental health services, these findings show the promise of telehealth formats for expanding the reach and scope of care for underserved children with developmental delay and their families.

Abstract

Importance

Early behavior problems in children with developmental delay (DD) are prevalent and impairing, but service barriers persist. Controlled studies examining telehealth approaches are limited, particularly for children with DD.

Objective

To evaluate the efficacy of a telehealth parenting intervention for behavior problems in young children with DD.

Design, Setting, and Participants

A randomized clinical trial was conducted from March 17, 2016, to December 15, 2020, in which children with DD and externalizing behavior problems were recruited from early intervention and randomly assigned to a telehealth parenting intervention or control group and evaluated through a 12-month follow-up. Most children were from ethnic or racial minoritized backgrounds. Over one-half of children were in extreme poverty or low income-need ratio categories.

Interventions

Internet-delivered parent-child interaction therapy (iPCIT), which leverages videoconferencing to provide live coaching of home-based caregiver-child interactions. Families received 20 weeks of iPCIT (provided in English or in Spanish) or referrals as usual (RAU).

Main Outcomes and Measures

Observational and caregiver-report measures of child and caregiver behaviors and caregiving stress were examined at preintervention, midtreatment, and postintervention and at 6- and 12-month follow-ups.

Results

The sample included a total of 150 children (mean [SD] age, 36.2 [1.0] months; 111 male children [74%]) and their caregivers with 75 each randomly assigned to iPCIT or RAU groups. Children receiving iPCIT relative to RAU displayed significantly lower levels of externalizing problems (postintervention Cohen d = 0.48; 6-month Cohen d = 0.49; 12-month Cohen d = 0.50) and significantly higher levels of compliance to caregiver direction after treatment. Of those children with data at postintervention, greater clinically significant change was observed at postintervention for children in the iPCIT group (50 [74%]) than for those in the RAU group (30 [42%]), which was maintained at the 6-month but not the 12-month follow-up. iPCIT did not outperform RAU in reducing caregiving stress, but caregivers receiving iPCIT, relative to RAU, showed steeper increases in proportion of observed positive parenting skills (postintervention odds ratio [OR], 1.10; 95% CI, 0.53-2.21; 6-month OR, 1.31; 95% CI, 0.61-2.55; 12-month OR, 1.64; 95% CI, 0.70-3.07) and sharper decreases in proportion of observed controlling/critical behaviors (postintervention OR, 1.40; 95% CI, 0.61-1.52; 6-month OR, 1.72; 95% CI, 0.58-1.46; 12-month OR, 2.23; 95% CI, 0.53-1.37). After treatment, iPCIT caregivers also self-reported steeper decreases in harsh and inconsistent discipline than did than RAU caregivers (postintervention Cohen d = 0.24; 6-month Cohen d = 0.26; 12-month Cohen d = 0.27).

Conclusions and Relevance

Results of this randomized clinical trial provide evidence that a telehealth-delivered parenting intervention with real-time therapist coaching led to significant and maintained improvements for young children with DD and their caregivers. Findings underscore the promise of telehealth formats for expanding scope and reach of care for underserved families.

Trial Registration

ClinicalTrials.gov Identifier: NCT03260816

Introduction

Behavior problems in young children with developmental delay (DD) represent a significant public health concern. Roughly 13% of young children have a DD,1 and over one-half of these children have at least 1 mental health disorder.2 Behavioral challenges are particularly common, as children with DD show 3 times the risk of clinically significant externalizing problems relative to typically developing children.3 Externalizing problems in children with DD are associated with a wide range of functional impairments4 and result in significant economic costs when left untreated.5 Caregivers of children with DD experience high levels of caregiving stress6 associated with the severity of child behavior problems.7 Accordingly, effective treatment of behavior problems in young children with DD is critical.

In the US, early intervention (EI), via Part C of the Individuals With Disabilities Education Act, provides services to children aged 0 to 3 years with DD. However, EI focuses on child delay(s)8 rather than associated behavior problems and caregiving stress that predict functional outcomes.9 Caregivers completing EI report less confidence managing their child’s behavior than meeting their child’s developmental needs.10 Research demonstrates efficacy of clinic-based parenting interventions for treating behavior problems in children with DD.11,12,13,14 For example, parent-child interaction therapy (PCIT)15 draws on attachment and social learning theories, with efficacy supported across multiple studies of youth with DD and autism spectrum disorder.11,12,16,17,18,19 A distinguishing feature of clinic-based PCIT is its use of in-session caregiver coaching via a 1-way mirror and wireless caregiver-worn earpiece.

Despite support for PCIT and other clinic-based parenting interventions, considerable barriers interfere with accessibility and acceptability of children’s mental health services, including transportation obstacles, regional clinician shortages, limited availability of non-English language services, and stigma-related concerns about visiting a clinic.20,21 Youth from marginalized, low-income, and/or remote communities are particularly underserved.22 Among children with DD who received clinic-based treatment for behavior, those living in poverty and from ethnic or racial minoritized backgrounds have lower session attendance and higher dropout rates.23 In EI, Spanish-speaking families and families living in poverty experience delayed or inadequate services,24 and EI services abruptly end and transition to school-based services after the child’s third birthday.25,26

Rapidly developing technology, broadening internet availability, and increasingly sophisticated capabilities for live home-based broadcasting have transformed behavioral health delivery and can overcome issues of geography, transportation, and stigma.27 Telehealth strategies are not new, although when COVID-19 stay-at-home guidelines put traditional clinic-based mental health care further out of reach for families,28 telehealth practices entered the clinical mainstream.29,30 Despite increasing reliance on telehealth strategies in mental health care, randomized clinical trials (RCTs) evaluating telehealth strategies with families of young children are limited.

Research shows initial support for internet-delivered PCIT (iPCIT) in broadening reach for treating typically developing youth.30 Given the importance of in-session caregiver coaching,31 iPCIT therapists use videoconferencing to watch family interactions and provide in-the-moment feedback to caregivers via a wireless caregiver-worn earpiece. In an initial RCT32 comparing iPCIT vs clinic-based PCIT for young typically developing children with disruptive behavior, outcomes were comparable, except that caregivers receiving iPCIT reported fewer barriers to care, and more children receiving iPCIT were rated by masked evaluators as having an excellent response compared with those receiving clinic-based PCIT. Findings suggest iPCIT can reduce barriers and may offer incremental benefits over clinic-based PCIT. However, this preliminary iPCIT evaluation excluded children with DD and caregivers who did not speak English, studied a sample of mostly non-Hispanic or non-Latino White families, and was not powered to test broad clinical utility.

We conducted, to our knowledge, the first RCT of a telehealth-delivered parenting intervention for young children with DD and present the main outcomes herein. Participants were from predominantly economically disadvantaged and underrepresented ethnic or racial minoritized backgrounds. In a 2-armed RCT, families were randomly assigned to receive iPCIT or referrals as usual (RAU) for 20 weeks after ending EI services at age 3 years and evaluated across a 12-month follow-up period. For primary outcomes, we hypothesized iPCIT, relative to RAU, would be associated with significantly reduced child externalizing problems, higher levels of observed child compliance with caregiver direction, and a higher rate of children showing clinically significant change. For secondary outcomes, we expected caregivers receiving iPCIT, relative to RAU, would show increases in positive parenting skills and decreases in controlling/critical behaviors during play with their child, as well as decreases in harsh and inconsistent discipline and caregiving stress.

Methods

Participants and Study Design

The Florida International University institutional review board approved this study and oversaw all procedures (Supplement 1). Families were recruited between March 17, 2016, and August 28, 2019, at 3 Part C EI sites in South Florida. Recruitment occurred during the child’s EI exit evaluation within 3 months of the child’s third birthday. Inclusion criteria among these youth with DD were (1) Child Behavior Checklist (CBCL)33 externalizing problems T score greater than or equal to 60 and (2) the primary caregiver speaks English or Spanish. Exclusion criteria were as follows: (1) child receiving psychiatric medication for behavior problems; (2) child/caregiver deafness or blindness; (3) severe child social communication deficits (ie, caregiver report on Social Responsiveness Scale, second edition,34 T score >75), although children with moderate social communication deficits (scores between 66-75), including those with autism spectrum disorder, were eligible; and (4) primary caregiver standard score less than 4 on the vocabulary subtest of the Wechsler Abbreviated Scale of Intelligence, second edition35 (for English speakers) or Escala de Inteligencia Wechsler Para Adultos, third edition36 (for Spanish speakers). This study followed the Consolidated Standards of Reporting Trials (CONSORT) reporting guidelines.

Families meeting study eligibility were invited to participate. After providing informed written consent, families completed a baseline assessment. Eligible families were randomly assigned 1:1 (stratified by child sex) to up to 20 weeks of either iPCIT or RAU by the masked study statistician. A total of 124 families (62 per condition) was determined sufficient to detect a medium effect with 80% power at α less than .05. Major assessments, consisting of caregiver reports and observational tasks of family interactions, were conducted in the family’s home at baseline and week 20 (posttreatment/RAU) and again at 6- and 12-month follow-ups. An abbreviated caregiver-report assessment was collected at week 8 (ie, midtreatment). Consistent with other studies of parenting interventions37,38 and ethical guidelines for research participant payment,39 families received $100 for each major assessment ($50 at midtreatment) and a tablet (valued at $50) at study completion. All participants completed the treatment phase before the COVID-19 pandemic. The study flow and retention rates were consistent with other studies conducting home-based assessments.40 Participants from the following race and ethnic groups were included in the study: Asian, Black or African American, Hispanic or Latino, non-Hispanic or non-Latino White, and other, which included biracial individuals. Race and ethnicity were identified by caregiver report.

Treatment

iPCIT draws on encrypted videoconferencing technology in which therapists provide live coaching of caregiver-child interactions via webcam and a caregiver-worn earpiece. As in clinic-based PCIT, iPCIT progresses through child-directed interaction and parent-directed interaction phases. During child-directed interaction, caregivers learn to follow their child’s lead in play by using PRIDE skills (ie, praising child behavior, reflecting child statements, imitating child play, describing child actions, and showing enjoyment) and avoiding questions, commands, and criticisms. They learn to use PRIDE skills in response to appropriate child behaviors and ignore undesirable behaviors. During parent-directed interaction, caregivers learn to use effective commands and consistently follow through with timeouts to increase child compliance. Families received a tablet (and data plan for families without a wireless network) and wireless earpiece for treatment. Sessions were conducted weekly by a remote therapist and lasted 1 to 1.5 hours. Approximately one-half of iPCIT-treated families received treatment in Spanish. Therapists were psychology doctoral students or postdoctoral fellows, who completed initial PCIT training before working on this project, and received ongoing supervision and consultation from the first author, a PCIT International Global Trainer.

Measures

Primary Child Behavior Outcomes

The CBCL for ages 1.5 to 5 years is a 99-item caregiver-rating scale that measures the frequency of children’s behavioral and emotional problems, showing excellent psychometric properties,33 including in RCTs of interventions for children with DD.11,14 The externalizing T score was used to measure caregiver-reported child externalizing problems at all assessments (α = .90).

The Dyadic Parent-Child Interaction Coding System, fourth edition (DPICS) is a well-supported observational coding system of caregiver and child behaviors during family interactions.41 Coders masked to condition were trained to 80% agreement with a criterion tape, and 25% of baseline observations were double-coded for reliability (mean κ = 0.83). Child compliance, defined as the proportion of caregiver commands with which the child complied, was coded during a 5-minute clean-up task at each major assessment. For child compliance scores in DPICS, the range was from 0 to 100 because the scores represent percentage compliance.

Secondary Caregiver Behavior Outcomes

The DPICS was also used to observe caregiver behaviors during family interactions. “Do” skills during play refer to praises, behavior descriptions, and reflections, whereas “don’t” skills refer to questions, commands, and criticisms. The proportion of caregiver do and don’t skills was coded to reflect positive vs controlling/critical parenting behaviors during a 5-minute child-led play task completed at each major assessment. The do and don’t skills in DPICS are proportions, therefore, the range of those scores are from 0 to 100.

The Harsh and Inconsistent Discipline subscale of the Parenting Practices Inventory (PPI)42 measured caregiver-reported discipline at each major assessment and showed strong psychometric properties in caregivers of young children (α = .83).

The Negative Feelings Toward Parenting subscale of the Family Impact Questionnaire (FIQ)43 measured caregiving stress and strain at all assessments and has been used extensively with caregivers of children with DD44 (α = .70).

Treatment Satisfaction

The Therapy Attitude Inventory (TAI)45 and Client Satisfaction Questionnaire 8 (CSQ-8)46 assessed caregiver satisfaction with iPCIT at postintervention. Both measures have shown strong psychometric properties47,48 (TAI α = 0.95; CSQ α = 0.94).

Statistical Analysis

Mixed-effects regression models analyzed the effects of time, treatment condition, and their interaction as predictors of outcome trajectories.49 We treated time as a continuous predictor (weeks since baseline) consistent with recommendations to decrease the likelihood of type I error.50 For continuous outcomes (CBCL, PPI, FIQ), linear mixed models were used; for proportions (compliance, do/don’t skills), generalized linear (logistic) mixed models were used. For CBCL and PPI models, the natural log of weeks since baseline was used as the time predictor to linearize associations between time and outcomes; this was based on comparing the Akaike information criterion and Bayesian information criterion from this model to the linear time model.51 Separate mixed-effects models were run for each outcome. Significant condition-by-time interactions were followed up with simple slopes probing to clarify the direction of effects for each group. We evaluated clinical significance by creating a dichotomous variable as to whether the CBCL externalizing T score was below or above the clinical cutoff of 60 at postintervention and follow-up. To compare rates of children moving out of the clinical range of symptoms across conditions, χ2 tests were used.

Mixed models provide unbiased estimates when missing values are at least missing at random.52 Missing value analysis showed that missingness on variables at later waves was associated with child sex, child age, language of assessment, and BDI score; these variables were included as covariates in all models (child age and BDI were mean centered). All P values were 2-sided, and the cutoff for significance was set at P <.05. Statistical analyses were performed using the lme4 package in R, version 4.2.0 (R Core Team).

Results

Descriptive Findings

The sample included a total of 150 children (mean [SD] age, 36.2 [1.0] months; 111 male children [74%]; 39 female children [26%]) and their caregivers. Children from the following race and ethnicity groups were included: 5 Asian (3.4%), 35 Black or African American (23.5%), 105 Hispanic or Latino (70.5%), 10 non-Hispanic or non-Latino White (6.7%), and 2 other (1.3%). All families completed the baseline assessment and were included in all analyses. Figure 1 presents study flow and retention rates.

Figure 1. Consolidated Standards of Reporting Trials (CONSORT) Flow Diagram.

Figure 1.

CBCL indicates Child Behavior Checklist; EIWA, Escala de Inteligencia Wechsler Para Adultos; iPCIT, internet-delivered parent-child interaction therapy; RAU, referrals as usual; SRS, Social Responsiveness Scale; WASI, Wechsler Abbreviated Scale of Intelligence.

Table 1 presents sample baseline characteristics. Most primary caregivers identified themselves (135 of 149 [91%]) and their child (140 of 149 [94%]) as being from an ethnic or racial minoritized group (1 family did not report race or ethnicity data). Approximately one-half of primary caregivers reported speaking multiple languages (60 of 145 [48%]). Based on income-need ratios (household income divided by Federal Poverty Threshold),53 over one-half of the sample was classified in extreme poverty or low-income categories (78 of 137 [57%]). Most caregivers were biological/adoptive mothers (137 [91%]); 12 (8%) were biological/adoptive fathers, and 1 (1%) was a biological grandmother. Mean developmental functioning across the sample (as determined by the Battelle Development Inventory, second edition54 administered at the EI exit evaluation) was in the low average range, and mean CBCL externalizing T scores were in the clinical range. No baseline group differences were found.

Table 1. Baseline Demographic Variables Across Conditions.

Characteristic Treatment condition, No. (%)
Total (n = 150) iPCIT group (n = 75) RAU group (n = 75)
Child sex
Male 111 (74.0) 54 (72.0) 57 (76.0)
Female 39 (26.0) 21 (28.0) 18 (24.0)
Child age, mean (SD), mo 36.20 (1.0) 36.30 (1.3) 36.10 (0.6)
Child ethnicity and racea
Asian 5 (3.4) 1 (1.4) 4 (5.3)
Black/African American 35 (23.5) 14 (18.9) 21 (28.0)
Hispanic or Latino 105 (70.5) 58 (78.4) 47 (62.7)
Non-Hispanic or non-Latino White 10 (6.7) 3 (4.1) 7 (9.3)
Otherb 2 (1.3) 0 (0) 2 (2.7)
Primary caregiver ethnicity and racea
Asian 5 (3.4) 1 (1.4) 4 (5.3)
Black/African American 35 (13.5) 14 (18.9) 21 (28.0)
Hispanic or Latino 99 (66.4) 53 (71.6) 46 (61.3)
Non-Hispanic or non-Latino White 15 (10.1) 7 (9.5) 8 (10.7)
Otherb 4 (2.7) 1 (1.4) 3 (4.0)
Primary caregiver age, mean (SD), y 34.49 (6.3) 34.30 (6.1) 34.68 (6.5)
Primary caregiver education (highest)c
Did not complete high school 14 (9.6) 7 (9.7) 7 (9.5)
Graduated high school 60 (41.1) 27 (37.5) 33 (44.6)
Graduated college 49 (33.6) 25 (34.7) 24 (32.4)
Completed graduate degree 23 (15.4) 13 (18.1) 10 (13.5)
Income-to-needs classificationd
Extreme poverty/poor 42 (30.7) 23 (33.8) 19 (27.5)
Low income 36 (26.3) 21 (30.9) 15 (21.7)
Adequate income 32 (23.4) 12 (17.7) 20 (30.0)
Affluent 27 (19.7) 12 (17.7) 15 (21.7)
Primary caregiver languagee
English and Spanish 58 (40.0) 25 (34.7) 33 (45.2)
English only 41 (28.3) 20 (27.8) 21 (28.8)
Spanish only 35 (24.1) 22 (30.6) 33 (45.2)
English and other (eg, Creole) 11 (7.59) 5 (6.9) 6 (8.2)
CBCL Externalizing T score, mean (SD) 68.52 (6.9) 67.75 (6.6) 69.29 (7.2)
BDI developmental quotient, mean (SD) 74.74 (10.0) 75.23 (9.6) 74.26 (10.4)

Abbreviations: BDI, Battelle Developmental Inventory; CBCL, Child Behavior Checklist; iPCIT, internet-delivered parent-child interaction therapy; RAU, referrals as usual.

a

Based on 149 primary caregivers who reported ethnic or racial identity data. Percentages add up to more than 100% as categories are not mutually exclusive.

b

Other race or ethnicity indicates biracial.

c

Based on n = 146 of primary caregivers who reported education data.

d

Based on n = 137 who reported income and dependents in household to calculate the income to needs ratio based on Federal Poverty Threshold.

e

Based on n = 145 of primary caregivers who reported language(s) spoken at home.

On average, families assigned to iPCIT completed 9.44 sessions (range, 0-19 sessions) in 20 weeks; 55 (73%) completed at least 5 sessions, and 42 (56%) completed at least 10 sessions. A total of 147 sessions (21%) were randomly selected and coded for fidelity, defined as the percentage of session elements detailed in the PCIT manual to which the therapist adhered. Fidelity was high across sessions (mean = 86%). At posttreatment, iPCIT-treated caregivers reported high satisfaction with treatment on the TAI (mean = 44.45 of 50) and the CSQ-8 (mean = 28.74 of 32). Among families in the RAU group, 44 of 71 (62%) received services for their child between baseline and postassessments, predominately from speech (34 of 71 [48%]) or occupational (27 of 71 [38%]) therapists.

Child Behavior Outcomes

Table 2 presents model-implied means and details of regression models predicting changes in child behavior outcomes. Caregiver report of child externalizing problems on the CBCL had a significant condition-by-time interaction term, indicating the conditions had different effects on child externalizing problems across time. Specifically, caregiver report of child externalizing problems significantly decreased over time for both conditions but decreased more steeply in response to iPCIT (between-conditions postintervention Cohen d = 0.48; 6-month follow-up d = 0.49; 12-month follow-up d = 0.50). These steeper iPCIT declines in externalizing problems unfolded during the acute treatment phase, after which gains were largely maintained across the 12-month follow-up (Figure 2). Significantly more children in the iPCIT-treated group than in the RAU group demonstrated clinically significant change in externalizing problems at postintervention (50 of 68 [74%] vs 30 of 71 [42%]; P < .001) and 6-month follow-up (45 of 62 [73%] vs 31 of 69 [45%]; P = .002), but not at 12-month follow-up (42 of 62 [68%] vs 46 of 71 [65%]; P = .85).

Table 2. Model-Implied Means Across Conditions and Results of Mixed Modelsa.

Outcome Model-implied means
Baseline Midintervention Postintervention 6-mo Follow-up 12-mo Follow-up Time Condition Condition by time interaction
Primary outcomes: child
Externalizing problemsb
iPCIT 61.18 54.43 53.82 53.43 53.15 −0.60c 4.97d 0.23e
RAU 64.05 59.87 59.49 59.25 59.08
Observed proportion compliancef
iPCIT 0.12 NA 0.15 0.19 0.23 0.01c 0.26 −0.01c
RAU 0.16 NA 0.17 0.18 0.20
Secondary outcomes: caregiver
Observed proportion do skillsf
iPCIT 0.11 NA 0.12 0.13 0.14 0.01c 0.08 −0.01c
RAU 0.12 NA 0.11 0.10 0.09
Observed proportion don’t skillsf
iPCIT 0.45 NA 0.40 0.36 0.31 −0.01c 0.11 0.01c
RAU 0.47 NA 0.48 0.49 0.50
Harsh/inconsistent disciplineb
iPCIT 3.05 NA 2.57 2.54 2.52 −0.04c 0.14 0.02d
RAU 2.99 NA 2.77 2.76 2.75
Caregiving stressg
iPCIT 11.10 10.72 10.05 9.09 7.89 −0.04c 0.95 0.02
RAU 12.05 11.80 11.35 10.72 9.92

Abbreviations: BDI, Battelle Developmental Inventory; iPCIT, internet-delivered parent-child interaction therapy; NA, not available; RAU, referrals as usual.

a

All models include child sex, age, language, and BDI score as covariates; BDI and child age were mean centered. Slopes reflect change in outcome per week. Means are calculated at the mean week for each assessment. Mean timing of post = 22.10 weeks after baseline; mean timing of 6-month follow-up = 42.34 weeks after baseline; mean timing of 12-month follow-up = 67.52 weeks after baseline.

b

Log transformation of week model. Slopes reflect change in outcome variable per log (week). Externalizing problems measured via Child Behavior Checklist. Harsh and inconsistent discipline measured via Parenting Practices Inventory.

c

P < .001

d

P < .01

e

P < .05

f

Logistic mixed model. Slopes reflect change in logit of outcome per week. Observed child compliance and observed caregiver do and don’t skills measured via Dyadic Parent-Child Interaction Coding System.

g

Linear mixed model. Slopes reflect change in outcome variable per week. Caregiving stress measured via Family Impact Questionnaire.

Figure 2. Changes in Child Externalizing Problems Across Conditions.

Figure 2.

The solid lines represent the growth curve or slope of the change in the Child Behavior Checklist (CBCL) in each group. iPCIT indicates internet-delivered parent-child interaction therapy; RAU, referrals as usual.

Observed child compliance with caregiver commands during the cleanup task also had a significant interaction term (between-conditions postintervention odds ratio [OR], 0.93; 95% CI, 0.51-1.71; 6-month OR, 1.01; 95% CI, 0.57-1.80; 12-month follow-up OR, 1.11; 95% CI, 0.64-1.91). Specifically, the rate of child compliance roughly doubled by 12-month follow-up among children in the iPCIT-treated group but only increased by approximately one-third for children in the RAU group.

Caregiving Outcomes

Table 2 also presents model-implied means and details of regression models predicting changes in caregiving outcomes. Observed do and don’t skills during a structured child-led play task had significant condition-by-time interaction terms, with steeper increases in proportion of observed positive parenting skills (postintervention OR, 1.10; 95% CI, 0.53-2.21; 6-month OR, 1.31; 95% CI, 0.61-2.55; 12-month OR, 1.64; 95% CI, 0.70-3.07) and sharper decreases in proportion of observed controlling/critical behaviors (postintervention OR, 1.40; 95% CI, 0.61-1.52; 6-month OR, 1.72; 95% CI, 0.58-1.46; 12-month OR, 2.23; 95% CI, 0.53-1.37). These results indicated that the conditions had different effects on caregiving behaviors across time. Caregiver do skills significantly increased and don’t skills significantly decreased over time among iPCIT caregivers, with the opposite pattern for RAU caregivers (Figure 3).

Figure 3. Changes in Observed Proportion of Do and Don’t Skills Across Conditions.

Figure 3.

The top set of lines are the proportion of don't skills, and the bottom set of lines are the proportion of do skills. These are also growth curves of these measures for both groups. iPCIT indicates internet-delivered parent-child interaction therapy; RAU, referrals as usual.

Caregiver-reported use of harsh and inconsistent discipline also had a significant condition-by-time interaction term. Specifically, harsh and inconsistent discipline significantly decreased across conditions but decreased more steeply among iPCIT families (between-conditions postintervention Cohen d = 0.24; 6-month follow-up Cohen d = 0.26; 12-month follow-up Cohen d = 0.27). Caregiving stress decreased in both conditions and showed no significant condition-by-time interaction.

Discussion

Considerable barriers interfere with accessibility of clinic-based care for families of young children with DD and behavioral challenges. This study offers the first RCT, to our knowledge, that examined a telehealth-delivered parenting intervention for children with DD and found that iPCIT significantly outperformed usual referrals in reducing child behavior problems. Between-group effect sizes based on both caregiver report and structured observations were mostly in the moderate range and maintained across time. Findings are consistent with previous studies examining clinic-based PCIT for children with DD11,12,16,17,18,19 and telehealth strategies for typically developing youth.32 Moreover, iPCIT-treated children not only showed reductions in behavior problems, such as aggression, but demonstrated higher rates of following directions, which is especially important for children entering kindergarten.55

It is encouraging that caregiver behaviors improved after iPCIT, as such behaviors are associated with the development of adaptive emotion regulation in children with DD,56,57 which, in turn, predicts subsequent social skills.58 It is also promising that iPCIT was able to reduce harsh and inconsistent discipline in this population, as such discipline predicted decreases in surface area and cortical thinning of brain regions involved with sensorimotor and social functioning59 and in regions implicated in DD.60 However, iPCIT did not outperform RAU in reducing caregiving stress. This result is not completely surprising given mixed findings on the impact of parenting interventions on stress in caregivers of children with DD.11,12,17 It is worth noting that, unlike these previous studies, most families in this sample were from ethnic/racial minoritized and/or immigrant backgrounds. Given that acculturation and enculturation can differentially worsen or buffer stress in minoritized caregivers of children with DD,7 it may be important to consider how parenting interventions can incorporate cultural factors into care.61,62

The present findings have important clinical implications. The study adds to a small but growing literature supporting the effects of telehealth approaches to children’s mental health care.32,63 Telehealth strategies can overcome geographic disparities in care availability, logistical obstacles (eg, transportation, parking), and stigma-related concerns about visiting a mental health facility. Telehealth strategies can even improve the ecological validity of care by treating families in natural settings where problems occur most.64 Integration of iPCIT into existing systems of care, such as EI, may have broad public health impact. For example, there are notable gaps in the transition from Part C to Part B services, especially among children living in poverty and from underserved ethnic/racial minoritized backgrounds.26 When children with DD complete Part C services, iPCIT can provide a critical resource as children enter the school system.

Limitations

Several limitations in this study warrant comment. First, the present analysis focused on primary and secondary outcomes, and examination of other factors was beyond the scope of this report. Second, RAU reflected standard care for families exiting EI, but future comparison of iPCIT with an active control group (eg, clinic-based PCIT) would help clarify the differential impact of clinic-based vs telehealth delivery, control for potential dosage effects, and examine whether quantity and/or quality of services received impacts outcome. Third, although three-quarters of iPCIT-treated children reached normative levels of behavioral problems by posttreatment, by 1-year follow-up, these clinically significant gains were not better than the clinically significant gains in RAU children, suggesting that effects may wane over time. Fourth, future research should follow iPCIT effects beyond 1 year, as children with DD enter elementary school. Fifth, equipment was provided to families, therefore, differences in treatment response could not be attributed to differences in household technology. Some families may not own the needed equipment (eg, tablet), which reduces study generalizability. Accelerating growth in household internet connectivity is encouraging, but home-based telehealth may not be feasible for some resource-insecure households. Sixth, the study was a single-site study in 1 metropolitan area, and a relatively high number of participating caregivers completed college, thus limiting study generalizability.

Conclusions

Despite limitations, this was the first RCT, to our knowledge, to demonstrate positive effects of a telehealth-delivered parenting intervention for children with DD. The sample included mostly economically disadvantaged and ethnic/racial minoritized families, for whom DD and behavior problems are prevalent and treatment resistant23 and are underserved by clinic-based care. Overall, findings underscore the value of leveraging technological innovations to overcome barriers to effective care for underserved families of young children with DD.

Supplement 1.

Trial Protocol

Supplement 2.

Data Sharing Statement

References

  • 1.Rosenberg SA, Zhang D, Robinson CC. Prevalence of developmental delays and participation in early intervention services for young children. Pediatrics. 2008;121(6):e1503-e1509. doi: 10.1542/peds.2007-1680 [DOI] [PubMed] [Google Scholar]
  • 2.Baker BL, Neece CL, Fenning RM, Crnic KA, Blacher J. Mental disorders in 5-year-old children with or without developmental delay: focus on ADHD. J Clin Child Adolesc Psychol. 2010;39(4):492-505. doi: 10.1080/15374416.2010.486321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Baker BL, Blacher J, Crnic KA, Edelbrock C. Behavior problems and parenting stress in families of three-year-old children with and without developmental delays. Am J Ment Retard. 2002;107(6):433-444. doi: [DOI] [PubMed] [Google Scholar]
  • 4.Shevell M, Majnemer A, Platt RW, Webster R, Birnbaum R. Developmental and functional outcomes at school age of preschool children with global developmental delay. J Child Neurol. 2005;20(8):648-653. doi: 10.1177/08830738050200080301 [DOI] [PubMed] [Google Scholar]
  • 5.Strydom A, Romeo R, Perez-Achiaga N, et al. Service use and cost of mental disorder in older adults with intellectual disability. Br J Psychiatry. 2010;196(2):133-138. doi: 10.1192/bjp.bp.108.060939 [DOI] [PubMed] [Google Scholar]
  • 6.Barroso NE, Mendez L, Graziano PA, Bagner DM. Parenting stress through the lens of different clinical groups: a systematic review & meta-analysis. J Abnorm Child Psychol. 2018;46(3):449-461. doi: 10.1007/s10802-017-0313-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Conroy K, Frech N, Sanchez AL, Hagan MB, Bagner DM, Comer JS. Caregiver stress and cultural identity in families of preschoolers with developmental delay and behavioral problems. Infant Ment Health J. 2021;42(4):573-585. doi: 10.1002/imhj.21923 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Bailey DB Jr, Hebbeler K, Scarborough A, Spiker D, Mallik S. First experiences with early intervention: a national perspective. Pediatrics. 2004;113(4):887-896. doi: 10.1542/peds.113.4.887 [DOI] [PubMed] [Google Scholar]
  • 9.Herring S, Gray K, Taffe J, Tonge B, Sweeney D, Einfeld S. Behaviour and emotional problems in toddlers with pervasive developmental disorders and developmental delay: associations with parental mental health and family functioning. J Intellect Disabil Res. 2006;50(Pt 12):874-882. doi: 10.1111/j.1365-2788.2006.00904.x [DOI] [PubMed] [Google Scholar]
  • 10.Bailey DB Jr, Hebbeler K, Spiker D, Scarborough A, Mallik S, Nelson L. Thirty-six-month outcomes for families of children who have disabilities and participated in early intervention. Pediatrics. 2005;116(6):1346-1352. doi: 10.1542/peds.2004-1239 [DOI] [PubMed] [Google Scholar]
  • 11.Bagner DM, Eyberg SM. Parent-child interaction therapy for disruptive behavior in children with mental retardation: a randomized controlled trial. J Clin Child Adolesc Psychol. 2007;36(3):418-429. doi: 10.1080/15374410701448448 [DOI] [PubMed] [Google Scholar]
  • 12.Bagner DM, Sheinkopf SJ, Vohr BR, Lester BM. Parenting intervention for externalizing behavior problems in children born premature: an initial examination. J Dev Behav Pediatr. 2010;31(3):209-216. doi: 10.1097/DBP.0b013e3181d5a294 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.McIntyre LL. Parent training for young children with developmental disabilities: randomized controlled trial. Am J Ment Retard. 2008;113(5):356-368. doi: 10.1352/2008.113:356-368 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Roberts C, Mazzucchelli T, Studman L, Sanders MR. Behavioral family intervention for children with developmental disabilities and behavioral problems. J Clin Child Adolesc Psychol. 2006;35(2):180-193. doi: 10.1207/s15374424jccp3502_2 [DOI] [PubMed] [Google Scholar]
  • 15.Zisser A, Eyberg S. Treating oppositional behavior in children using parent-child interaction therapy. In: Kazdin AE, Weisz JR, eds. Evidence-Based Psychotherapies for Children and Adolescents. Guilford Press; 2010:179-193. [Google Scholar]
  • 16.Lesack R, Bearss K, Celano M, Sharp WG. Parent-child interaction therapy and autism spectrum disorder: adaptations with a child with severe developmental delays. Clin Pract Pediatr Psychol. 2014;2(1):68-82. doi: 10.1037/cpp0000047 [DOI] [Google Scholar]
  • 17.Solomon M, Ono M, Timmer S, Goodlin-Jones B. The effectiveness of parent-child interaction therapy for families of children on the autism spectrum. J Autism Dev Disord. 2008;38(9):1767-1776. doi: 10.1007/s10803-008-0567-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Agazzi H, Tan R, Tan SY. A case study of parent-child interaction therapy for the treatment of autism spectrum disorder. Clin Case Stud. 2013;12(6):428-442. doi: 10.1177/1534650113500067 [DOI] [Google Scholar]
  • 19.Hatamzadeh A, Pouretemad H, Hassanabadi H. The effectiveness of parent-child interaction therapy for children with high functioning autism. Procedia Soc Behav Sci. 2010;5:994-997. doi: 10.1016/j.sbspro.2010.07.224 [DOI] [Google Scholar]
  • 20.Owens PL, Hoagwood K, Horwitz SM, et al. Barriers to children’s mental health services. J Am Acad Child Adolesc Psychiatry. 2002;41(6):731-738. doi: 10.1097/00004583-200206000-00013 [DOI] [PubMed] [Google Scholar]
  • 21.St Amant HG, Schrager SM, Peña-Ricardo C, Williams ME, Vanderbilt DL. Language barriers impact access to services for children with autism spectrum disorders. J Autism Dev Disord. 2018;48(2):333-340. doi: 10.1007/s10803-017-3330-y [DOI] [PubMed] [Google Scholar]
  • 22.Flaum M. Telemental health as a solution to the widening gap between supply and demand for mental health services. In: Myers K, Turvey C, eds. Telemental Health: Clinical, Technical, and Administrative Foundations for Evidence-Based Practice. Elsevier; 2012:11-25. [Google Scholar]
  • 23.Bagner DM, Graziano PA. Barriers to success in parent training for young children with developmental delay: the role of cumulative risk. Behav Modif. 2013;37(3):356-377. doi: 10.1177/0145445512465307 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Kim C, Disare K, Pfeiffer M, Kerker BD, McVeigh KH. Effects of individual and neighborhood characteristics on the timeliness of provider designation for early intervention services in New York City. J Dev Behav Pediatr. 2009;30(1):38-49. doi: 10.1097/DBP.0b013e318196b0f0 [DOI] [PubMed] [Google Scholar]
  • 25.Fox L, Dunlap G, Cushing L. Early intervention, positive behavior support, and transition to school. J Emot Behav Disord. 2002;10(3):149-157. doi: 10.1177/10634266020100030301 [DOI] [Google Scholar]
  • 26.Hebbeler K, Spiker D, Kahn L. Individuals With Disabilities Education Act’s early childhood programs: powerful vision and pesky details. Top Early Child Spec Educ. 2012;31(4):199-207. doi: 10.1177/0271121411429077 [DOI] [Google Scholar]
  • 27.Comer JS, Barlow DH. The occasional case against broad dissemination and implementation: retaining a role for specialty care in the delivery of psychological treatments. Am Psychol. 2014;69(1):1-18. doi: 10.1037/a0033582 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Golberstein E, Wen H, Miller BF. Coronavirus disease 2019 (COVID-19) and mental health for children and adolescents. JAMA Pediatr. 2020;174(9):819-820. doi: 10.1001/jamapediatrics.2020.1456 [DOI] [PubMed] [Google Scholar]
  • 29.Comer JS. Rebooting mental health care delivery for the COVID-19 pandemic (and beyond): guiding cautions as telehealth enters the clinical mainstream. Cogn Behav Pract. 2021;28(4):743-748. doi: 10.1016/j.cbpra.2021.09.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Gurwitch RH, Salem H, Nelson MM, Comer JS. Leveraging parent-child interaction therapy and telehealth capacities to address the unique needs of young children during the COVID-19 public health crisis. Psychol Trauma. 2020;12(S1):S82-S84. doi: 10.1037/tra0000863 [DOI] [PubMed] [Google Scholar]
  • 31.Kaminski JW, Valle LA, Filene JH, Boyle CL. A meta-analytic review of components associated with parent training program effectiveness. J Abnorm Child Psychol. 2008;36(4):567-589. doi: 10.1007/s10802-007-9201-9 [DOI] [PubMed] [Google Scholar]
  • 32.Comer JS, Furr JM, Miguel EM, et al. Remotely delivering real-time parent training to the home: an initial randomized trial of Internet-delivered parent-child interaction therapy (I-PCIT). J Consult Clin Psychol. 2017;85(9):909-917. doi: 10.1037/ccp0000230 [DOI] [PubMed] [Google Scholar]
  • 33.Achenbach TM, Rescorla LA. Manual for the ASEBA Preschool Forms and Profiles. University of Vermont, Research Center for Children, Youth, and Families; 2001. [Google Scholar]
  • 34.Constantino JN, Gruber CP. Social Responsiveness Scale: SRS-2. Western Psychological Services; 2012. [Google Scholar]
  • 35.Wechsler D. Wechsler Abbreviated Scale of Intelligence. Psychological Corporation; 1999, doi: 10.1037/t15170-000. [DOI] [Google Scholar]
  • 36.Pons JI, Flores-Pabón L, Matías-Carrelo L, et al. Confiabilidad de la Escala de Inteligencia Wechsler para Adultos Versión III, Puerto Rico (EIWA-III). Rev Puertorriq Psicol. 2008;19:112-132. [Google Scholar]
  • 37.Shaw DS, Dishion TJ, Supplee L, Gardner F, Arnds K. Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the family check-up in early childhood. J Consult Clin Psychol. 2006;74(1):1-9. doi: 10.1037/0022-006X.74.1.1 [DOI] [PubMed] [Google Scholar]
  • 38.McCabe K, Yeh M, Lau A, Argote CB. Parent-child interaction therapy for Mexican Americans: results of a pilot randomized clinical trial at follow-up. Behav Ther. 2012;43(3):606-618. doi: 10.1016/j.beth.2011.11.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Gelinas L, Largent EA, Cohen IG, Kornetsky S, Bierer BE, Fernandez Lynch H. A framework for ethical payment to research participants. N Engl J Med. 2018;378(8):766-771. doi: 10.1056/NEJMsb1710591 [DOI] [PubMed] [Google Scholar]
  • 40.Shelleby EC, Shaw DS, Dishion TJ, Wilson MN, Gardner F. Effects of the Family Check-Up on reducing growth in conduct problems from toddlerhood through school age: An analysis of moderated mediation. J Consult Clin Psychol. 2018;86(10):856-867. doi: 10.1037/ccp0000337 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Eyberg SM, Nelson MM, Ginn NC, Bhuiyan N, Boggs SR. Dyadic Parent-Child Interaction Coding System (DPICS) Comprehensive Manual for Research and Training. 4th ed. University of Florida; 2013. [Google Scholar]
  • 42.Webster-Stratton C, Reid MJ, Hammond M. Preventing conduct problems, promoting social competence: a parent and teacher training partnership in head start. J Clin Child Psychol. 2001;30(3):283-302. doi: 10.1207/S15374424JCCP3003_2 [DOI] [PubMed] [Google Scholar]
  • 43.Donenberg G, Baker BL. The impact of young children with externalizing behaviors on their families. J Abnorm Child Psychol. 1993;21(2):179-198. doi: 10.1007/BF00911315 [DOI] [PubMed] [Google Scholar]
  • 44.Baker BL, McIntyre LL, Blacher J, Crnic K, Edelbrock C, Low C. Preschool children with and without developmental delay: behaviour problems and parenting stress over time. J Intellect Disabil Res. 2003;47(Pt 4-5):217-230. doi: 10.1046/j.1365-2788.2003.00484.x [DOI] [PubMed] [Google Scholar]
  • 45.Eyberg S. Consumer satisfaction measures for assessing parent training programs. In: VandeCreek L, Knapp S, Jackson TL, eds. Innovations in Clinical Practice: A Source Book. Professional Resource Press; 1993:377-382. [Google Scholar]
  • 46.Nguyen TD, Attkisson CC, Stegner BL. Assessment of patient satisfaction: development and refinement of a service evaluation questionnaire. Eval Program Plann. 1983;6(3-4):299-313. doi: 10.1016/0149-7189(83)90010-1 [DOI] [PubMed] [Google Scholar]
  • 47.Brestan EV, Jacobs JR, Rayfield AD, Eyberg SM. A consumer satisfaction measure for parent-child treatments and its relation to measures of child behavior change. Behav Ther. 1999;30(1):17-30. doi: 10.1016/S0005-7894(99)80043-4 [DOI] [Google Scholar]
  • 48.Byalin K. Assessing parental satisfaction with children’s mental health services: a pilot study. Eval Program Plann. 1993;16(2):69-72. doi: 10.1016/0149-7189(93)90018-4 [DOI] [Google Scholar]
  • 49.Hedeker D, Gibbons RD. Longitudinal Data Analysis. John Wiley & Sons; 2006, doi: 10.1002/0470036486. [DOI] [Google Scholar]
  • 50.Usami S, Murayama K. Time-specific errors in growth curve modeling: type-1 error inflation and a possible solution with mixed-effects models. Multivariate Behav Res. 2018;53(6):876-897. doi: 10.1080/00273171.2018.1504273 [DOI] [PubMed] [Google Scholar]
  • 51.Cohen J, Cohen P, West SG, Aiken LS. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences . Psychology Press; 2013. [Google Scholar]
  • 52.Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods. 2002;7(2):147-177. doi: 10.1037/1082-989X.7.2.147 [DOI] [PubMed] [Google Scholar]
  • 53.United States Department of Health and Human Services . Poverty guidelines computations. Accessed February 28, 2022. https://aspe.hhs.gov/topics/poverty-economic-mobility/poverty-guidelines/prior-hhs-poverty-guidelines-federal-register-references/2017-poverty-guidelines/2017-poverty-guidelines-computations
  • 54.Newborg J. Battelle Developmental Inventory. 2nd ed. Riverside Publishing; 2005. [Google Scholar]
  • 55.Welchons LW, McIntyre LL. The transition to kindergarten: predicting socio-behavioral outcomes for children with and without disabilities. Early Child Educ J. 2017;45(1):83-93. doi: 10.1007/s10643-015-0757-7 [DOI] [Google Scholar]
  • 56.Norona AN, Baker BL. The transactional relationship between parenting and emotion regulation in children with or without developmental delays. Res Dev Disabil. 2014;35(12):3209-3216. doi: 10.1016/j.ridd.2014.07.048 [DOI] [PubMed] [Google Scholar]
  • 57.Norona AN, Baker BL. The effects of early positive parenting and developmental delay status on child emotion dysregulation. J Intellect Disabil Res. 2017;61(2):130-143. doi: 10.1111/jir.12287 [DOI] [PubMed] [Google Scholar]
  • 58.Baker JK, Fenning RM, Crnic KA, Baker BL, Blacher J. Prediction of social skills in 6-year-old children with and without developmental delays: contributions of early regulation and maternal scaffolding. Am J Ment Retard. 2007;112(5):375-391. doi: 10.1352/0895-8017(2007)112[0375:POSSIY]2.0.CO;2 [DOI] [PubMed] [Google Scholar]
  • 59.Whittle S, Pozzi E, Rakesh D, et al. Harsh and inconsistent parental discipline is associated with altered cortical development in children. Biol Psychiatry Cogn Neurosci Neuroimaging. 2022;7(10):989-997. doi: 10.1016/j.bpsc.2022.02.001 [DOI] [PubMed] [Google Scholar]
  • 60.Levy Y. ‘Developmental delay’ reconsidered: the critical role of age-dependent, co-variant development. Front Psychol. 2018;9:503. doi: 10.3389/fpsyg.2018.00503 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Sanchez AL, Comer JS, LaRoche M. Enhancing the responsiveness of family-based CBT through culturally informed case conceptualization and treatment planning. Cognit Behav Pract. 2021;29(4):750-770. doi: 10.1016/j.cbpra.2021.04.003 [DOI] [Google Scholar]
  • 62.Sanchez AL, Jent J, Aggarwal NK, et al. Person-centered cultural assessment can improve child mental health service engagement and outcomes. J Clin Child Adolesc Psychol. 2022;51(1):1-22. doi: 10.1080/15374416.2021.1981340 [DOI] [PubMed] [Google Scholar]
  • 63.Comer JS, Furr JM, Del Busto C, et al. Therapist-led, internet-delivered treatment for early child social anxiety: a waitlist-controlled evaluation of the iCALM telehealth program. Behav Ther. 2021;52(5):1171-1187. doi: 10.1016/j.beth.2021.01.004 [DOI] [PubMed] [Google Scholar]
  • 64.Comer JS, Timmons AC. The other side of the coin: computer-mediated interactions may afford opportunities for enhanced empathy in clinical practice. Clin Psychol. 2019;26(4):e12308. doi: 10.1111/cpsp.12308 [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement 1.

Trial Protocol

Supplement 2.

Data Sharing Statement


Articles from JAMA Pediatrics are provided here courtesy of American Medical Association

RESOURCES