Skip to main content
NCBI home page
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2015 Jul 1.
Published in final edited form as: Res Autism Spectr Disord. 2014 Jul 1;8(7):899–907. doi: 10.1016/j.rasd.2014.03.013

A Multisite Trial of Atomoxetine and Parent Training in Children with Autism Spectrum Disorders: Rationale and Design Challenges

Laura Silverman a, Jill A Hollway b, Tristram Smith a, Michael G Aman b, L Eugene Arnold b, Xueliang Pan d, Xiaobai Li d, Benjamin L Handen c
PMCID: PMC4153991  NIHMSID: NIHMS595022  PMID: 25197320

1. OVERVIEW

Children with autism spectrum disorder (ASD) often have co-occurring behavior problems such as inattention, hyperactivity, irritability, anxiety and noncompliance (Lecavalier, 2006). Behavioral interventions, based on the principles of applied behavior analysis, can reduce these problems and increase adaptive skills (Howard, Ladew & Pollack, 2009; Smith, 2011). Certain medications are also effective for decreasing such problems (Hollander & Anagnostou, 2007). However, the available evidence provides little guidance on whether to select a behavioral intervention, medication, or both for an individual child with ASD.

To inform clinical decision-making, investigators have increasingly sought to examine the comparative and combined effects of psychosocial and psychopharmacological treatment in childhood mental health disorders. For example, the Multimodal Treatment Study of ADHD (MTA) compared stimulants (mostly methylphenidate), behavioral interventions, and their combination, in typically developing children with attention-deficit/hyperactivity disorder (ADHD) (The MTA Cooperative Group, 1999). Among children with ASD, the largest randomized clinical trial (RCT) of combined psychosocial and pharmacological treatments was conducted by the Research Units on Pediatric Psychopharmacology-Psychosocial Intervention (RUPP-PI) Autism Network. This RCT examined the effects of adding parent training (PT) in behavior management principles to risperidone to treat irritability and noncompliance in 124 children with ASD (Aman et al., 2009). This study showed that parent training augmented the therapeutic effects of medication alone. However, the investigators noted some methodological limitations, including (a) a medication-induced ceiling effect (the powerful effect of risperidone left little room for improvement for PT on behavioral outcomes), (b) no placebo control, and (c) no PT-alone condition (Aman et al., 2009, 2010). In the current investigation, the Children with Hyperactivity and Autism Research Treatment Study (CHARTS), we sought to refine the methods used in the RUPP-PI study and extend them to the treatment of ADHD symptoms in children with ASD.

A comparative effectiveness trial of two active treatments requires a more complex design than a trial comparing a single treatment to placebo. The purpose of this manuscript is to highlight some of the challenges that arose in conducting our trial in children with ASD and to explain how we addressed these difficulties. The challenges are divided into four categories: (a) overarching study design, (b) blinding, (c) measurement of treatment outcomes, and (d) data analytic plan.

2. STUDY DESIGN AND DESCRIPTION

Three sites were funded by the National Institute of Mental Health to conduct this five-year trial: the University of Pittsburgh Medical Center, the Ohio State University’s Nisonger Center and the University of Rochester Medical Center. The trial included two phases. Phase 1 was a 10-week, randomized, double-blind, placebo-controlled, 2 × 2 trial of atomoxetine (ATX) and parent training (PT). Treatment goals were to decrease hyperactivity and inattentiveness and to increase compliance in 128 children ages 5 through 13 years with ASD and ADHD symptoms. Participants were randomized to one of four possible treatment options: (a) PT and ATX, (b) PT and placebo, (c) ATX alone (no PT), or (d) placebo alone. Phase 2 of the study consisted of a 24-week extension period, explained below. During the acute trial (Phase 1), medication was titrated for the first six weeks, based on response and side effects, to a possible ceiling dose of 1.8 mg/kg/day and stabilized for the next four weeks. At the conclusion of the acute phase, subjects were classified as either responders or nonresponders. A responder was defined as: (a) a subject who showed a reduction of 30% or more in parent ratings for symptoms of ADHD, noncompliance, or both; and (b) a blinded clinician rating of much or very much improved (“1” or “2”) on the Clinical Global Impression – Improvement (CGI-I) scale for ADHD, noncompliance, or both. All other subjects were considered nonresponders.

In Phase 2, responders continued their treatment without breaking the medication blind while nonresponders had the blind broken. “Placebo nonresponders” were offered 10-weeks of open-label ATX treatment and “ATX nonresponders” were treated clinically with the best available medication options for the next 24 weeks. This was done in order for those randomized to PT to obtain all planned PT treatment sessions. Figure 1 shows the study flow chart for responders and nonresponders.

Figure 1.

Figure 1

Open in a new tab

Study flow chart. Note: ATX = Atomoxetine (Strattera); PT= Parent Management Training (in behavior intervention); ASD = Autism Spectrum Disorders. Study 1 is a 10-Week, double-blind, placebo-controlled comparison of effects of (a) ATX (ATX/No PT), (b) PBO (PBO/No PT, (c) ATX + PT, (d) PBO + PT.

All study participants underwent a complete assessment to establish diagnosis of autistic disorder, pervasive developmental disorder – not otherwise specified (PDD-NOS), or Asperger’s disorder based upon the Diagnostic and Statistical Manual of Mental Disorders – Fourth Edition (DSM-IV-TR) (American Psychiatric Association, 2000). Also assessed were intelligence level, symptom severity and medical status. Randomization was stratified by site and balanced on two levels of mental age (above and below 6 years). Once randomized, participants were initially assessed at six weekly visits and then every other week until week 10. The Extension phase involved assessments every four weeks over a 24-week period. A blinded clinician rated therapeutic response. The treating physician, who monitored side effects and made dose adjustments, remained blind to treatment assignment unless clinical care required breaking the blind.

The study tested the following hypotheses: (a) participants receiving ATX alone would show greater improvement on ADHD measures over participants receiving placebo; (b) participants receiving PT would score significantly better on measures of compliance than participants not receiving PT; (c) participants receiving the combination of ATX and PT would show an additive effect and score significantly better on all outcome measures than participants in the other three groups; and (d) participants receiving ATX would experience minor and tolerable elevations in certain adverse events when compared with the placebo group. Table 1 illustrates the rationale and design decisions made when planning this study.

Table 1.

CHARTS Design Decisions and Rationale

Design Decisions Rationale
Study Design Decisions (see section 3)
Use of four treatment arms
(ATX alone, ATX + PT; PBO alone, PBO +
PT)		 PT only group important to establish PT
efficacy: Placebo group important to establish
ATX efficacy
Selection of 10-week randomized, double-
blind, placebo-controlled study		 Ensure sufficient time for positive effects of
ATX
Selection of 24-Week Extension Ensure sufficient time for positive effects of
PT
Blinded Raters: Therapeutic effects blind to
side effects		 To minimize treatment bias
Selection of Treatment Options (see section 4)
Use of atomoxetine (Straterra) New FDA indication for ADHD
Use of manualized Parent Training: Clinician
Fidelity		 To decrease noncompliance and increase
adaptive skills
Use of alternative medication treatments after
the failure of ATX		 Prevent attrition in the 24-week extension
Selection of Two Study Primary Study Outcomes (see section 5)
ADHD and Noncompliance Measuresa Evaluate improved ADHD symptoms with
medication. Evaluate increased compliance
and adaptive behavior with Parent Training
Data Analytic Plan (see section 6)
Two Outcome Domains
Multiple Informants		 Hochsberg’s Procedure
Model considered the associations of different
measures for the same individual
Different Time Points to Optimal Effects Primary analyses for ATX at Week 10;
Primary analyses for PT at Week 22
Open in a new tab
a

Parent and Teacher SNAP IV, Home and School Situations Questionnaires, Parent and Teacher SER , Standard Observation Analogue Procedure (SOAP), CGI-S and CGI-I for both ADHD symptoms and noncompliance.

3. DESIGN CHALLENGES AND RATIONALE

The following section presents the design challenges we were confronted with when planning this RCT. We also highlight the methodological decisions that were ultimately made and the rationale behind them.

3.1 Four Treatment Conditions

One limitation of the RUPP-PI study was that it compared just two treatment conditions (i.e., medication and combined treatment) without a PT-only condition or a placebo condition (Aman, et al., 2009: van Haaren, 2009). We concluded that a PT-only group would enable us to evaluate the efficacy of PT as a stand-alone treatment for increasing compliant behavior. Likewise, a placebo-only group would enable us to evaluate the efficacy of ATX. Consequently, we included four treatment arms (ATX alone, PT alone, both interventions together, and a placebo condition), using a 2 × 2 factorial design.

3.2 Acute Trial

Once the overall design of the study was agreed upon, team members had to determine the appropriate length of the acute trial (Phase 1 of the study). This phase needed to be long enough to assess ATX efficacy adequately, but short enough that families of children who were on placebo or nonresponsive to active medication would be willing to maintain their children in the study. To limit side effects and allow for possibly greater sensitivity among children with ASD, a slow dose titration was planned (starting at 0.3 mg/kg vs. the 0.5 mg/kg recommended by the ATX package insert). In addition, if side effects were reported, adequate time was required to lower the ATX dose and then to “re-challenge” the child at the higher dose. Therefore, six weeks were allotted for dose titration, followed by four weeks at a steady dose. This was slightly longer than the eight-week trials typically conducted by researchers working with neurotypical children with ADHD (e.g., Michaelson et al., 2001; Newcorn et al., 2005).

3.3 Twenty-Four Week Extension

Another issue related to trial length involved the time required to observe positive effects of PT. In the RUPP-PI study (Aman et al., 2009), the impact of PT was not evident until 20 weeks of treatment. However, the target symptoms were different (severe irritability rather than noncompliance). In addition, risperidone had a more immediate and significant impact on behavior than we expected ATX to have. We did not predict near-universal reduction of behavioral symptoms with the use of ATX. Therefore, we anticipated that the effect of PT in CHARTS might exceed the effect seen in RUPP-PI. Nevertheless, based on RUPP-PI findings, we conservatively estimated that effects of PT might not be observable until after 10 weeks, with even greater impact during a 24-week follow-up phase (Phase 2 of the study).

Because of the possibility that behavioral effects of parent training might become apparent more slowly than medication effects, we decided to retain all participants (not just responders) until at least Week 10 of the Extension (i.e., after an exposure of 20 weeks of PT). Were we to retain responders alone, there was a strong chance that the number of control subjects (i.e., those receiving neither PT nor ATX) would be too low to enable a well-powered statistical comparison to take place. Additionally, such a control group might also be unrepresentative.

3.4 Establishing and Maintaining Blindness to Treatment Assignment

In order to maintain the blind during the study, ATX and visually identical placebo were dispensed. Staff members who dispensed the medication at each site were not involved in other study procedures. In addition, independence was maintained between researchers serving as prescribers, who might be tipped off by side effects, and those serving as blinded raters (independent evaluators who assessed behaviors at baseline and during subsequent study visits). Thus, the pharmacological intervention was delivered in a double-blind, placebo-controlled design, which deliberately isolated blinded raters from any knowledge of adverse events (AEs).

As for the psychosocial intervention, we were unable to maintain the double-blind since both participants and therapists were aware of treatment assignment. However, we were able to maintain the blind with the independent evaluators, through the management of communication among study personnel, families and blinded raters. PT therapists were not permitted to discuss their patients with other study personnel or to share information about scheduling, lest they disclose treatment assignment. In addition, PT therapists saw study parents in a different physical space than other research personnel. This was done so that independent evaluators would not inadvertently encounter study patients or see them with PT clinicians. Parents were instructed not to discuss PT-related content with blinded staff. Likewise, parents were also warned to avoid language or terminology included in the PT intervention when talking to other study personnel. Finally, PT therapists held conference calls that were separate from the rest of the leadership group. This allowed clinical issues to be discussed without unblinding researchers responsible for medication management or assessment of behavioral outcomes.

4. SELECTION OF TREATMENT OPTIONS

4.1 Psychopharmacological Intervention: Atomoxetine (Strattera)

Psychostimulants are the first line of treatment for ADHD symptoms in typically developing children (Arnold, 2000). RCT’s have shown that these medications also improve ADHD symptoms in some children with ASD, but have much lower response rates and much higher rates of AEs than reported in typically developing children (Aman, 1996; Handen et al., 2000; Quintana et al., 1995; RUPP Autism Network, 2005). Early studies examining stimulants in ASD reported AEs, including paradoxical overactivity and stereotypic behavior (Schmidt, 1982); fearfulness, separation anxiety, rapid pulse and increased hyperactivity (Realmuto et al., 1989); delusional ideas and fragmented thinking (Sporn & Pinkser, 1981); and agitation, stereotypies, aggression, and motor and phonic tics (Volkmar, Hoder, & Cohen, 1985). Although these side effects were seen in only five patients, this reflects approximately 14% of study enrollment. The RUPP Autism Network reported intolerable AEs in response to methylphenidate in 18% of their sample, with the most significant effect being irritability. Similarly, in a double-blind, placebo-controlled crossover study, significant side effects of methylphenidate included increased levels of social irritability, withdrawal, crying, tantrums and skin picking, especially at a higher doses (0.6 mg/kg; Handen et al., 2000). Alpha2-adrenergic receptor agonists, such as clonidine and guanfacine have also been tested in ASD, as alternatives to stimulants, for children who either show little response or significant side effects. RCTs using these medications documented drowsiness, decreased activity and irritability (Handen, Sahl & Harden, 2008; Jaselskis, Cook, Fletcher, & Leventhal, 1992).

Endeavoring to achieve a more favorable treatment profile, we decided to investigate the efficacy of ATX, a non-stimulant medication. At that time, a literature search revealed only limited data regarding the safety and efficacy of ATX’s use in ASD. We found only four relevant reports, of which three were open label and one was a small, double-blind study. In general, the effects of atomoxetine on the symptoms of ADHD in children with ASD appeared to be positive. The small placebo-controlled, cross-over trial of ATX noted fewer intolerable side effects than generally seen in response to stimulant medication (Arnold et al., 2006). The most common AEs were mild upper gastrointestinal symptoms, including upset stomach and/or nausea and vomiting. More recently, we conducted another review of the literature in subjects with developmental disabilities, which reinforced our original conclusions (Aman, et al., in review). Several studies showed that ATX also had a number of additional practical advantages over stimulants.

The primary human subjects concern was that atomoxetine has a “black box” warning because, in rare instances, it may be associated with an increased risk of suicidality. Because children with ASD have impairments in social communication, suicidality is particularly difficult to assess for them. We implemented a number of safeguards to address this concern. First, study teams at all sites included both child psychiatrists and clinical psychologists to ensure that experts on suicidality were available if needed. Second, in our screening evaluation, we conducted a mental health assessment that included a parent-completed symptom checklist and interviews with the parent and child; we excluded children with past or current bipolar disorder, major depression, or suicidality. In addition, we highlighted mood swings and agitation on the side-effect review forms collected at each visit during the double-blind and extension phases, and we followed up with families if these were reported by either the parent or the teacher. Independent evaluators also met with parents at each visit and asked them to rate the severity of their child’s mood swings, agitation, self-injury, anxiety and depression on a scale from 1 to 10, with additional follow-up if parents reported an increase in any of these behaviors. Finally, our independent Data and Safety Monitoring Board included a patient advocate to assess side-effects from the perspective of a family member and two psychiatrists to advise us on safety issues.

4.2 Psychosocial Intervention: Manualized Parent Management Training

The CHARTS manual was designed for use with a broad range of children with ASD, including children who were high functioning and verbal, and those who were lower-functioning with limited expressive language. The PT manual that was written for the RUPP-PI study (Aman et al., 2009) was also used in the CHARTS study. The manual was modified slightly, with some minor revisions to the sequence and content of sessions, based on the therapists’ previous clinical experience. We chose this intervention because (a) limited information was available on its impact on ADHD symptoms (especially in children with ASD), and (b) most children with ADHD also displayed noncompliance. PT had been shown to reduce noncompliance in populations other than ASD. However, most studies of PT for noncompliance in ASD had been small-N investigations of unstandardized PT protocols (Bearss et al., 2013).

To monitor clinician fidelity, forms were created for every session, identifying the key teaching points and activities that needed to be implemented by the clinician. Fidelity scores of 80% or above were set as the expectation. All sessions were videotaped and a random subset of videos was sent to an independent clinician at a different site to check self-ratings of fidelity. Cross-site clinician conference calls were held monthly to discuss questions regarding how best to implement interventions.

5. SELECTION OF TWO STUDY OUTCOMES

Typically, a single primary target symptom is selected in RCTs. However, in the current study we chose to focus on two treatments for two target areas: ADHD symptoms and noncompliance. While both ATX and PT were expected to affect both target areas, we hypothesized that ATX would have a greater impact on ADHD symptoms, whereas PT would have greater impact on noncompliance. This is in contrast to other studies of combined psychosocial/psychopharmacological treatment, which have designated a single primary outcome measure (e.g., Abikoff et al. 2004; March et al., 2004; POTS, 2004).

5.1 Parent and Teacher Outcomes

Parent and Teacher Swanson, Nolan, and Pelham, Questionnaire – Fourth Edition (SNAP-IV) (Swanson, 1992)

For comparability with our prior studies and with many studies of ADHD among typically developing children, the SNAP-IV Parent and Teacher Rating Scales were used to measure ADHD at home and school. The SNAP-IV comprises the 18 DSM-IV symptoms of ADHD (nine hyperactive/impulsive items and nine inattention items) on a 0-3 metric scale. A mean item score of >1.5 on the Parent and Teacher SNAP-IV18 ADHD symptoms or the 9-symptom hyperactive-impulsive items, or the 9 symptom inattentive items was used for study inclusion. The SNAP-IV was also used to measure change.

Home and School Situations Questionnaires (HSQ and SSQ) (Altepeter & Breen, 1989; Barkley, Edwards, & Robin, 1994)

The HSQ and SSQ, which were originally designed to assess the severity of noncompliance in typically developing children, were selected to measure noncompliance in CHARTS. The RUPP-PI Autism Network (Aman et al., 2009) adapted the HSQ for measuring noncompliance in ASD by adding five items, yielding a total of 25 items (Chowdhury et al., 2010). The SSQ was used in its original 9-item form.

5.2 Observer-Rated Outcome Measures

Standard Observation Analogue Procedure (SOAP) (Johnson et al. 2009)

While the primary outcome measures were derived from standardized questionnaires, we also conducted direct observations. The SOAP consisted of three conditions: (a) a 3-minute free-play/social attention control condition (demand-free interaction between parent and child), (b) a 10-minute high-demand condition (involving 10 parental requests) and (c) a 3-minute clean up Condition (Handen et al., 1999; Hanley, Iwata, & McCord, 2003; Kennedy et al., 2000; Repp & Horner, 1999). The high-demand condition was intended to simulate typical parent-child interactions, in which multiple requests and restrictions were placed on the child. Sessions were 16 minutes long and used two sets of standardized toys and materials. One set of demands was for higher-functioning participants and another for lower-functioning participants; parents selected items from the demand set that they considered to be representative of home. Details of the procedure can be found in Handen et al. (2013), including procedures for coding mother and child behaviors.

Clinical Global Impressions of ADHD and Noncompliance (Guy, 1976)

These measures provided clinician-rated global ratings of a study participant’s condition prior to and during medication dosing (Busner & Targum, 2007, 2009). We decided to conduct two global assessments, one for ADHD and one for noncompliance. This made achievement of inter-rater reliability more difficult than when there is a single target behavior. As with other outcome ratings, the CGI was completed by a blinded rater insulated from knowledge of AEs and dosing. To develop a common “culture” for rating CGIs, we developed guidelines and scored vignettes for review by blinded clinicians. Finally, we reviewed all subjects’ outcome scores and arrived at consensus CGI scores monthly on Steering Committee calls.

5.3 Child Cognitive Assessments

Cognitive Tests

Subjects were assessed using a computer-controlled battery for cognitive

performance on tasks tapping sustained attention, visual selective attention and inhibition. A paper and pencil cancellation task was also administered to measure sustained attention. The battery was chosen to detect relevant drug effects; however, this may be the first study in which cognitive tests have been used to assess the potential impact of PT on child cognitive performance. Although unintended originally, this could be a unique contribution of this study.

6. STATISTICAL CONSIDERATIONS

6.1 Two Outcome Domains

The first analytic challenge was the dual outcome domain. There were two primary outcome measures: (a) ADHD symptoms rated by parent and teacher using the SNAP-IV (i.e., 18 items), which we planned to use to assess medication efficacy and which involved comparisons of ATX vs. Placebo, and (b) noncompliance rated by parent and teacher on the Home and School Situation Questionnaires (HSQ/SSQ), which we intended to use as a primary outcome for comparison of PT vs. no PT. This posed the problem of multiple tests for related but conceptually independent domains. To resolve this, we proposed to test the two primary hypotheses using Hochberg’s procedure (Hochberg, 1988). If both outcomes were to reveal a p-value of <0.05, both would be considered significant. If one revealed a p-value of <0.025 and the other >0.05, the first would be considered significant. However, if one were to have a p-value of >0.05 and the other >0.025, neither would be considered significant. This risked the possibility that a significant finding between 0.025 and 0.05 on one would be lost because the other was >0.05. We felt that this risk was worth taking to examine both primary outcomes simultaneously by controlling the family-wise error rate.

6.2 Multiple Informants

An additional problem was the multiple informants for the primary analyses. While all parents provided ratings of ADHD symptoms and noncompliance, some teacher data were missing (due to summer vacations, etc.). Rather than attempt to composite the informants prior to analysis, we decided to use the method of O’Brien (1984) and Lechmacher et al. (1991) to combine multiple test statistics into a single hypothesis test. Our intent was to estimate the effect of PT on noncompliance (measured by two primary outcome variables) relative to no PT, with random coefficient mixed models applied to these multivariate longitudinal data (Gao et al., 2006). We planned to standardize each outcome variable into z-scores (based on sample baseline mean and SD) to ensure the same measuring scale (O’Brien, 1984). Each outcome measure, we assumed, would reveal random slopes for different subjects. The model proposed would consider the associations of different measures from the same individual. The same procedure will be used for parent and teacher ratings of ADHD symptoms.

6.3 Different Time Points to Optimal Effects

A third problem was the different times – to optimal effect for the two treatments. We expected ATX to show optimal effect by 10 weeks. However, we knew from the RUPP-PI study (Aman et al, 2009) that PT might not show its full effect until week 20, well after the double-blind ATX-placebo comparison of this study. Therefore, although we had proposed to do a secondary test for PT at 10 weeks (at the end of the 2×2 blinded phase), the primary analysis for noncompliance was intended for analysis at 22 weeks. Another complex issue was that the medical treatment would no longer be strictly controlled by protocol after week 10; alternative medications could be introduced as clinically indicated. Thus, we planned to compare the PT vs. no-PT groups on medication type and dose during the extension (after week 10). We determined that if they did not differ, we could assume that alternative medication and dose variations did not interfere with the noncompliance comparison between PT and no PT. If a medication difference was found, we would examine the pattern of the medication difference (number of drugs, dose), and then could consider the medication profile as covariate(s) for the primary analysis.

7. DISCUSSION

The CHARTS study is similar to previous studies in that it was designed to incorporate both a pharmacological treatment and a psychosocial intervention (Abikoff et al. 2004; Aman et al., 2009; March et al., 2004; POTS, 2004; The MTA Cooperative Group, 1999). However, it contained some unique features designed to address the complexities of treating children with ASD and to reconcile the need for placebo with the need for enough time for PT to show an effect. The study design made maintaining the blind more difficult than in a study of monotherapy. Consequently, we gave special consideration to preserving the independence of study evaluators. Also, the treatments were hypothesized to have complementary effects, with ATX primarily modifying ADHD symptoms and PT primarily modifying noncompliance. Further, because the effects of ATX were expected to emerge more quickly than the effects for PT, our primary analyses for ATX effects were based on data from the Week 10 visit. Conversely, our primary analyses for PT were based on Week 22 data. In order to enhance the generalizability of our findings, our primary outcome measures are composites of parent and teacher ratings. Because we were dealing with multiple informants, we proposed a model that would consider the associations of different measures from the different individuals. We also included secondary measures that consisted of blinded clinician ratings, standardized behavior observations scored by blinded observers and computerized tests of attention. The decision to use dual outcomes and multiple measures made data analyses more difficult as well, and we were obliged to address the problem of multiple tests for related domains. The design of CHARTS may be informative for researchers planning other RCTs.

Highlights.

This paper reviews the rationale for a double-blind, placebo-controlled RCT.

It tests whether ATX and Parent Training is superior to single treatment /placebo.

Challenges include: study design, blindness, outcome measures and data analysis.

Our goal is to assist researchers planning multimodal RCTs for children with ASD.

Acknowledgments

Grant Support: This work was supported by grants from the National Institute of Mental Health to Ohio State University (1R01MH079080-01A2), University of Pittsburgh (5R01MH079082-05), and University of Rochester (R01 MH083247) as well as support from Eli Lilly, who supplied active medication and matching placebo.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Disclosures: Dr. Handen has received research funding from CureMark, Lilly and Roche. Dr. Aman has received research contracts, consulted with, or served on advisory boards of Biomarin Pharmaceuticals, Bristol-Myers Squibb, Confluence Pharmaceutica, Coronado Bioscience, Forest Research, Hoffman LaRoche, Johnson & Johnson, Novartis, Pfizer, and Supernus Pharmaceutica. Dr. Arnold has received research funding from CureMark, Forest, Lilly, and Shire, advisory board honoraria from Biomarin, Novartis, Noven, Otsuka, Roche, Seaside Therapeutics, and Shire, consulting fees from Tris Pharma, and travel support from Noven. Dr. Hollway has received research funding from Forest Research Institute. Drs. Pan, Li, Smith and Silverman have no disclosures.

REFERENCES

  1. Abikoff H, Hechman L, Klien RG, Weiss G, Fleiss K, Etcovich J, Pollack S. Symptomatic improvement in children with ADHD treated with long-term methylphenidate and multimodal psychosocial treatment. Journal of the American Academy of Child and Adolescent Psychiatry. 2004;43:802–811. doi: 10.1097/01.chi.0000128791.10014.ac. [DOI] [PubMed] [Google Scholar]
  2. Altepeter TS, Breen MJ. The Home Situations Questionnaire (HSQ) and the School Situations Questionnaire (SSQ): Normative data and an evaluation of Psychometric Properties. Journal of Psychoeducational Assessment. 1989;7:312–322. [Google Scholar]
  3. Aman MG. Stimulant drugs in the developmental disabilities revisited. Journal of Developmental and Physical Disabilities. 1996;8:347–365. [Google Scholar]
  4. Aman MG, Arnold LE, Lecavalier L, Hollway JA, Mulick JA, McDougle CJ, Scahill L. Risperidone and parent training in pervasive developmental disorders. Authors’ reply. Journal of the American Academy of Child and Adolescent Psychiatry. 2010;49:407–408. doi: 10.1097/00004583-201004000-00015. [DOI] [PubMed] [Google Scholar]
  5. Aman MG, McDougle CJ, Scahill L, Handen B, Arnold LE, Johnson C, Wagner A, the Research Units on Pediatric Psychopharmacology Autism Network Medication and Parent Training in Children with Pervasive Developmental Disorders and Serious Behavior Problems: Results from a Randomized Clinical Trial. Journal of the American Academy of Child and Adolescent Psychiatry. 2009;48:1143–1154. doi: 10.1097/CHI.0b013e3181bfd669. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Aman MG, Smith T, Arnold LE, Corbett-Dick P, Tumuluru R, Hollway J, Handen BL. A review of atomoxetine effects in young people with developmental disabilities. Research in Developmental Disabilities. doi: 10.1016/j.ridd.2014.03.006. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. American Psychiatric Association . Diagnostic and Statistical Manual of Mental Disorders. 4th ed Author; Washington DC: 2000. [Google Scholar]
  8. Arnold LE. Methylphendate versus amphetamine: Comparative review. Journal of Attention Disorders. 2000;3:200–211. [Google Scholar]
  9. Arnold LE, Aman MG, Cook AM, Witwer AN, Hall KL, Thompson S, Ramadan Y. Atomoxetine for hyperactivity in autism spectrum disorders: Placebo-controlled crossover pilot trial. Journal of the American Academy of Child and Adolescent Psychiatry. 2006;45:1196–1205. doi: 10.1097/01.chi.0000231976.28719.2a. [DOI] [PubMed] [Google Scholar]
  10. Barkley RA, Edwards GH, Robin AL. Defiant teens: A clinician’s manual for assessment and intervention. Guildford Press; New York: 1994. [Google Scholar]
  11. Bearss K, Lecavalier L, Minshawi N, Johnson C, Smith T, Handen B, Scahill L. Toward an exportable parent training program for disruptive behaviors in autism spectrum disorders. Neuropsychiatry. 2013;3:170–180. doi: 10.2217/npy.13.14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Busner J, Targum SD. The Clinical Global Impressions Scale: Applying a research tool in clinical practice. Psychiatry. 2007;4:28–37. [PMC free article] [PubMed] [Google Scholar]
  13. Busner T, Targum SD, Miller DS. The Clinical Global Impressions scale: Errors in understanding and use. Comprehensive Psychiatry. 2009;50:257–262. doi: 10.1016/j.comppsych.2008.08.005. [DOI] [PubMed] [Google Scholar]
  14. Chowdhury M, Aman MG, Scahill L, Swiezy N, Arnold LE, Lecavalier L, McDougle CJ. The Home Situations Questionnaire-PDD version: Factor structure and psychometric properties. Journal of Intellectual Disabilities Research. 2010;54:281–291. doi: 10.1111/j.1365-2788.2010.01259.x. [DOI] [PubMed] [Google Scholar]
  15. Gao F, Thompson P, Xiong C, Miller PJ. Analyzing multivariate longitudinal data using SAS (Paper 187-31); Paper presented at the annual SAS Users Group international conference; San Francisco, CA. 2006. [Google Scholar]
  16. Guy W. ECDEU Assessment Manual of Psychopharmacology. National Institute of Mental Health US Dept. of Health, Education, and Welfare publication (ADM), Psychopharmacology Research Branch; Rockville, Md.: 1976. pp. 76–338. [Google Scholar]
  17. Handen BL, Feldman H, Lurier M, Husar PJ. Efficacy of methylphenidate among preschoolers with developmental disabilities and ADHD. Journal of the American Academy of Child and Adolescent Psychiatry. 1999;38:805–812. doi: 10.1097/00004583-199907000-00009. [DOI] [PubMed] [Google Scholar]
  18. Handen BL, Johnson CR, Butter EM, Lecavalier L, Scahill L, Aman MG, Vitiello B. Use of a direct observational measure in a trial of risperidone and parent training in children with pervasive developmental disorders. Journal of Developmental and Physical Disabilities. 2013;25:355–371. doi: 10.1007/s10882-012-9316-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Handen BL, Johnson C, Lubetsky M. Efficacy and safety of methylphenidate in children with autistic disorder. Journal of Autism and Developmental Disorders. 2000;35:245–255. doi: 10.1023/a:1005548619694. [DOI] [PubMed] [Google Scholar]
  20. Handen BL, Sahl R, Harden AY. Guanfacine in children with autism and/or intellectual disabilities. Journal of Developmental Behavioral Pediatrics. 2008;29:303–308. doi: 10.1097/DBP.0b013e3181739b9d. [DOI] [PubMed] [Google Scholar]
  21. Hanley GP, Iwata BA, McCord BE. Functional analysis of problem behavior: A review. Journal of Applied Behavior Analysis. 2003;36:147–185. doi: 10.1901/jaba.2003.36-147. doi: 10.1901/jaba.2003.36-147. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika. 1988;75:800–802. [Google Scholar]
  23. Hollander E, Anagnostou E. Clinical manual for the treatment of autism. American Psychiatric Publishing, Inc; Washington DC: 2007. [Google Scholar]
  24. Howard HA, Ladew P, Pollack EG, editors. The National Autism Center’s National Standard’s Project “Findings and conclusions.”. National Autism Center; Randolph, MA: 2009. [Google Scholar]
  25. Jaselskis CA, Cook EH, Fletcher KE, Leventhal BL. Clonidine treatment of hyperactive and impulsive children with autistic disorder. Journal of Clinical Psychopharmacology. 1992;12:322–327. [PubMed] [Google Scholar]
  26. Johnson C, Butter E, Handen B, Sukhodolsky DG, Mulick J, Lecavalier L, McDougle CJ. Journal of Intellectual and Developmental Disabilities. 2009;34:230–238. doi: 10.1080/13668250903074471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kennedy CH, Meyer KA, Knowles T, Shukla S. Analyzing the multiple functions of stereotypical behavior for students with autism: Implications for assessment and treatment. Journal of Applied Behavior Analysis. 2000;33:559–571. doi: 10.1901/jaba.2000.33-559. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Lecavalier L. Behavioral and emotional problems in young people with pervasive developmental disorders: relative prevalence, effects of subject characteristics, and empirical classification. Journal of Autism and Developmental Disorders. 2006;36:1101–1114. doi: 10.1007/s10803-006-0147-5. [DOI] [PubMed] [Google Scholar]
  29. Lechmacher W, Wassmer G, Reitmeir P. Procedures for two-sample comparisons with multiple endpoints controlling the experiment-wise error rate. Biometrics. 1991;47:511–512. [PubMed] [Google Scholar]
  30. March J, Silva S, Patrycki S, Curry J, Wells K, Fairbank J, Severe J. Fluoxetine, cognitive behavioral therapy, and their combination for adolescents with depression: Treatment for adolescents with depression study (TADS) randomized controlled trial. Journal of the American Medical Association. 2004;292:807–820. doi: 10.1001/jama.292.7.807. [DOI] [PubMed] [Google Scholar]
  31. Michelson D, Faries D, Wernicke J, Kelsey D, Kendrick K, F. Sallee FR, Spencer T, the Atomoxetine ADHD Study Group Atomoxetine in the treatment of children and adolescents with Attention-Deficit/Hyperactivity Disorder: A randomized, placebo-controlled, dose-response study. Pediatrics. 2001;108:e83. doi: 10.1542/peds.108.5.e83. [DOI] [PubMed] [Google Scholar]
  32. Newcorn JH, Spencer TJ, Biederman J, Milton D, Michelson D. Atomoxetine treatment in children and adolescents with attention-deficit/hyperactivity disorder and comorbid oppositional defiant disorder. Journal of the American Academy of Child and Adolescent Psychiatry. 2005;44:240–248. doi: 10.1097/00004583-200503000-00008. [DOI] [PubMed] [Google Scholar]
  33. O’Brien PC. Procedures for comparing samples with multiple endpoints. Biometrics. 1984;40:1079–1087. [PubMed] [Google Scholar]
  34. Pediatric OCD Treatment Study (POTS) Team Cognitive behavior therapy, sertraline and their combination for children and adolescents with obsessive-compulsive disorder. Journal of the American Medical Association. 2004;292:1969–1976. doi: 10.1001/jama.292.16.1969. [DOI] [PubMed] [Google Scholar]
  35. Quintana H, Birmaher B, Stedge D, Lennon S, Freed J, Bridge J, Greenhill L. Use of methylphenidate in the treatment of children with autistic disorder. Journal of Autism and Developmental Disorders. 1995;25:283–294. doi: 10.1007/BF02179289. [DOI] [PubMed] [Google Scholar]
  36. Realmuto GM, August GJ, Garfinkel BD. Clinical effect of buspirone in autistic children. Journal of Clinical Psychopharmacology. 1989;9:122–125. doi: 10.1097/00004714-198904000-00009. [DOI] [PubMed] [Google Scholar]
  37. Repp A, Horner R. Functional analysis of problem behaviors: From effective assessment to effective support. Wadsworth; New York: 1999. [Google Scholar]
  38. Research Units on Pediatric Psychopharmacology Autism Network (RUPP) Randomized Controlled, Crossover Trial of Methylphenidate in Pervasive Developmental Disorders with Hyperactivity. Archives of General Psychiatry. 2005;62:1266–1274. doi: 10.1001/archpsyc.62.11.1266. [DOI] [PubMed] [Google Scholar]
  39. Schmidt K. The effect of stimulant medication in childhood onset pervasive developmental disorder: A case report. Journal of Developmental and Behavioral Pediatrics. 1982;3:244–246. doi: 10.1097/00004703-198212000-00014. [DOI] [PubMed] [Google Scholar]
  40. Smith T. Applied behavior analysis and early intensive intervention. In: Amaral DG, Dawson G, Geschwind DH, editors. Autism Spectrum Disorders. Oxford University Press; New York: 2011. pp. 1037–1055. [Google Scholar]
  41. Sporn A, Pinsker H. Use of stimulant medication in treating pervasive developmental disorder. American Journal of Psychiatry. 1981;138:997. doi: 10.1176/ajp.138.7.997a. [DOI] [PubMed] [Google Scholar]
  42. Swanson JM. School-Based Assessments and Interventions for ADD Students. KC Publishing; Irvine, CA: 1992. [Google Scholar]
  43. The MTA Cooperative Group A 14-Month randomized clinical trial of treatment Strategies for attention-deficit/hyperactivity disorder (ADHD) Archives of General Psychiatry. 1999;56:1073–1086. doi: 10.1001/archpsyc.56.12.1073. [DOI] [PubMed] [Google Scholar]
  44. van Haaren F. Risperidone and parent training in pervasive developmental disorders. (Letter to the editor) Journal of the American Academy of Child and Adolescent Psychiatry. 2009:406–407. doi: 10.1097/00004583-201004000-00015. [DOI] [PubMed] [Google Scholar]
  45. Volkmar F, Hoder EL, Cohen DJ. Inappropriate uses of stimulant medications. Clinical Pediatrics. 1985;24:127–130. doi: 10.1177/000992288502400301. [DOI] [PubMed] [Google Scholar]

RESOURCES