Abstract
Objectives
To determine the feasibility of implementing a broadband screen at the 1-year check-up to detect cases of autism spectrum disorders (ASD), language delay (LD), and developmental delay (DD).
Study design
The Communication and Symbolic Behavior Scales Developmental Profile Infant-Toddler Checklist was distributed at every 1-year pediatric check-up; 137 pediatricians and 225 infants participated. Screens were scored immediately, and failures referred for further evaluation.
Results
Pediatricians screened 10 479 infants at the 1-year check-up; 184 infants who failed the screen were evaluated and tracked. To date, 32 infants received a provisional or final diagnosis of ASD, 56 of LD, nine of DD, and 36 of “other.” Five infants who initially tested positive for ASD no longer met criteria at follow-up. The remainder of the sample was false positive results. Positive predictive value was estimated to be .75.
Conclusions
The 1-Year Well-Baby Check-Up Approach shows promise as a simple mechanism to detect cases of ASD, LD, and DD at 1 year. This procedure offers an alternative to the baby sibling design as a mechanism to study autism prospectively, the results of which will enrich our understanding of autism at an early age.
There is a paucity of prospective behavioral and biologic data on autism at 12 months of age. The reason for this gap is that autism remains behaviorally, not biologically, defined and diagnosed, and this significantly limits the approaches that can be used for the very early identification and study of infants at high risk for the disorder.
From a research perspective, the major approach currently used to prospectively study autism is the baby/sibling design.1 The approach is based on the fact that mothers of children with autism have a 5% to 10% chance of giving birth to a second child who will have development of an autism spectrum disorder (ASD).2,3 New studies suggest that recurrence rates may be even higher.1,4 Although the scientific importance of baby/sibling research is undeniably high, this method contains an intrinsic sampling bias in that, by design, it targets only families with an already existing child with autism. As such, resulting ASD samples are only those from multiplex families. Differences in rates of genetic mutations5 and indexes of fetal development6 between singleton and multiplex cases suggest the possibility of etiologic differences between those two groups. Prospective methods that sample autism as it occurs in the general population are needed.
From a clinical perspective, systematic screening of infants for autism at well-baby check-ups (18–24 months) is an essential goal that has been recently proposed by the American Academy of Pediatrics.7 Even with screening at 18 and 24 months, many children do not begin treatment until well after their second or third birthday. Neuroscience has provided strong evidence implicating the profound impact of early environmental manipulation on the developing brain.8 The opportunity to begin the treatment of autism specifically around the first birthday, an age when brain growth is altered,9–11 has not been systematically achieved but seems to have potential to change outcome for affected children. Unfortunately, there are currently no valid autism-specific screening tools for the 12-month age. In 2002, however, Wetherby and Prizant12 developed a general broadband screen, the Communication and Symbolic Behavior Scales Developmental Profile Infant-Toddler Checklist (CSBS-DP IT-Checklist), that detects a wide range of disorders such as global developmental delay, general language delay, and autism between 6 to 24 months. This screening tool, however, has never been administered systematically in a clinical setting as standard of care or as a mechanism to study autism prospectively.
The goals of this investigation were (1) to demonstrate the feasibility of assembling a pediatrician network designed to systematically screen all 1-year old infants; (2) to track the number of babies screened by this network and the rates of ASD, language delay (LD), developmental delay (DD), and false-positive results detected by the process; (3) to identify the ages with which infants with ASD, LD, and DD were referred for treatment, as well as when they actually began treatment; and (4) to evaluate pediatrician satisfaction with the program.
Methods
The overall design of the study included establishing a network of pediatricians throughout San Diego County and initiating a systematic screening program for all infants at the 1-year check-up. Conceptually, the program included five parts. First, pediatricians and their staff participated in a 1-hour educational seminar that provided general information about autism, as well as instruction regarding implementation and scoring of a screening tool to be used at all 1-year well-baby visits. Second, the number of screening forms handed out and the number of infants who passed versus failed at each office was tracked. Third, any infant who failed the screening form was referred to our laboratory for further developmental testing. Fourth, on the basis of testing scores, any infant who performed below expected developmental norms for age was referred for treatment and his/her participation was tracked. Fifth, each infant was developmentally evaluated every 6 months until age 36 months. This project was reviewed and approved by the Human Subjects Protection Review Board at the University of California, San Diego.
Pediatricians (n = 137) with practices across 30 different offices throughout San Diego County took part in this study. Pilot data collection for this project began at the end of 2005, and pediatric offices joined steadily over the next 3.5 years.
All infants who went to their pediatrician for a 1-year check-up were screened, with no exclusionary criteria. If an infant failed the screening, they were referred to our laboratory for further testing and were developmentally evaluated every 6 months until age 36 months; 184 infants who failed the screening were tracked and are the focus of this study. To obtain typical control subjects, pediatricians randomly selected infants who passed the screening and gave a referral flyer to their caregiver; 41 infants participated as control subjects. Regardless of at-risk or control status, all families were accepted equally when they called to enroll. For summary purposes, infants were categorized according to their current diagnoses on the basis of age at first evaluation session (Table I).
Table I.
Age group at intake | No | ASD | Prior positive ASD test result* | LD | DD | Other | False-positive result | Typical |
---|---|---|---|---|---|---|---|---|
12–15 mo | 166 | 14 | 3 | 37 | 6 | 29 | 42 | 35 |
16–19 mo | 36 | 10 | 0 | 13 | 0 | 6 | 3 | 4 |
20–24 mo | 23 | 8 | 2 | 6 | 3 | 1 | 1 | 2 |
Overall total 12–24 mo | 225 | 32 | 5 | 56 | 9 | 36 | 46 | 41 |
Indicates a failure on the ADOS-T, as well as a clear clinical judgment of ASD during early testing phases. At follow-up visits, these five toddlers no longer met ADOS-T or clinical judgment for ASD. Also note that there were also a small percentage of infants who met criteria for ASD on the ADOS-T but were not considered at-risk for an ASD because of clinical judgment. Children with profound mental retardation or those with scores only in the mild range of concern, for example, have a high false-positive rate on the ADOS-T.14
Screening Form: CSBS-DP-IT-Checklist
The CSBS-DP-IT-Checklist is a 24-item parent-report questionnaire shown to have both high sensitivity and specificity.12,13 This screening tool quantifies an infant’s proficiency in three subdomains: social and emotional communication, receptive and expressive speech, and symbolic behavior. This project used the 10th percentile cutoff scores, available at www.firstsigns.org. The form can be filled out in 5 minutes by caregivers and scored in less than 2 minutes by medical staff. The CSBS-DP-IT-Checklist is ideal as a first pass developmental screen because it was originally designed to detect children with communication delays and not autism per se. Given that children at risk for an ASD often have delays in language, it would be expected to detect a considerable percentage of infants at risk for an ASD, as well as those that were experiencing an LD or global DD.12,13 If used as a broadband screen for research purposes, the use of the CSBS-DP-IT-Checklist yields three natural contrast groups (ASD, LD, and DD), an essential consideration given the somewhat overlapping behavioral phenotype of these groups at a young age. If used as a broadband screen for clinical purposes, it has the potential to identify a wide range of children who may benefit from early treatment.
Educational Seminar, 1-Year Well-Baby Check-Up Procedure, and CSBS-DP-IT-Checklist Tracking
Pediatricians and their medical staff attended an educational seminar given by one of the authors (K.P.). The content of the seminar included a discussion of autism, the importance of early screening, and specifics about CSBS-DP-IT-Checklist scoring. Because the project was conducted in the context of institutional review board regulations, laboratory members were not allowed to contact families of babies who failed the screening form. Instead, pediatricians handed out referral flyers for further developmental evaluations at our laboratory.
To track the number of referrals to our laboratory, any failed CSBS-DP-IT-Checklist form referred for further testing was denoted by a check on the bottom of the screening form. To track the number of screening forms that were administered per pediatric office, deidentified photocopies of completed screening forms were collected every 2 weeks.
Thus the 1-Year Well-Baby Check Up Approach can be summarized as follows: (1) the CSBS-DP-IT-Checklist is handed out by the receptionist to the parent at check-in for all 1-year well baby visits; (2) the parent fills out the CSBS-DP-IT-Checklist while in the waiting room; (3) the CSBS-DP-IT-Checklist is immediately scored by a medical staff member and placed in the baby’s chart; (4) the pediatrician reviews the scored screen before 1-year examination; (5) the pediatrician refers any baby who failed for further developmental evaluation via a flyer; and (6) copies of deidentified completed CSBS-DP-IT-Checklist forms are collected every 2 weeks.
Infant Developmental Evaluation
Infants who failed the screening and were referred to our laboratory participated in a series of tests administered by highly experienced PhD-level psychologists, including the Autism Diagnostic Observation Schedule-Toddler Module (ADOS-T), newly validated for use with infants as young as 12 months14 and the Mullen Scales of Early Learning.15 Parents were asked to participate in additional behavioral (eg, eye tracking) and biologic tests that included a blood draw and magnetic resonance imaging as part of a larger study (www.autism-center.ucsd.edu). Infants returned to our laboratory every 6 months until age 3 years. Only ADOS-T, Mullen, and CSBS-DP-IT-Checklist scores will be reported here. Infants were considered “at risk” for an ASD on the basis of a failure of the ADOS-T and clinical judgment any time between 12 to 18 months, provisionally ASD between 19 to 31 months, and final ASD between 32 to 36 months. Final diagnosis at 32 to 36 months was also confirmed with the Autism Diagnostic Interview-R.16 Infants were categorized having LD if one or both of the language subtest results of the Mullen was >1 SD below expected values for that age (ie, a t-score < 40), which is slightly more liberal than most standard definitions of language delay that use a −1.25 SD cutoff. Infants were considered DD if scores on 3 or more of the subtests of the Mullen and the overall early learning composite was >1 SD below expected values. Infants were considered “other” if they showed delays outside the aforementioned categories such as motor delay. Infants were considered as having a false-positive result if despite failing the screening form at the 1-year check-up, they scored within the normal range on standardized tests at our laboratory. Infants were considered typically developing if test scores were above −1 SD. Infants determined to be developing below age-appropriate levels in social, language, or cognitive functioning at any time were referred for treatment mediated by California Early Start or the University of California, San Diego Autism Center of Excellence.
CSBS-DP-IT-Checklist Positive Predictive Value
Positive predictive value, the proportion of toddlers who initially failed the screening form who in fact have a true delay, was calculated as the number of True-positive results/True-positives + False-positive results.
Treatment Inventory
The onset date, quantity, and type of treatment were tracked for each infant with a form filled out by caregivers. This form was completed as a take-home survey or done via phone interview every 6 months (Figure 1; available at www.jpeds.com).
Pediatrician Satisfaction Questionnaire
To evaluate each pediatrician’s interpretation of the quality and usefulness of the program, each was asked to fill out a questionnaire anonymously and return via mail. A total of nine multiple-choice or yes/no questions were asked such as “Before participation in this program, did you or your office consistently screen 1-year-olds?” and “Do you believe that participation in this program enhanced your clinical practice?”
Results
Screening Form Failures and Referrals
A total of 10 479 screens were administered; the mean age at screening was 12.54 months (range 10.08 to 15.97 months). On the basis of the 10th percentile cutoff scores that were used,17 it was expected that approximately 1047 infants would fail the screening. In our San Diego sample, 1318 children failed the screening (12.5 %); 346 were referred to our laboratory as indicated by the referral check box. Compliance, for purposes of this study, is defined as the rate of parent enrollment of their infant on the basis of pediatrician referral. Of the initial 346 referrals, parents of 208 infants enrolled and 184 infants were seen for at least two testing sessions and are the focus of this study. Pediatricians randomly selected an additional 66 infants who passed the screening form to serve as typical control subjects, 41 of whom maintained active participation. The total final sample size was 225 infants (Figure 2).
Infant Developmental Evaluation, Tracking, and Diagnoses
On average, infants with ASD were tested across an average of six separate visits, and 72% of the ASD sample has been given a final diagnosis at 32 to 36 months or greater. One infant (3% of sample) was tracked until only 18 months, and the remaining 25% of the sample has been tracked until at least 24 months. There is now research empirically demonstrating the stability of diagnoses at this age.18–20 Toddlers with an ASD were tracked for significantly longer than non-ASD groups (F6,218 = 2.35, P = .035). Follow-up t-tests and additional tracking information is available in Table II. Out of the 184 infants who initially failed the CSBS-DP-IT-Checklist and were followed by this study, 32 received a provisional or final diagnosis of ASD and an additional five infants originally considered as having an ASD no longer met criteria at follow-up. Fifty-six infants were diagnosed as LD, nine as DD, 36 as “other,” and 46 were considered a false-positive result. All 41 infants who maintained participation as typical control subjects tested within the normal range. Summary information regarding the earliest available ADOS-T and Mullen scores, as well as the most recent ADOS-T and Mullen scores for each subject group, are available in Tables III and IV (available at www.jpeds.com). Note that ADOS-T scores are relatively stable across the two test periods for children identified as having an ASD.
Table II.
Diagnostic group | No. | Mean no. of visits (SD) | Most recent diagnostic age (mo; SD) | % Sample tracked until 24 mo or greater | % Sample tracked until 32 mo or greater |
---|---|---|---|---|---|
ASD | 32 | 6.0 (2.5) | 34.7 (8.8) | 97 | 72 |
Prior positive ASD test result* | 5 | 4.8 (2.2) | 32.0 (8.9) | 80 | 60 |
LD | 56 | 4.4 (2.4) | 25.9 (9.2) | 54 | 30 |
DD | 9 | 5.8 (2.9) | 33.4 (9.8) | 78 | 67 |
Other | 36 | 4.3 (2.1) | 25.7 (8.6) | 61 | 26 |
False-positive | 46 | 4.6 (2.3) | 25.4 (8.7) | 61 | 28 |
Typical | 41 | 4.3 (2.7) | 25.5 (10.3) | 56 | 42 |
Indicates a failure on the ADOS-T, as well as a clear clinical judgment of ASD during early testing phases. At follow-up visits, these five toddlers no longer met ADOS-T or clinical judgment for ASD. Also note that there were also a small percentage of infants who met criteria for ASD on the ADOS-T but were not considered at-risk for an ASD because of clinical judgment. Children with profound mental retardation or those with scores only in the mild range of concern, for example, have a high false-positive rate on the ADOS-T.14
Table III.
Age (mo) | Visual reception T score | Fine motor T score | Receptive language T score | Expressive language T score | Early learning composite | |
---|---|---|---|---|---|---|
Earliest age (Range; SD) | ||||||
ASD (n = 32) | 17.8 (12.3–24.8; 3.9) | 43.0 (25–69; 10.2) | 43.6 (20–71; 13.2) | 29.1 (17–62; 11.4) | 32.2 (15–65; 11.7) | 75.5 (51–120; 15.4) |
LD (n = 56) | 15.3 (12.2–24.8; 3.1) | 51.0 (23–80; 10.2) | 52.3 (20–74; 9.6) | 39.6 (21–63; 8.9) | 37.0 (21–57; 7.3) | 90.4 (67–122; 11.6) |
DD (n = 9) | 17.0 (13.1–23; 3.9) | 30.5 (20–40; 7.3) | 29.3 (20–44; 8.3) | 23.4 (20–28; 3.1) | 26.7 (20–38; 8.0) | 63.3 (29–65; 11.1) |
Other (n = 36) | 14.5 (10.8–23.7; 2.5) | 52.8 (31–74; 9.5) | 53.7 (33–77; 9.5) | 40.7 (24–60; 8.4) | 45.3 (24–62; 8.0) | 96.3 (67–121; 12.0) |
Prior positive ASD test result (n = 5) | 15.9 (12.2–21; 4.4) | 51.6 (41–60; 7.2) | 56.8 (49–69; 8.6) | 34.8 (26–40; 5.5) | 41.6 (33–51; 8.1) | 92.6 (83–105; 9.1) |
False-positive result (n = 46) | 13.7 (11.2–19.1; 1.4) | 55.0 (38–76; 8.5) | 58.6 (44–74; 7.5) | 46.7 (31–69; 8.3) | 51.6 (31–71; 9.6) | 106.1 (86–128; 11.9) |
Control (n = 41) | 14.5 (9.8–23; 2.4) | 56.5 (41–80; 8.2) | 58.4 (48–71; 6.5) | 53.4 (35–77; 11.0) | 53.3 (42–75; 7.4) | 111.2 (92–135; 11.7) |
Most recent age (Range; SD) | ||||||
ASD (n = 32) | 34.1 (18.2–60.9; 8.9) | 41.0 (20.0–65.0; 11.6) | 35.7 (20.0–49.0; 9.9) | 35.5 (18.0–58.0; 12.1) | 37.6 (8.0–63.0; 14.6) | 78.6 (49.0–106.0; 17.5) |
LD (n = 56) | 25.1 (12.3–46.4; 9.0) | 54.7 (23.0–82.0; 12.6) | 52.1 (28.0–80.0; 10.0) | 45.7 (21.0–68.0; 11.3) | 43.2 (25.0–68.0; 11.2) | 98.8 (72.0–144.0; 17.4) |
DD (n = 9) | 32.4 (13.8–51.0; 11.2) | 31.8 (20.0–52.0; 12.2) | 28.0 (20.0–40.0; 8.1) | 30.4 (20.0–44.0; 9.4) | 30.9 (20.0–41.0; 8.3) | 58.8 (20.0–81.0; 22.1) |
Other (n = 36) | 24.9 (12.1–40.0; 8.8) | 51.8 (31.0–80.0; 12.3) | 49.5 (23.0–77.0; 11.6) | 46.1 (24.0–66.0; 11.1) | 47.6 (20.0–63.0; 10.0) | 98.6 (72.0–160.0; 18.1) |
Prior positive ASD test result (n = 5) | 31.7 (18.6–44.9; 9.3) | 50.6 (45.0–54.0; 3.9) | 48.2 (43.0–54.0; 4.1) | 46.8 (30.0–59.0; 10.7) | 54.0 (45.0–61.0; 6.2) | 99.8 (89.0–111.0; 8.1) |
False-positive result (n = 46) | 24.6 (12.4–38.2; 8.9) | 57.3 (44.0–80.0; 8.7) | 56.6 (41.0–69.0; 8.1) | 51.8 (33.0–67.0; 9.2) | 51.8 (18.0–79.0; 10.4) | 110.9 (86.0–139.0; 13.3) |
Control (n = 41) | 23.8 (11.8–44.9; 10.2) | 56.9 (36.0–80.0; 11.1) | 56.8 (41.0–80.0; 8.1) | 54.3 (35.0–77.0; 11.7) | 53.1 (40.0–70.0; 8.3) | 111.8 (92.0–146.0; 13.6) |
Table IV.
Age (mo) | Social affect total | RR total | Total | |
---|---|---|---|---|
Earliest age (range; SD) | ||||
ASD (n = 32) | 17.9 (12.5–24.3; 3.8) | 13.8 (4–20; 4.8) | 2.9 (0–7; 1.8) | 16.8 (4–25; 6.0) |
LD (n = 56) | 15.6 (11.2–24.8; 3.1) | 5.3 (0–12; 3.3) | 1.2 (0–5; 1.4) | 6.5 (0–17; 4.3) |
DD (n = 9) | 16.2 (13.5–21.1; 3.1) | 9.6 (0–17; 6.4) | 2.3 (0–5; 2) | 12 (3–21; 7.2) |
Other (n = 36) | 14.7 (12.3–23.7; 2.5) | 4.3 (0–14; 3.2) | 1.8 (0–8; 2.1) | 6.2 (0–16; 4.1) |
Prior positive ASD test result (n = 5) | 16.2 (12.2–23.0; 4.8) | 9.8 (3–13; 4.1) | 1.8 (0–3; 1.6) | 11.6 (3–16; 5.0) |
False-positive result (n = 46) | 14.0 (11.5–19.5; 1.5) | 3.0 (0–12; 2.9) | .3 (0–3; .6) | 3.3 (0–12; 3.0) |
Control (n = 41) | 15.0 (12.0–23.2; 2.3) | 2.1 (0–7; 1.8) | .5 (0–4; 1.0) | 2.5 (0–8; 2.1) |
Most recent age (range; SD) | ||||
ASD (n = 32) | 34.2 (18.4–60.9; 8.8) | 13.4 (7.0–22.0; 4.6) | 3.5 (0–6.0; 1.6) | 16.9 (7.0–26.0; 5.2) |
LD (n = 56) | 25.1 (12.9–46.4; 8.8) | 3.6 (0–12.0; 2.9) | 0.6 (0–5.0; 1.0) | 4.1 (0–17.0; 3.5) |
DD (n = 9) | 32.6 (13.8–51.0; 11.2) | 4.6 (2.0–12.0; 3.4) | 2.3 (0–5.0; 1.8) | 6.9 (3.0–17.0; 4.8) |
Other (n = 36) | 24.7 (12.3–40.4; 9.1) | 4.0 (0–10.0; 2.4) | 0.8 (0–7.0; 1.6) | 4.8 (0–12.0; 3.0) |
Prior positive ASD test result (n = 5) | 32.1 (19.8–44.9; 10.3) | 4.8 (2.0–6.0; 1.9) | 0.5 (0–2.0; 1.0) | 5.3 (4.0–6.0; 1.0) |
False-positive result (n = 46) | 24.9 (12.5–38.4; 8.7) | 2.3 (0–9.0; 2.3) | 0.3 (0–3.0; .7) | 2.6 (0–9.0; 2.5) |
Control (n = 41) | 24.6 (12.0–44.7; 9.9) | 1.7 (0–6.0; 1.8) | 0.2 (0–2.0; 0.5) | 1.9 (0–7.0; 2.1) |
RR, restricted and repetitive.
CSBS-DP-IT-Checklist Scores
Because copies of the CSBS-DP-IT-Checklist forms were deidentified and we were blind to patient information at the time of form pick-up, original forms for each infant participant were located after parents signed the consent form at our laboratory (eg, retrospectively via pediatricians’ files). Sixty-six percent of original CSBS-DP-IT-Checklist forms filled out at the 1-year check-up were located for those infants who failed and were seen at our laboratory. The inability to locate the remaining forms was due to the fact that although pediatric offices were requested to make photocopies of each screening form to keep one for their files that we could locate after the family signed a consent form, many failed to do so. Excluding control subjects who consistently passed the screening form, there were no differences in overall CSBS-DP-IT-Checklist scores for any of the remaining five subject groups, F = 2.371 (4, 117) P > .05 (Figure 3).
CSBS-DP-IT-Checklist Positive Predictive Value
On the basis of the outcome data provided in Table I, estimates of the positive predictive value of the CSBS-DP-IT-Checklist as a screening tool for detecting a wide range of DDs (ASD, prior positive ASD test result, LD, DD, or “other”) at 12 months was 75%. This was based on the calculation True-positive results/True-positive results + False-positive positive results (ie, 138/138 + 46). Note that the prior positive ASD test result cases were included in the numerator of this calculation as a true-positive result because, despite no longer meeting full criteria for ASD, all received behavioral treatment, two cases still exhibited some language delay at follow-up, and in all cases some unusual social behaviors remained.
Treatment Inventory
The utility of a screening program can only fully be realized if effective treatment options exist for test positive cases.21 In this study, 100% of toddlers with an ASD or DD and 89% with a LD were referred for behavioral treatment as soon as a delay was detected on the basis of standardized test scores and clinical judgment. Treatment, on average, began around 19 months in age. Considering the sample as a whole, children with an ASD received an average of 11.5 hours per week of treatment, which was significantly more treatment than children with an LD (mean 1.9 hours per week, t = 8.1, P < .05) but not toddlers with a DD (mean 8.5 hours, t = 1.1, P > .05; Figure 4; available at www.jpeds.com).
Pediatrician Satisfaction Questionnaire
Ninety-two pediatricians completed and returned the survey. Most pediatricians were not systematically screening infants at any age before participation in the 1-Year Well-Baby Check-Up Approach (Table V; available at www.jpeds.com). In contrast, after participation in our program, 96% of pediatricians evaluated the program positively and believed that it was a clinically valuable improvement to their practice. Importantly, all pediatric practices are still using the screening tool today.
Table V.
Question (total respondents, n = 92) | Yes | No | Not sure |
---|---|---|---|
Q1. Before your office’s participation in this screening program, did you and your staff consistently screen babies at 12-months for developmental delay using a standardized tool? | 20% | 77% | 3% |
Q2. Before your office’s participation in this screening program, did you and your staff screen consistently at any other age? (e.g., 18, 24, 30 months)? | 44% | 51% | 5% |
Q3. Do you believe that participation in this program overall has heightened your general awareness regarding autism and other developmental disorders? | 87% | 12% | 1% |
Q4. Do you believe that the screening form that you currently use as part of this project (ie, CSBS) is a valuable tool that enhances your clinical practice? | 96% | 2% | 2% |
Q5. Do you believe that this general approach of screening at 1-Year (called the 1-Year Well-Baby Check-Up Approach) should serve as a model for other cities to follow? | 95% | 3% | 2% |
Discussion
On the basis of 10 479 simple screening forms administered at the first-year pediatric examination, 32 infants were identified as having ASD. Current epidemiologic estimates report that 65 of every 10 000 infants born will be diagnosed as having an ASD by early childhood.22 Given that late onset (approximately 20% of cases), regression (25% of cases23), and Asperger’s cases (10% of cases24) would not be expected to be detected by screening at the first birthday, rates obtained by this study are in alignment with what would be predicted on the basis of current prevalence rates. The strategy outlined here thus provides a simple mechanism for research laboratories to study autism beginning at 12 months. The ability to study autism in the general population before the onset of obvious symptoms may be particularly important for research studies aimed at identifying early biomarkers of the disorder. Furthermore, the 1-Year Well-Baby Check-Up Approach not only successfully identified early cases of autism, but also 56 cases of LD and nine cases of DD that stand as important research contrast groups.
The standard of clinical care was dramatically changed for infants in San Diego with relatively little effort on the part of participating pediatric offices. In a strong display of collaboration, 137 pediatricians actively and consistently screened infants at 1 year and are continuing to do so today. Before participation in this study, only 22% of pediatricians were consistently screening at 1 year. In contrast to other population-based screening studies that used screens that were mailed in or received from multiple child and health care agencies,12,25 this study reflects a valid assessment of what can be achieved in real-world pediatric practice. Specifically, screens were filled out and scored as part of the normal 1-year check-up appointment and were not received from any other source.
On the basis of the sample of children who were tracked in this study, our results suggest that approximately 20% of infants who fail the CSBS-DP-IT-Checklist at the 12-month pediatric check-up will manifest an ASD, 55% will manifest an LD, general DD, or associated issue, and 25% will have a false-positive result. No selection criteria, exclusionary criteria, or phone screening occurred when parents called our laboratory for an evaluation; parents were simply following their pediatrician’s recommendation for an evaluation, and participation was granted to all callers equally.
It is also important to consider how this study differs from the many important screening studies that preceded it.12,26–30 In contrast to studies in primary medical settings that focus on 18 months and older,26–28 this is the first and only study that demonstrates the feasibility of using a broad screen in a medical setting to detect autism as young as 12 months. Additionally, unlike other studies wherein a research assistant approached every parent in a waiting room and obtained informed consent,26 this study evaluated the ease with which a pediatricians’ office could actually implement the screening process with their own employees and not research assistants. Although a promising new autism toddler screen, the Early Screening of Autistic Traits Questionnaire, has been developed, the full screen has not been tested for use in a pediatrician’s office but rather was administered in the home setting at a mean age of 16 months,30 and infants did not receive a full developmental evaluation until an average of 24 months. Furthermore, field test results for the Early Screening of Autistic Traits Questionnaire indicated that of >36 000 infants screened, only 18 were identified as having ASD. In this study 32 infants with ASD were identified with far fewer screens (ie, 10 479), suggesting that the CSBS-DP-IT-Checklist may be particularly effective as an early screening tool for autism. The study by Wetherby et al12 focused on the CSBS-DP-IT Checklist. In that study parents in the general community were first mailed an information packet, and interested parents returned the completed screening form anytime when their infant was between 6 and 24 months via mail. There was the potential for a selection bias in that parents with strong concerns about their infant were more likely to return the screening form.12 Results from this study, which screened solely in pediatric offices and were possibly less susceptible to selection bias, found an almost identical positive predictive value at 12 months (75%) compared with what was found by the mail-in study by Wetherby et al12 at 12 months (73%). Combined results from both studies thus provide confidence in the CSBS-DP-IT-Checklist as an early screen to detect a wide range of delays.
Beyond the high research potential of using the CSBS-DP-IT-Checklist at all 1-year check-ups, this program also successfully initiated treatment targeting language, social, and cognitive skills for the vast majority of infants with an ASD, LD, or DD between the ages of 12 to 24 months. It is unlikely that treatment would have been initiated for these children at such an early age had it not been for this program. Almost all treatments were behaviorally based, with the most common modalities being speech therapy, discrete trial training, and pivotal response training. Overall, infants received an average of 7.6 hours of one-on-one treatment per week, with a greater number of treatment hours for the children with DD and ASD in comparison with those with LD. Most of these infants began treatment at or before 18 months in age.
There are, however, some limitations to the inferences one can draw from this study. Although clinically desirable and a possible line of future inquiry, this study did not set out to determine sensitivity and specificity of the CSBS-DP-IT-Checklist. The initial validation study of the instrument,12,13 not conducted in pediatric offices and with slightly older children, estimated good sensitivity (88.9%) and specificity (94%). Data from this study are not well-suited to replicate and extend these findings because only 41 infants who passed the initial screening were followed, and estimates of sensitivity and specificity, which take into account both true- and false-negative results, are strongly influenced by the number of infants tracked who passed the initial screening. Our data do speak to the estimated positive predictive value of the screening, however, because positive predictive value takes into account only infants who failed the screening, and we were able to track 184 such infants. We were also able to note that, similar to findings from the later validation study,12 there is a somewhat high-false positive rate of the CSBS-DP-IT-Checklist. Another potential limitation is that 28% of the toddlers with ASD in the sample have not been monitored through to the full 32 to 36 months of age called for in the study (but rather only until 24 months). It is possible that some diagnoses may change in this small group, although several studies have empirically demonstrated the stability of diagnoses at or around 24 months.18–20,31 Although the utility of this approach for detecting young ASD cases around the first birthday is strong, future iterations of this program could be improved if a second screening were administered 1 year later, at 24 months, to detect late onset and regression cases that were missed by the 12-month screening. Future versions of this program should also attempt to improve the tracking of infants who failed the screening form but were not actually referred for participation in the program. The large discrepancy between the number of failures and the number of referrals to the program could be due to a lack of follow-through on the part of pediatricians, the perception that the infant was not in need of an evaluation, or referral to different organizations. University institutional review board rules restricted a complete evaluation of these possibilities. Finally, the success of such a program can only truly be evaluated if children are tracked until a much older age, such as school age, so long-term follow-up of the sample will be important. This will allow for not only a reexamination of diagnosis but also the opportunity to look for early predictors of long-term clinical outcome.
Despite these hurdles and unknowns, this screening program is promising because it can be implemented at virtually no cost to pediatric practices and is easily translatable into clinical practice. Consistent with other studies,30 we did note a high parental refusal rate to initiate testing and treatment once a toddler was identified by use of the screening. Thus, future effort should be placed on more clearly identifying and attempting to modify factors relating to compliance.
At a theoretical level, it is provocative to consider that programs such as the 1-Year Well-Baby Check-Up Approach that target the detection and treatment of pediatric disorders before the establishment of mature brain circuitry, have the potential to positively impact outcome for affected children. Although it is impossible to determine whether the five toddlers who no longer met criteria for having an ASD after early treatment were impacted by the potential intervention or merely had false-positive results, a comprehensive examination of the early treatment literature concluded that starting treatment as early as possible contributes to more efficacious potential interventions.32 As such, any screening program that aims to identify toddlers at risk and thus begin treatment around the first birthday at least offers the opportunity for significant gains to be made.
Acknowledgments
Supported by Organization for Autism Research, Autism Speaks (formerly Cure Autism Now), and NIMH (R01-MH080134 to K.P).
We would like to sincerely thank all of the children and families that participated in this research. A special thank you to Eric Courchesne (supported by NIH/NIMH P50MH081755-04, NIH/NINDS 5R01MH036840-23, and NIH/NIMH PHS R01MH080134, and the Simons Foundation for Autism Research 176540) for continued overall support and helpful comments on drafts of the manuscript, Lisa Eyler (supported by NIH R01 MH083968-01, 1 P50 MH091755-01, 5 RO1 MH036840-21, and 2 R01 AG022381-07, and San Diego VA Mental Illness Research Education and Clinical Center) for helpful comments on the manuscript, Catherine Lord (supported by the Simons Foundation Genetics Research Study and NIH R01 MH078165-01A2, R01MH81757-01, 1 R01 MH81873-01A1, 3R01MH078165-02S1, 1R C1MH089721, 1 R01 HD065272, 1 R01 MH089477, 1R01MH089390, 5U01NS061264, U24 MH081810, and UA3MC11055, and Centers for Disease Control 10IPA100356) for generously sharing the very first versions of the ADOS-T with us, and Clelia Ahrens-Barbeau (NIH/NIMH P50MH081755-04, NIH/NINDS 5R01MH036840-23, and the Simons Foundation for Autism Research 176540) for administrative support. A very sincere thank you goes out to all of the pediatricians in the UCSD Autism Center of Excellence Pediatric Network (Appendix available at www.jpeds.com). Finally, this work would not have been possible without the generous support of pediatricians in San
Glossary
- ADOS-T
Autism Diagnostic Observation Schedule-Toddler Module
- ASD
Autism spectrum disorders
- CSBS-DP-IT-Checklist
Communication and Symbolic Behavior Scales Developmental Profile Infant-Toddler Checklist
- LD
Language delay
- DD
Developmental delay
Appendix
Pediatricians in the UCSD Autism Center of Excellence Pediatric Network: Dr Robert Bjork, Dr Michael Nelson, Dr Cheryl Jennett, Dr John Kafka, Dr Douglas Wilson, Dr Crystal De Freitas, Dr Martin Gilboa, Dr Patricia Juarez, Dr George Madany, Dr Seven Brody, Dr Ingrid Martinez-Andree, Dr Irene Chang, Dr Stephanie Powell, Dr Adam Breslow, Dr Patricia Pisinger, Dr Isabel Baratta, Dr Sheila Cason, Dr Thomas Neglia, Dr Stephen Balch, Dr Randall Metsch, Dr David Schmottlach, Dr Sonja Brion, Dr Anna Mendenhall, Dr Nancy Clementino, Dr Marshall Littman, Dr Leslie McCormick, Dr Sharon Sternfeld, Dr Cara Cohen, Dr Nicholas Tsoulos, Dr Elena Fishman, Dr Hilary Bowers, Dr Albert Martinez, Dr Genevieve Minka, Dr Wendy Chacon, Dr Leon Kelley, Dr Victor Lipp, Dr Jeffrey Selzer, Dr Lynn Herring, Dr Teresa O’dea, Dr Richard Walls, Dr Vivian Tung, Dr Christian Archambault, Dr Veronique James, Dr Stuart Cohen, Dr Nancy Shiau, Dr Linda Smith, Dr Tevor Henderson, Dr Cheryl Morell, Dr Josef Zwass, Dr Lon Dubeye, Dr Andrea Siano, Dr Aida Martinez, Dr Rachel Ireland, Dr Louis Luevanos Dr Laurie Tyrrell, Dr John Cella, Dr Jill Gustafson, Dr Rosemary Page, Dr David Steele, Dr Carlos Quiros, Dr Brian Chu, Dr Kathleen Jones, Dr James Moseman, Dr Laurence Ashbacher, Dr Theresa Dailey, Dr Frederick Frumin, Dr Nicholas Levy, Dr Julie Snyder Block, Dr Lori Taylor, Dr Rosalind Dockweiler, Dr Christine Wood, Dr William Hitchcock, Dr Robert Warner, Dr Sheetal Gandhi, Dr Suzanne Mills, Dr Mona Sobel, Dr Craig Duck, Dr James Hay, Dr Georgine Jorgensen, Dr Richard Payne, Dr James Quigley, Dr Richard Buchta, Dr Ann Marie Engfelt, Dr Benjamin Spiegel, Dr Lori Gould, Dr Michelle Sanford Dr Annie Kupelian, Dr Paula Grayson, Dr Raha Shaw, Dr Gary Chun, Dr Matilda Remba, Dr Janna Cataldo, Dr Nicole Gorton, Dr Bret Gerber, Dr Denise Brownlee, Dr Stuart Rubenstein, Dr Peggy Manuel, Dr Veda Wu, Dr Michael Berent, Dr Gargi Kubal, Dr Norman Gollub, Dr Teresa Hardisty, Dr Jeanne Montal, Dr Katrina Durkee, Dr Kamei Tolba, Dr Carol Hart, Dr Dennis Butler, Dr Howard Mehl, Dr Marta Awdykovych, Dr Uma Narayan, Dr Richard McNeal, Dr Richard McNeal, Dr Jennie Ou, Dr Howard Smart, Dr Neethi Ratnesar, Dr Cindy Fujii, Dr Philip Mattson, Dr Norman, Dr Sauer, Dr Gabriela Mogrovejo, Dr Julie Keeler, Dr Liz Hourihan, Dr Dania Lindenberg, Dr Dori Mortimer, Dr Marvin Zaguli, Dr Tari Park, Dr John Hansen, Dr Jennifer Dolby, Dr Colleen Geniblazo, Dr Genevieve Parsons, Dr Donald Rostow, Dr Mary Best Casement, Dr David Herz, Dr Gerald Weintraub, Dr Berry Goldberg, Dr Ronald Woerpel, Dr Trieva Scanlan, Dr Pamela Wells.
Footnotes
The authors declare no conflicts of interest.
References
- 1.Zwaigenbaum L, Bryson S, Rogers T, Roberts W, Brian J, Szatmari P. Behavioral manifestations of autism in the first year of life. Int J Dev Neurosci. 2005;23:143–52. doi: 10.1016/j.ijdevneu.2004.05.001. [DOI] [PubMed] [Google Scholar]
- 2.Jorde LB, Hasstedt SJ, Ritvo ER, Mason-Brothers A, Freeman BJ, Pingree C, et al. Complex segregation analysis of autism. Am J Human Genet. 1991;49:932–8. [PMC free article] [PubMed] [Google Scholar]
- 3.Lauritsen MB, Pedersen CB, Mortensen PB. Effects of familial risk factors and place of birth on the risk of autism: a nationwide register-based study. J Child Psychol Psychiatry. 2005;46:963–71. doi: 10.1111/j.1469-7610.2004.00391.x. [DOI] [PubMed] [Google Scholar]
- 4.Landa RJ, Holman KC, Garrett-Mayer E. Social and communication development in toddlers with early and later diagnosis of autism spectrum disorders. Arch Gen Psychiatry. 2007;64:853–64. doi: 10.1001/archpsyc.64.7.853. [DOI] [PubMed] [Google Scholar]
- 5.Sebat J, Lakshmi B, Malhotra D, Troge J, Lese-Martin C, Walsh T, et al. Strong association of de novo copy number mutations with autism. Science. 2007;316:445–9. doi: 10.1126/science.1138659. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hobbs K, Kennedy A, Dubray M, Bigler ED, Petersen PB, McMahon W, et al. A retrospective fetal ultrasound study of brain size in autism. Biol Psychiatry. 2007;62:1048–55. doi: 10.1016/j.biopsych.2007.03.020. [DOI] [PubMed] [Google Scholar]
- 7.Johnson CP, Myers SM American Academy of Pediatrics Council on Children With Disabilities. Identification and evaluation of children with autism spectrum disorders. Pediatrics. 2007;120:1183–215. doi: 10.1542/peds.2007-2361. [DOI] [PubMed] [Google Scholar]
- 8.Majdan M, Shatz CJ. Effects of visual experience on activity-dependent gene regulation in cortex. Nat Neurosci. 2006;9:650–9. doi: 10.1038/nn1674. [DOI] [PubMed] [Google Scholar]
- 9.Courchesne E, Carper R, Akshoomoff N. Evidence of brain overgrowth in the first year of life in autism. JAMA. 2003;290:337–44. doi: 10.1001/jama.290.3.337. [DOI] [PubMed] [Google Scholar]
- 10.Redcay E, Courchesne E. When is the brain enlarged in autism? A meta-analysis of all brain size reports. Biol Psychiatry. 2005;58:1–9. doi: 10.1016/j.biopsych.2005.03.026. [DOI] [PubMed] [Google Scholar]
- 11.Dawson G, Munson J, Webb SJ, Nalty T, Abbott R, Toth K. Rate of head growth decelerates and symptoms worsen in the second year of life in autism. Biol Psychiatry. 2007;61:458–64. doi: 10.1016/j.biopsych.2006.07.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Wetherby AM, Brosnan-Maddox S, Peace V, Newton L. Validation of the infant-toddler checklist as a broadband screener for autism spectrum disorders from 9 to 24 months of age. Autism. 2008;12:487–511. doi: 10.1177/1362361308094501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wetherby AM, Woods J, Allen L, Cleary J, Dickinson H, Lord C. Early indicators of autism spectrum disorders in the second year of life. J Autism Dev Disord. 2004;34:473–93. doi: 10.1007/s10803-004-2544-y. [DOI] [PubMed] [Google Scholar]
- 14.Luyster R, Gotham K, Guthrie W, Coffing M, Petrak R, Pierce K, et al. The Autism Diagnostic Observation Schedule-toddler module: a new module of a standardized diagnostic measure for autism spectrum disorders. J Autism Dev Disord. 2009;39:1305–20. doi: 10.1007/s10803-009-0746-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Mullen EM. AGS. Mullen scales of early learning. Circle Pines, MN: American Guidance Service Inc; 1995. [Google Scholar]
- 16.Lord C, Rutter M, Le Couteur A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Dis. 1994;24:659–85. doi: 10.1007/BF02172145. [DOI] [PubMed] [Google Scholar]
- 17.Wetherby AM, Prizant G. CSBS DP Manual. Baltimore: Brookes Publishing; 2008. First Normed Edition. [Google Scholar]
- 18.Cox A, Charman T, Baron-Cohen S, et al. Autism spectrum disorders at 20 and 42 months of age: stability of clinical and ADI-R diagnosis. J Child Pscyhol Psychiatry. 1999;5:719–32. [PubMed] [Google Scholar]
- 19.Chawarska K, Klin A, Paul R, Macari S, Volkmar F. A prospective study of toddlers with ASD: short-term diagnostic and cognitive outcomes. J Child Psychol Psychiatry. 2009;50:1235–45. doi: 10.1111/j.1469-7610.2009.02101.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Kleinman JM, Ventola PE, Pandey J, Verbalis AD, Barton M, Hodgson S, et al. Diagnostic stability in very young children with autism spectrum disorders. J Autism Dev Disord. 2008;38:606–15. doi: 10.1007/s10803-007-0427-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Cadman D, Chambers L, Feldman W, Sackett D. Assessing the effectiveness of community screening programs. JAMA. 1984;251:1580–5. [PubMed] [Google Scholar]
- 22.Fombonne E. The prevalence of autism. JAMA. 2003;289:87–9. doi: 10.1001/jama.289.1.87. [DOI] [PubMed] [Google Scholar]
- 23.Rogers SJ. Developmental regression in autism spectrum disorders. Ment Retard Dev Disabil Res Rev. 2004;10:139–43. doi: 10.1002/mrdd.20027. [DOI] [PubMed] [Google Scholar]
- 24.Chakrabarti S, Fombonne E. Pervasive developmental disorders in pre-school children. JAMA. 2001;285:3093–9. doi: 10.1001/jama.285.24.3093. [DOI] [PubMed] [Google Scholar]
- 25.Kleinman JM, Robins DL, Ventola PE, Pandey J, Boorstein HC, Esser EL, et al. The modified checklist for autism in toddlers: a follow-up study investigating the early detection of autism spectrum disorders. J Autism Dev Disord. 2008;38:827–39. doi: 10.1007/s10803-007-0450-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Pinto-Martin JA, Young LM, Mandell DS, Poghosyan L, Giarelli E, Levy SE. Screening strategies for autism spectrum disorders in pediatric primary care. J Dev Behav Pediatr. 2008;29:345–50. doi: 10.1097/DBP.0b013e31818914cf. [DOI] [PubMed] [Google Scholar]
- 27.Robins DL. Screening for autism spectrum disorders in primary care settings. Autism. 2008;12:537–56. doi: 10.1177/1362361308094502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Baron-Cohen S, Allen J, Gillberg C. Can autism be detected at 18 months? The needle, the haystack, and the CHAT. Br J Psychiatry. 1992;161:839–43. doi: 10.1192/bjp.161.6.839. [DOI] [PubMed] [Google Scholar]
- 29.Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31:131–44. doi: 10.1023/a:1010738829569. [DOI] [PubMed] [Google Scholar]
- 30.Dietz C, Swinkels S, van Daalen E, van Engeland H, Buitelaar JK. Screening for autistic spectrum disorder in children aged 14–15 months. II: population screening with the Early Screening of Autistic Traits Questionnaire (ESAT): design and general findings. J Autism Dev Disord. 2006;36:713–22. doi: 10.1007/s10803-006-0114-1. [DOI] [PubMed] [Google Scholar]
- 31.van Daalen E, Kemner C, Dietz C, Swinkels SH, Buitelaar JK, van Engeland H. Inter-rater reliability and stability of diagnoses of autism spectrum disorder in children identified through screening at a very young age. Eur Child Adolesc Psychiatry. 2009;18:663–74. doi: 10.1007/s00787-009-0025-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Wallace KS, Rogers SJ. Intervening in infancy: implications for autism spectrum disorders. J Child Psychol Psychiatry. 2010 Dec;51(12):1300–20. doi: 10.1111/j.1469-7610.2010.02308.x. [DOI] [PMC free article] [PubMed] [Google Scholar]