Skip to main content
Springer logoLink to Springer
. 2020 May 18;51(3):922–932. doi: 10.1007/s10803-020-04539-8

Functional Outcomes of Children Identified Early in the Developmental Period as at Risk for ASD Utilizing the The Norwegian Mother, Father and Child Cohort Study (MoBa)

Nina Stenberg 1,#, Synnve Schjølberg 2,#, Frederick Shic 5,6, Fred Volkmar 4, Anne-Siri Øyen 2,8, Michaeline Bresnahan 7, Britt Kveim Svendsen 1, Stephen von Tetzchner 9, Nina Torheim Thronæs 3, Suzanne Macari 4, Domenic V Cicchetti 4,#, Katarzyna Chawarska 4, Pål Suren 2, Roald A Øien 3,4,
PMCID: PMC7954713  PMID: 32424708

Abstract

Early identification of autism spectrum disorder (ASD) is regarded as crucial for swift access to early intervention and, subsequently, better outcomes later in life. However, current instruments miss large proportions of children who later go on to be diagnosed with ASD, raising a question of what these instruments measure. The present study utilized data from the Norwegian Mother, Father, and Child Cohort Study and the Autism Birth Cohort study to explore the subsequent developmental and diagnostic characteristics of children raising developmental concern on the six-critical discriminative item criterion of the M-CHAT (DFA6) at 18 months of age (N = 834). The DFA6 identified 28.8% of children diagnosed with ASD (N = 163), but 4.4% with language disorder (N = 188) and 81.3% with intellectual disability (N = 32) without ASD. Scoring in the «at-risk» range was associated with lower IQ, impaired functional language, and greater severity of autism symptoms whether children had ASD or not.

Keywords: MoBa, Norwegian mother, Father and child cohort study, Cognition, Language, Autism spectrum disorders, Vineland, ADOS, Screening, Early identification

Introduction

Early identification of autism spectrum disorder (ASD) is regarded as crucial for prompt access to early intervention, and subsequently, better outcomes later in life (Fernell et al. 2013; Mandell et al. 2005; Zwaigenbaum et al. 2015). Recent studies have revealed that only a small proportion of young children, between 18 and 36 months of age, eventually diagnosed with an autism spectrum disorder (ASD) are captured by screening instruments (Guthrie et al. 2019; Øien et al. 2018b; Stenberg et al. 2014; Surén et al. 2019). Thus, it is essential to determine if children who are diagnosed early show different behavioral characteristics compared to children who are missed. A better understanding of these characteristics may allow providers to identify early interventions that are best suited to a children’s specific needs (Fernell et al. 2013).

Currently, a range of autism-specific screening measures exist that probe for early developmental and behavioral delays or deviancies. The Modified Checklist for Autism in Toddlers (M-CHAT) (Kleinman et al. 2008; Robins et al. 2001) and subsequent M-CHAT Revised with Follow-Up (M-CHAT-R/F) (Robins et al. 2014) are currently the most studied screening instruments for children younger than 36 months. However, studies reveal that the M-CHAT fails to identify the majority of 18-month-olds who are later diagnosed with ASD (Guthrie et al. 2019; Øien et al. 2018a; Stenberg et al. 2014; Sturner et al. 2017). One possible cause of the discrepancy in findings may be that measures implemented in the M-CHAT-R/F aimed to reduce false positives, not to increase the identification of false negatives (Øien et al. 2018a; Stenberg et al. 2014). Additionally, many studies using the M-CHAT and M-CHAT-R/F in large samples only validate the screening results with a full assessment of the screen positives for ASD (Chlebowski et al. 2013; Kleinman et al. 2008; Pandey et al. 2008; Robins et al. 2001, 2014). As a result, these studies are unable to capture false negatives because few screen negatives are reassessed between 18 and 24 months of age, and even fewer are followed later to examine diagnostic status and developmental trajectories.

While the primary rationale for screening is to improve early identification and facilitate swift access to intervention, most screening-related efforts have had a limited effect on decreasing the age of diagnosis. Despite many parents expressing concerns when children are 15 months of age or younger (Chawarska et al. 2006), recent epidemiological studies report that the average age of diagnosis remains between 3 and 5 years (Baio 2012; Baio et al. 2018; Fountain et al. 2011; Mandell et al. 2010; Surén et al. 2019). Further research is needed to delineate the differences in early behavioral characteristics, developmental trajectories, and age of parental concern in early- versus late-diagnosed children with ASD in the general population.

It is essential to address the sparsity of knowledge regarding the variability in developmental and behavioral characteristics of 18-month-old children who are later diagnosed with ASD. A minority of these children meet the threshold to be considered as "at-risk” at 18 months based on screening instruments (Stenberg et al. 2014). It is particularly unclear how the phenotypic presentations of these “at-risk” children later diagnosed with ASD differ from those of autistic children who were not identified by gold-standard screening measures and who would hence have been considered as “low-risk” at 18 months (Beacham et al. 2018; Øien et al. 2018a). Increased knowledge of phenotypic differences associated with screening performance and outcomes is critical for addressing the challenges of identifying a more substantial proportion of children at 18 months that later go on to develop ASD. This is especially true for those children who are not identified by the currently used core symptom patterns expected at 18 months as concurrent or emerging early markers for ASD.

The current knowledge gap is related to the understanding of the association between broader behavioral and developmental characteristics of children at the time of screening, and later developmental outcomes in those identified prospectively with ASD. Because most screening studies are conducted in high-risk samples, less is known about the expression of children missed by screening instruments (i.e., children regarded as "low-risk" after initial screening but receiving a diagnosis later). Understanding which early behavioral and developmental symptoms characterize children who are missed in early screening provides a basis for improving ASD screening instruments and can substantially increase their efficiency in identifying children as early as 18 months of age who are on a path of being diagnosed with ASD. For example, some studies, such as studies of infant siblings of children with ASD, have found that early developmental characteristics (fine motor skills at six months) predicted the severity of ASD symptoms both at 18 and 36 months of age (Iverson et al. 2019). Other studies have found that combining a screening instrument with a general developmental checklist improved the prediction of a later ASD diagnosis (Beacham et al. 2018).

Finally, it is crucial to understand whether screening instrumssents can identify children who are later diagnosed with neurodevelopmental disorders other than ASD (i.e., false positives). Children with more advanced language skills and IQ within the average range might make some toddlers appear more typical. These toddlers often do not meet the threshold for parental or professional concern and, because little is known about the heterogeneity of predictive symptoms of ASD, they are more challenging to identify as at-risk for ASD (Øien et al. 2018a; Salomone et al. 2015; Surén et al. 2019). However, there may be other symptom patterns associated with the development of ASD that have yet to be explored in screener development (Chawarska et al. 2014). It is crucial to understand more about the developmental and behavioral characteristics that predict ASD diagnosis and ASD subgroup identification so that we may tailor screening instruments and increase the performance of early identification. This could enable researchers to identify different subgroups of children later diagnosed with ASD, but who do not early show the types of symptoms enlisted in the current screening instruments.

The aims of the current study are to:

  1. compare child characteristics at the time of clinical diagnostic assessment and relate those to the presence (at-risk) or absence (low-risk) of core ASD symptoms at 18 months, i.e., including both children with early symptoms who were later diagnosed with ASD (true positives), and children with no symptoms, but who were still diagnosed with ASD later (false negatives).

  2. compare developmental characteristics at the clinical assessment of children with and without ASD depending on whether they rated above or below the threshold for concern on core ASD symptoms at 18 months. The four groups (true positives, true negatives, false positives, and false negatives) are compared on measures of (a) cognition (IQ), (b) functional language (Vineland Adaptive Behavior Scales; Communication Domain), and c) ASD symptom severity (ADOS CSS) at the time of clinical assessment.

  3. examine whether the core symptoms (as measured by the screening instrument) for ASD are specific to ASD, or whether measures screening for these symptoms also characterize children with other neurodevelopment diagnoses, i.e., detailing the diagnostic outcome of false positives and false negatives.

Methods

Participants

The present study utilizes data collected in the Autism Birth Cohort study (ABC study) (Stoltenberg et al. 2010). The ABC Study is a sub-study of the Norwegian Mother, Father, and Child Cohort Study (MoBa) (Magnus et al. 2016) aiming to identify all ASD cases within MoBa (Surén et al. 2019). MoBa is a national prospective general population pregnancy cohort conducted by the Norwegian Institute of Public Health. Participants were recruited from all over Norway between 1999 and 2008. The women consented to participation in 41% of the pregnancies and included 114, 552 children, 95,000 mothers, and 75,200 fathers (Magnus et al. 2016). Parents who agreed to participate in MoBa and the ABC Study signed an informed consent form, and the study was approved by the Regional Committee for Medical and Health Research Ethics South East. MoBa data version 9 was used.

The mothers completed questionnaires during pregnancy and at regular intervals after birth, at 6, 18, and 36 months as well as at 5, 7, 8, and 14 years (still ongoing). The MoBa questionnaires include items on child development and behavior as well as health, diet, socioeconomic factors, and other factors relevant to child and parental health. Parents completed the questionnaires independently, without assistance from a health care professional. The clinical assessments in the ABC study started in 2005 and ended in 2012, finalizing the assessment of 1,033 children. Since the end of the clinical assessments, the ABC sample is followed through yearly linkage to the Norwegian Patient Registry (NPR), a national registry containing information about all discharge diagnoses on children who were referred to specialized health services. The study has information about discharge diagnosis from 2008 through 2015.

Recruitment of the Sample

Multiple methods identified potential cases of ASD seen in the ABC study clinic, including MoBa questionnaire information (at child age 3, 5, and 7 years), referrals (parental or professional), and annual linkages to the Norwegian Patient Register (NPR). The clinical study focused primarily on assessing 3-year-olds and utilized six questionnaire-based selection criteria from the 3-year-old questionnaire in MoBa (Q3yr). The selection criteria cast the screening net wide to ensure that all children on the path to a diagnosis of ASD would be captured.

Families endorsing any of the following six specific criteria were invited for a clinical assessment: (Criterion 1) Families of children scoring at or above a cutoff of 12 on the Social Communication Questionnare (SCQ) embedded in Q3yr (see details on the study-specific screening procedures in Stoltenberg et al. 2010, pp.677–678). (Criterion 2) Families of children endorsed on all nine repetitive behavior items on the SCQ. (Criterion 3) Families who reported language delay under the “health problem” section in Q3yr and referred to a language specialist. (Criterion 4) Families who reported "yes" on autism or autistic traits under the "health problem” section in Q3yr, and/or “yes” on autism/Asperger syndrome in Q5yr or Q7yr “health problem” section. (Criterion 5) Families who reported concerns about the child’s lack of interest in playing with other children under the “concern about the child” section. (Criterion 6) Families who reported that others (e.g. family, day-care staff, and well-baby nurses) had expressed concern about the child's development. In addition to the specific criteria based on the 3-year-old questionnaire, both professionals and parents could refer a child with suspected ASD to the study if the family/child were participating in MoBa and the child was born in the same time interval as the questionnaire-recruited children in the study.

Among the 1033 children clinically assessed in the ABC study, 665 were children who met one or more of the high-risk criteria listed above. The remaining 368 comprised the random control group and were drawn from the same cohort in a nested case–control design. For details on the ABC study criteria and results, see (Stoltenberg et al. 2010) and (Surén et al. 2019). After the research clinic ended in 2012, case ascertainment has continued through annual linkage to the NPR. At the last linkage in 2015, only 56 ASD cases were detected through the screening effort and clinical assessments. The vast majority of children with ASD were detected through the registry linkage after the clinical study had ended (Surén et al. 2019).

Study Sample

This study takes advantage of the data collected in the ABC study and focuses primarily on the early developmental history of children who were diagnosed with ASD either in the ABC clinic or later through NPR linkage (the last linkage was done in 2015). The 18-month questionnaire in MoBa contained the complete M-CHAT checklist and was completed long before the ABC study started, and no criteria from this questionnaire were used in the ABC study. Children included in the final study sample had parents who (a) participated in the ABC study and returned the 18-month questionnaire, and (b) completed all of the six most discriminative items from the M-CHAT (Robins et al. 2001). The six discriminative items have better psychometric properties compared to the full M-CHAT in terms of sensitivity and specificity in identifying children with ASD based on their early symptom patterns (Kleinman et al. 2008; Øien et al. 2018a; Pandey et al. 2008; Stenberg et al. 2014). Totaling 834 children, the sample consisted of 539 with potential ASD (81.1% of the potential ASD assessed in the clinic) and 295 random controls (80.2% of controls assessed in the clinic). 547 children were males (65.6%), and 163 were diagnosed with ASD through ABC's clinical assessment or linkage to NPR.

Clinical Diagnosis

ASD diagnoses: The children were assessed in the ABC study clinic by a research-trained team of experienced clinicians (specialists in clinical psychology or child psychiatry). Children were rendered a best-estimate diagnosis according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) utilizing all available information from the clinical assessment. ASD symptoms were evaluated using the Autism Diagnostic Interview-Revised (ADI-R) and the Autism Diagnostic Observation Schedule-Generic (ADOS-G) (Lord et al. 2000). No information from MoBa questionnaires or NPR was available for the research team concerning individual children, i.e., they were blinded to health differences, developmental questions, parental concern, and selection criteria. A diagnostic summary meeting among the research staff after the data collection integrated all available clinical information, and the diagnosis was rendered, along with the certainty of the conclusion.

Measures

Modified Checklist for Autism in Toddlers

The Modified Checklist for Autism in Toddlers (M-CHAT) (Robins et al. 2001) is the most widely used instrument for detecting early symptoms of ASD in young children (Ibaez et al. 2014), designed to be completed in the waiting room by a primary care provider (Robins et al. 2001). It has been recommended for use in toddlers at 18 months of age with a follow-up at 24 months (Bright Futures Steering Committee 2006). This instrument is the best-validated measure of early ASD signs and symptoms. Scores depend on either a six-critical discriminative item criterion (DFA6) or a total-23 item criterion (Total23). The six-critical item criterion is met when failing two or more of the six critical items, whereas the Total23 criterion demands a failure of three or more of any of the 23 items of the M-CHAT. It is recommended to do a follow-up phone interview of screen positives to reduce the number of false positives. Since the introduction of the M-CHAT in 2001, a revision of the checklist was released in 2014 (Robins et al. 2014), still used with the recommended follow-up interview to further reduce the number of false positives. The ABC study did not use any follow-up phone interviews in their design, as it is an epidemiological study, while the current study focuses on the relationship between early symptom patterns and later functional outcome both in children with and without ASD. Failing two or more of the six critical items at 18 months is treated as consistent reporting of core ASD symptoms (i.e., being at-risk). It is not an indication that such a child would be diagnosed with ASD this early, even if an experienced autism specialist evaluated the child at 18 months.

Cognitive Skills

Children's cognitive level was assessed with an appropriate developmental test, depending on age and cognitive level. As a general rule, the Stanford-Binet Intelligence Scales: Fifth Edition (SB-5) (Roid and Pomplun 2012) was the first choice for all children younger than 6 years of age. The SB-5 Brief IQ score (based on two routing-tasks from verbal and non-verbal domains) was calculated if the child did not complete all the subtests. If the child was not able to complete the routing tasks on the SB-5, a switch was made to the Mullen Scales of Early Learning (MSEL) (Mullen 1995). For children who were 6 years or older at clinical assessment, the Wechsler Abbreviated Scale of Intelligence (WASI) (Psychological Corporation 1999) was used, and the SB-5 was administered if the child was not able to complete WASI.

Communication Skills

The Vineland Adaptive Behavior Scales (VABS, 2nd edition) (Sparrow et al. 2005) is a parent interview assessing adaptive skills in four domains, communication, daily living, socialization, and motor. In the current study, the VABS Communication Domain was used to assess language ability, including expressive, receptive, and literacy skills. The standardized score for each domain was used.

Symptom Severity of ASD

The Autism Diagnostic Observation Schedule (ADOS-G) is a semi-structured play- and conversation-based assessment. Module 1, 2, or 3 was administered depending on the child's level of expressive language. The revised algorithm and calibrated severity scores described by Gotham and colleagues (Gotham et al. 2006) were used because they are better suited than the original algorithm scores for comparing ADOS scores across modules. The revised algorithm calculates ADOS summary scores for social and repetitive behavior domains. The calibrated severity scores are less influenced by age and language level than are raw scores (Gotham et al. 2008).

Statistical Analyses

Pearson's chi-squared test (when appropriate) were used to ascertaining between-group differences concerning parent characteristics and age of children. To compare children with ASD with and without core ASD symptoms at 18 months to non-ASD children with and without core ASD symptoms at 18 months, on cognition, functional language and ASD symptom severity, a dummy variable (4 groups) was created combining ASD diagnosis (yes/no) and risk status at 18 months (yes/no). Children in the four groups were compared on (a) cognition (IQ), (b) functional language (VABS), and (c) ASD symptom severity (ADOS-CSS) by conducting a one-way ANOVA with Bonferroni correction for post-hoc analyses (see Table 1). All statistical analyses were performed using SPSS 26.

Table 1.

Child test characteristic across child diagnosis and screening status on DFA6 from M-CHAT

GROUP Children without ASD Children with ASD F P
DFA6 N = 671 N = 163
A
N = 612
B
N = 59
C
N = 116
D
N = 47
Below cut off Cut off or higher Below cut off Cut off or higher
Mean (SD)
 IQa 100.2 (14.1) 73.2 (20.7) 87.9 (20.4) 60.2 (15.3) 133.75*  < .001
 VABSb functional language 95.9 (12.5) 73.2 (15.4) 78.4 (17.2) 61.0 (13.2) 165.54*  < .001
 ADOSc CSS 1.4 (1.1) 2.7 (2.2) 5.2 (2.5) 6.1 (2.7) 284.10*  < .001

All differences significant except group B vs. C on VABS functional language

aWASI, SB-5 or Mullen scales of early development

bVineland Adaptive Behaviour Scale—communication domain

cAutism diagnostic observation schedule 4 N in each group varies due to missing data on outcome measures (from 1 to 8 children missing)

Results

Of the 163 children diagnosed with ASD in the ABC study/NPR linkage, 47 (28.8%) met cut-off or above on DFA6 at 18 months according to early ASD symptoms (at-risk, group D) compared to 116 children with ASD scoring below cut-off according to early ASD symptoms (low-risk, group C). Comparable numbers in the non-ASD group were 59 (8.8%) who met cut-off on DFA6 at 18 months (at-risk, group B) compared to 612 children in the non-ASD group scoring below the cut-off (low-risk, group A). There were significant between-group differences in the proportion of children reaching cut-off on DFA6 across age and sex (see Table 2). In all four groups (A to D), the majority reaching cut-off were boys. The ratio of boys to girls in the ASD groups (C, D) was approximately 7: 1 in the low-risk group and approximately 1.5: 1 in the at-risk group. The comparable ratio in the non-ASD groups (A, B) was 1.5: 1 in the low-risk group and approximately 5.0: 1 in the at-risk group.

Table 2.

Child age and sex across child diagnosis and screening status on DFA6 from M-CHAT

Group Children without ASD Children with ASD F P
DFA6 N = 671 N = 163
A
N = 612
B
N = 59
C
N = 116
D
N = 47
Below cut off Cut off or higher Below cut off Cut off or higher
Age at assessment 3 and 4 years 587 (95.9%) 57 (96.6%) 60 (51.7%) 40 (85.1%) 211.488a  < .001
5 and 6 years 13 (2.1%) 2 (3.4%) 17 (14.7%) 3 ( 6.4%)
7 to 10 years 12 (2.0%) 0 (0.0%) 39 (33.6%) 4 (8.5%)
Sex Male 367 (60.0 &) 49 (83.1%) 101 (87.1%) 30 (63.8%) 40.318 4  < .001
Female 245 (40.0%) 10 (16.9%) 15 (12.9%) 17 (36.2%)

aFisher’s exact test (expected number in cells < 5)

There were no significant between-group differences related to maternal age, maternal education, or parity (see Table 3). Subsequent analyses were conducted on all children (with/without ASD) regardless of risk status at 18 months. This was done to identify child characteristics, possibly contributing to the determination of risk status.

Table 3.

Parental characteristics across child diagnosis and symptom status on DFA6 from M-CHAT

Total N = 834 Group Children without ASD Children with ASD Test statistics P value
DFA6 N = 671 N = 163
A
N = 612
B
N = 59
C
N = 116
D
N = 47
Below cut offa Cut off or higher Below cut off 0 Cut off or higher
Maternal age < 25 years 57 (9.3%) 6 (10.2%) 15 (12.9%) 2 (4.3%) χ2 = 13.916  = .125
25–29 years 185 (30.2%) 12 (20.3%) 39 (33.6%) 22 (46.8%)
30–34 years 240 (39.2%) 28 (47.5%) 46 (39.7%) 16 (34.0%)
> 34 years 130 (21.2%) 13 (22.0%) 16 (13.8%) 7 (14.9%)
Maternal education < 12 yearsb 42 (6.9%) 8 (13.6%) 7 (6.0%) 6 (12.8%) χ2 = 11.607  = .478
12 yearsc 153 (25.0%) 14 (23.7%) 38 (32.8%) 13 (27.7%)
13–16 yearsd 241 (39.4%) 24 (40.7%) 44 (37.9%) 16 (34.0%)
17 yearse 160 (26.1%) 11 (18.6%) 25 (21.6%) 12 (25.5%)
Missing 16 (2.6%) 2 (3.4%) 2 (1.7%) 0 (0.0%)
Parity 0 281 (45.9%) 23 (39.0%) 67 (57.8%) 25 (53.2%) χ2 = 7.839  = .049
1+ 331 (54.1%) 36 (61.0%) 49 (42.2%) 22 (46.8%)

Fisher’s exact test or Pearson’s Chi-squared test

aRated with none or only one ASD symptom

bNot completed high school

cHigh school level

dBachelor level

eMaster/Ph.D. level

Cognition

Analysis of IQ score at the time of clinical assessment indicated a significant association between 18 months risk status (at-risk/low-risk according to whether early ASD symptoms were present or absent) and later cognitive skills (F (3, 816) = 133,749, p < 0.001). Post-hoc analysis revealed that children with at-risk status at 18 months had lower IQ scores at the time of assessment compared to low-risk children, both in the ASD group and non-ASD group. The mean difference in IQ between children below DFA6 cut-off compared to those scoring at cut-off or above were Mdiff = 27.7, CI95% (20.2, 35.2) IQ points in the ASD group, and Mdiff = 26.9, CI95% (21.0, 32.7) in the non-ASD group. Children diagnosed with ASD and scoring below cut-off on DFA6 at 18 months (low-risk) had a mean IQ score at the assessment of M = 87.9, CI95% (84.0, 91.7) compared to children with ASD who scored at or above cut-off with M = 60.2, CI 95% (55.7, 64.7). This indicates an association between showing core ASD symptoms (at-risk) at 18 months and a lower cognitive level (IQ measure) at the time of assessment.

Functional Language

Analyses using standardized scores of functional language (VABS) at the time of assessment indicated a significant association of risk status (at-risk/low-risk on presence/absence of early ASD symptoms) and later functional language skills (F (3, 795) = 165,537, p < 0.001). Post-hoc analysis revealed that children with at-risk status at 18 months, in general, had lower standardized VABS functional language scores at the time of assessment compared to low-risk children, both in the ASD group and non-ASD group. The mean difference in functional language score between children scoring below DFA6 cut-off compared to those scoring at cut-off or above was Mdiff = 17.4, CI95% (11.2, 23.7) in the ASD group, and Mdiff = 22.7, CI95% (17.7, 27.7) in the non-ASD group. Children diagnosed with ASD and scoring below cut-off on DFA6 at 18 months (low-risk) had a mean functional language score at the assessment of M = 78.4, CI95% (75.1, 81.6) compared to children with ASD who scored at or above cut-off with M = 61.0, CI95% (55.7, 64.7). This indicates an association between showing core ASD symptoms at 18 months (at-risk) and lower functional language skills (VABS) at the time of assessment.

ADOS Calibrated Severity Score (ADOS CSS)

Analyses of ADOS symptom severity score at the time of assessment indicated a significant association between risk status (at-risk/low-risk on presence/absence of early ASD symptoms) and later symptom severity (F (3, 825) = 284,101, p < 0.001). Post-hoc analysis revealed that children with at-risk status at 18 months, had higher symptom severity scores at the time of assessment compared to low-risk children, both in the ASD group and non-ASD group. The mean difference in symptom severity score between children scoring below DFA6 cut-off compared to those scoring at cut-off or above were Mdiff = − 1.0, CI95% (− 1.7, − 0.2) in the ASD group and Mdiff = − 1.3, CI95% (− 1.8, − 0.7) in the non-ASD group. Children diagnosed with ASD and scoring below cut-off on DFA6 at 18 months (low-risk) had a mean symptom severity score at the assessment of M = 5.2, CI95% (4.7, 5.6) compared to children with ASD who scored at or above cut-off with M = 6.1, CI 95% (5.3, 6.9). This indicates an association between showing core ASD symptoms at 18 months (at-risk) and higher symptom severity (ADOS-CSS) at the time of assessment.

Other Diagnoses

The DFA6 did not capture the majority of children at 18 months who were diagnosed with ASD at the clinical assessment in the ABC study or from the NPR registry. Thirty percent of the children diagnosed with Autistic Disorder (non-syndromic) did show ASD symptoms at 18 months (at-risk), compared to 22% of those later diagnosed with Asperger syndrome or PDD-NOS at the ABC clinic or in NPR. Seven children identified with ASD in the clinic had a concurrent known syndrome combined with severe intellectual disability (N = 5) or had a history of loss of skills (disintegrative disorder) (N = 2). The two children with loss of skills scored, as expected, below cut-off on DFA6 at 18 months, and the other five ("syndromic ASD") scored at or above cut-off on the DFA6 criterion. To further explore the characteristics of children identified by the DFA6, we also looked at the distribution (below cut-off/above cut-off on DFA6) across other relevant diagnoses in the sample, e.g., specifically children diagnosed with language impairment or with intellectual disability (Table 4).

Table 4.

Diagnostic result across screening status on DFA6 from M-CHAT

N (%) Below cut-off Cut-off or higher Total
No Dx or ClinProbl 288 3 (1.0%) 291
Autistic disorder 65 28 (30.1%) 93
PDD-Nos 49 14 (22.2%) 63
Syndrome ASD or loss of skills 2 5 (71.4%) 7
Intellectual disability (ID) no ASD 6 26 (81.3%) 32
Language disorder (LD) noASD noID 165 23 (4.4%) 188
Other Dx or ClinProbl 153 7 (4.4%) 160
Total 728 106 834

Dx diagnosis, ClinProbl clinical problems, ID intellectual disability, ASD autism spectrum disorder, LD language disorder

The clinical sample comprised of 32 children with a primary diagnosis of Intellectual Disability. Most of these children (N = 26; 81.3%) scored above the six critical item criteria (DFA6). However, in the group of children with a primary diagnosis of Language Impairment at assessment, only approximately one in twenty children (N = 23; 4.4%) scored at or above the DFA6 cut-off at 18 months. In children with no diagnoses or clinical problems, only three scored at or above the six critical item criteria (DFA6) of two or more core ASD symptoms at 18 months (N = 3, 1.0%).

Discussion

The present study compared intellectual level, functional language skills and ASD symptom severity at the age of diagnostic assessment (age range 3–10 years) with ASD at-risk status at 18 months of age based on the symptom score on the six critical items of the M-CHAT (DFA6) and diagnostic outcomes in the ABC study/NPR (ASD, non-ASD). The results indicate an association between parents' recognition of clinical signs of ASD at 18 months (at or above cut-off on DFA6) and the severity of cognitive impairments in children with ASD at diagnostic assessment. Furthermore, children with ASD who showed core ASD symptoms at 18 months (at-risk) scored lower on functional language skills at the clinical assessment and with increased symptom severity (ADOS CSS) score compared to children with ASD who scored below cut-off on DFA6 (low-risk) at 18-months, as is also true for the non-ASD groups as well.

The finding that children with ASD who scored below the cut-off for ASD symptoms (DFA6) at 18 months scored within the average IQ range at assessment, and children with ASD who scored at or above the cut-off for core ASD symptoms at 18 months scored within the intellectual disability range, is consistent with previous reports. Early identification of ASD is associated with general developmental delay and more pronounced cognitive impairment than later identified children, suggesting that a more significant impairment is necessary to raise parental concerns as early as 18 months, or that early symptoms of ASD might be more heterogeneous than those often considered prototypical for ASD (Baghdadli et al. 2003; Chawarska et al. 2006, 2014; Giacomo & Fombonne 1998; Guthrie et al. 2019; Iverson et al. 2019; Øien et al. 2018a; Shattuck et al. 2009). Several population-based studies show that a large proportion of children who later were diagnosed with ASD were not identified by screening instruments at 18 months (Baird et al. 2000; Guthrie et al. 2019; Øien et al. 2018a; Stenberg et al. 2014). It is likely that population-based samples, in contrast to clinical samples (or stage 2 screening), include more children who are within the average range of IQ and functional language skills. Children referred for clinical assessment are likely to be more severely affected and have more prototypical symptoms than children in a general population-based sample. Additionally, in clinical samples, parents are already likely to express concern about their child's development, which might influence how they answer questionnaires and rate symptom patterns. In line with this, commonly used screening instruments seem to perform more ‘accurately' in high-risk samples (i.e., children referred for diagnostic assessment) than in low-risk samples (children attending routine visits to well-baby clinics) (Kleinman et al. 2008; Pandey et al. 2008). This suggests that the instruments are picking up children with ASD who have lower intellectual and adaptive functioning while missing children with more robust general intellectual development and better functional language (Eaves et al. 2016; Kamio et al. 2013; Øien et al. 2018b; Salomone et al. 2015; Snow and Lecavalier 2008). In other words, the performance of screening instruments at an early age, as reported in many high-risk clinical samples, seems biased towards more severe behavioral characteristics of ASD and other atypical developmental phenomena.

Difficulties in identifying children with ASD early in the developmental period are related to the substantial heterogeneity that characterizes ASD (Ozonoff et al. 2010; Zwaigenbaum et al. 2015), affecting both the screening and the diagnostic process. Still, research suggests that ASD can be reliably diagnosed very early (Lord et al. 2006) and that early diagnoses of ASD are stable (Chawarska et al. 2007; Ozonoff et al. 2015). Another contributing factor is the possibility that a large proportion of children developing ASD do not show the prototypical signs of ASD at 18 months. ASD is a developmental disorder, and symptoms often emerge gradually. It is not known whether a different set of descriptors better captures key characteristics in children missed by current instruments or if the behavioral characteristics of these children are more subtle and thus cannot meet actionable concern. Such challenges make it difficult to construct an appropriate checklist with the salient symptom description relevant at an early age for the whole spectrum of children with ASD (Øien, Schjølberg, et al. 2018a, b). There are indications that children need to show more significant impairment to be identified by screening instruments (Baghdadli et al. 2003; Giacomo and Fombonne 1998; Shattuck et al. 2009). One possibility is that subgroups of children with ASD might show differences in developmental trajectories throughout the first years of life, both in symptom pattern and in heterogeneity in age when features of autism begin to manifest and in a variation of when social demands exceed the child's capabilities (Chawarska et al. 2006). The findings of the present study suggest that future research should focus on mapping the developmental trajectories of children with the aim of understanding factors that contribute to a child’s at-risk or low-risk status at various times in early development. Further, future research should aim to relate these findings to long-term outcome developmentally, behaviorally and diagnostically. Such knowledge might lead to the development of new methods and insights in early identification of children with lower symptom severity and cognitive impairment and to a better understanding of developmental processes underlying the emergence of autism features in higher-functioning children with ASD at an early age. It is possible that broader developmental measures (e.g. motor development and temperament) might prove useful and eventually contribute to a better understanding of the variability in early trajectories and hence contribute to a decrease in the age of diagnosis across the whole spectrum.

Findings from this study and other studies (Guthrie et al. 2019; Øien et al. 2018a; Stenberg et al. 2014; Yuen et al. 2018) warrant a meaningful discussion on the feasibility of universal screening at 18 months and give directions for moving to capture different phenotypical variants of autism spectrum disorder at an early age. In this study, the early at-risk score was defined at 18 months based on the six critical items from M-CHAT and was related to diagnostic conclusions several years later. It might be necessary to revisit our determination of prototypical early developmental features of ASD. One strategy for follow-up would be to utilize a broad set of assessment tools to capture characteristics and changes in behavior patterns across age and to look specifically at the developmental trajectories of children with ASD who have preserved language and intellectual abilities. The fact that some of these children are identified early, both by parents and professionals, should bring forward opportunities to study their development in greater detail. At present, studies indicate that finding one single measure to identify all ASD-relevant developmental profiles of delayed and deviant behavior in early childhood might be utopian at this point, and that such measures might be close to or impossible to construct due to the heterogeneous nature of ASD. However, it is essential to follow the same goal-directed course as Robins and Colleagues on the M-CHAT and the later M-CHAT-R (Robins et al. 2001, 2014). Over almost two decades, they have provided the field with the measures that currently –in spite of their shortcomings– are regarded as the gold standard of screening instruments. In the end, the best approach to early identification may be to combine multiple measures and to consider parental concern as “red-flags,” even when concern for prototypical signs of ASD are not present. As Mick Jagger and Keith Richards sing: “You can’t always get what you want” might also apply to the possibility of developing one measure to identify all children with ASD. It may be necessary to envision a gold standard, in terms of psychometric properties, for screening instruments for early detection as relative rather than absolute (Øien et al. 2019).

Strengths and Limitations

Previous studies in the field of early identification of children with ASD have mostly used clinical samples and retrospective data collection. The principal strength of this study is prospective data collection and information about signs of ASD before the diagnosis has been established. The MoBa cohort is population-based; thus, both children with mild and severe ASD symptoms are included in the study.

Only six items on ASD characteristics at 18 months were used for the analyses in the present study. In a previous study, we found that the three M-CHAT items that contributed to the highest likelihood ratios for ASD (the proportion of screen-positives among ASD cases relative to the proportion of screen-positives among non-cases) were among these six items that had been found in other studies to be most critical for distinguishing ASD (Stenberg et al. 2014).

Most population-based studies are affected by selection bias. Compared with the Norwegian birth cohort, the MoBa cohort and the ABC Study cohort have an under-representation of young mothers (< 25 years), mothers who have single status, mothers who smoked during pregnancy, and non-users of prenatal folic acid supplements (Nilsen et al. 2009, 2013).

Different methods were used to assess intellectual level due to the age span and different levels of intellectual ability in our sample. This is not optimal because different IQ measures are normed on different samples. However, the IQ difference between at-risk and low-risk 18-month-old children in the current study was so substantial that we would not expect this to be an effect of the different IQ measures in of itself. All IQs were calculated based on US norms because Norwegian norms were not yet available for WASI, SB-5, or Mullen.

Acknowledgments

Open Access funding provided by UiT The Arctic University of Norway. The Norwegian Mother, Father and Child Cohort Study is supported by the Norwegian Ministry of Health and Care Services and the Ministry of Education and Research. We are grateful to all the participating families in Norway who take part in this on-going cohort study. The authors would like to acknowledge and thank all participating families and their children. Furthermore, we want to acknowledge the help of Madeline Aubertine, Minhang Xie, and Katherine Riley of the Seattle Children’s Research Institute in the editing process of this article.

Author Contributions

NS, SS, and RAØ designed and conducted the analyses, drafted the manuscript and revised according to input from co authors. FS, FRV, ASØ, MB, BKS, SvT, DVC, KC, PS, and NTT reviewed, revised and provided input and editing of the manuscript. All authors approved the final submission.

Compliance with Ethical Standards

Conflict of interest

The Autism Birth Cohort Study is funded by the National Institute of Neurological Disorders and Stroke (NIH/NINDS), Bethesda, MD, USA (Grant No. NS47537). The Norwegian Mother and Child Cohort Study is funded by the Norwegian Ministry of Health and Care Services, the Norwegian Ministry of Education and Research, the Research Council of Norway / FUGE (Grant No. 151918), the National Institute of Neurological Disorders and Stroke (NIH/NINDS), Bethesda, MD, USA (Grant No. NS47537), and the National Institute of Environmental Health Sciences (NIH/NIEHS), Research Triangle Park, NC, USA (Contract No. NO-ES-75558). The present study was supported by a grant from the Research Council of Norway (Grant No. 196452). The authors report no conflicts of interest.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Nina Stenberg and Synnve Schjølberg share the first authorship of the present manuscript.

Domenic V. Cicchetti deceased before the completion of the present manuscript were publication.

References

  1. Baghdadli A, Picot MC, Pascal CL, Pry R, Aussilloux C. Relationship between age of recognition of first disturbances and severity in young children with autism. European Child & Adolescent Psychiatry. 2003;12(3):122–127. doi: 10.1007/s00787-003-0314-6. [DOI] [PubMed] [Google Scholar]
  2. Baird G, Charman T, Baron-Cohen S, Cox A, Swettenham J, Wheelwright S, Drew A. A screening instrument for autism at 18 months of age: A 6-year follow-up study. Journal of the American Academy of Child & Adolescent Psychiatry. 2000;39(6):694–702. doi: 10.1097/00004583-200006000-00007. [DOI] [PubMed] [Google Scholar]
  3. Baio, J. (2012). Prevalence of autism spectrum disorders: Autism and developmental disabilities monitoring network, 14 Sites, United States, 2008. Morbidity and Mortality Weekly Report. Surveillance Summaries, 61(3). [PubMed]
  4. Baio, J., Wiggins, L., Christensen, D., Maenner, M., Daniels, J., Warren, Z., et al. (2018). Prevalence of autism spectrum disorder among children aged 8 years—Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2014. Morbidity and Mortality Weekly Report. Surveillance Summaries, 67(6), 1–23. 10.15585/mmwr.ss6706a1. [DOI] [PMC free article] [PubMed]
  5. Beacham C, Reid M, Bradshaw J, Lambha M, Evans L, Gillespie S, Klaiman C, Richardson SS. Screening for autism spectrum disorder: Profiles of children who are missed. Journal of Developmental and Behavioral Pediatrics: JDBP. 2018;39(9):673–682. doi: 10.1097/dbp.0000000000000607. [DOI] [PubMed] [Google Scholar]
  6. Bright Futures Steering Committee Identifying infants and young children with developmental disorders in the medical home: An algorithm for developmental surveillance and screening. Pediatrics. 2006;118(1):405–420. doi: 10.1542/peds.2006-1231. [DOI] [PubMed] [Google Scholar]
  7. Chawarska K, Klin A, Paul R, Volkmar F. Autism spectrum disorder in the second year: Stability and change in syndrome expression. Journal of Child Psychology and Psychiatry. 2007;48(2):128–138. doi: 10.1111/j.1469-7610.2006.01685.x. [DOI] [PubMed] [Google Scholar]
  8. Chawarska K, Paul R, Klin A, Hannigen S, Dichtel LE, Volkmar F. Parental recognition of developmental problems in toddlers with autism spectrum disorders. Journal of Autism and Developmental Disorders. 2006;37(1):62–72. doi: 10.1007/s10803-006-0330-8. [DOI] [PubMed] [Google Scholar]
  9. Chawarska K, Shic F, Macari S, Campbell DJ, Brian J, Landa R, Hutman T, Nelson CA, Ozonoff S, Tager-Flusberg H, Young GS, Zwaigenbaum L, Cohen IL, Charman T, Messinger DS, Klin A, Johnson S, Bryson S. 18-month predictors of later outcomes in younger siblings of children with autism spectrum disorder: A baby siblings research consortium study. Journal of the American Academy of Child & Adolescent Psychiatry. 2014;53(12):1317–1327. doi: 10.1016/j.jaac.2014.09.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Chlebowski C, Robins DL, Barton ML, Fein D. Large-scale use of the modified checklist for autism in low-risk toddlers. Pediatrics. 2013;131(4):e1121–e1127. doi: 10.1542/peds.2012-1525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Eaves LC, Wingert H, Ho HH. Screening for autism: Agreement with diagnosis. Autism. 2016;10(3):229–242. doi: 10.1177/1362361306063288. [DOI] [PubMed] [Google Scholar]
  12. Fernell E, Eriksson MA, Gillberg C. Early diagnosis of autism and impact on prognosis: A narrative review. Clinical Epidemiology. 2013;5(1):33–43. doi: 10.2147/clep.s41714. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Fountain C, King M, Bearman P. Age of diagnosis for autism: Individual and community factors across 10 birth cohorts. Journal of Epidemiology and Community Health. 2011;65(6):503–510. doi: 10.1136/jech.2009.104588. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Giacomo AD, Fombonne E. Parental recognition of developmental abnormalities in autism. European Child & Adolescent Psychiatry. 1998;7(3):131–136. doi: 10.1007/s007870050058. [DOI] [PubMed] [Google Scholar]
  15. Gotham K, Pickles A, Lord C. Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders. 2008;39(5):693–705. doi: 10.1007/s10803-008-0674-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Gotham K, Risi S, Pickles A, Lord C. The autism diagnostic observation schedule: Revised algorithms for improved diagnostic validity. Journal of Autism and Developmental Disorders. 2006;37(4):613–627. doi: 10.1007/s10803-006-0280-1. [DOI] [PubMed] [Google Scholar]
  17. Guthrie W, Wallis K, Bennett A, Brooks E, Dudley J, Gerdes M, Pandey J, Levy SE, Schultz RT, Miller JS. Accuracy of autism screening in a large pediatric network. Pediatrics. 2019;144(4):e20183963. doi: 10.1542/peds.2018-3963. [DOI] [PubMed] [Google Scholar]
  18. Ibaez LV, Stone WL, Coonrod EE. Screening for autism in young children Handbook of autism and pervasive developmental disorders. 4. New York: Wiley; 2014. [Google Scholar]
  19. Iverson JM, Shic F, Wall CA, Chawarska K, Curtin S, Estes A, Gardner JM, Hutman T, Landa RJ, Levin AR, Libertus K, Messinger DS, Nelson CA, Ozonoff S, Sacrey L-AR, Sheperd K, Stone WL, Tager-Flusberg HB, Wolff JJ, et al. Early motor abilities in infants at heightened versus low risk for ASD: A Baby Siblings Research Consortium (BSRC) study. Journal of Abnormal Psychology. 2019;128(1):69–80. doi: 10.1037/abn0000390. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Kamio Y, Inada N, Koyama T, Inokuchi E, Tsuchiya K, Kuroda M. Effectiveness of using the modified checklist for autism in toddlers in two-stage screening of autism spectrum disorder at the 18-month health check-up in Japan. Journal of Autism and Developmental Disorders. 2013;44(1):194–203. doi: 10.1007/s10803-013-1864-1. [DOI] [PubMed] [Google Scholar]
  21. Kleinman JM, Robins DL, Ventola PE, Pandey J, Boorstein HC, Esser EL, Wilson LB, Rosenthal MA, Sutera S, Verbalis AD, Barton M, Hodgson S, Green J, Dumont-Mathieu T, Volkmar F, Chawarska K, Klin A, Fein D. The modified checklist for autism in toddlers: A follow-up study investigating the early detection of autism spectrum disorders. Journal of Autism and Developmental Disorders. 2008;38(5):827–839. doi: 10.1007/s10803-007-0450-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Lord C, Risi S, DiLavore PS, Shulman C, Thurm A, Pickles A. Autism from 2 to 9 years of age. Archives of General Psychiatry. 2006;63(6):694–701. doi: 10.1001/archpsyc.63.6.694. [DOI] [PubMed] [Google Scholar]
  23. Lord C, Risi S, Lambrecht L, Cook EH, Leventhal BL, DiLavore PC, Pickles A, Rutter M. The autism diagnostic observation schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders. 2000;30(3):205–223. doi: 10.1023/a:1005592401947. [DOI] [PubMed] [Google Scholar]
  24. Magnus P, Birke C, Vejrup K, Haugan A, Alsaker E, Daltveit AK, Handal M, Haugen M, Høiseth G, Knudsen GP, Paltiel L, Schreuder P, Tambs K, Vold L, Stoltenberg C. Cohort profile update: The Norwegian mother and child cohort study (MoBa) International Journal of Epidemiology. 2016;45(2):382–388. doi: 10.1093/ije/dyw029. [DOI] [PubMed] [Google Scholar]
  25. Mandell D, Novak M, Zubritsky C. Factors associated with age of diagnosis among children with autism spectrum disorders. Pediatrics. 2005;116(6):1480–1486. doi: 10.1542/peds.2005-0185. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Mandell, D., Morales, K., M.S., M., Lawer, L., Stahmer, A., & Marcus, S. (2010). Age of diagnosis among medicaid-enrolled children with autism, 2001–2004. Psychiatric Services, 61(8), 822–829. 10.1176/ps.2010.61.8.822. [DOI] [PMC free article] [PubMed]
  27. Mullen EM. Mullen scales of early learning. Circle Pines, MN: AGS; 1995. pp. 58–64. [Google Scholar]
  28. Nilsen RM, Surén P, Gunnes N, Alsaker ER, Bresnahan M, Hirtz D, Hornig M, Lie KK, Lipkin WI, Kjennerud TR, Roth C, Schjølberg S, Smith GD, Susser E, Vollset SE, Øyen AS, Magnus P, Stoltenberg C. Analysis of self-selection bias in a population-based cohort study of autism spectrum disorders. Paediatric and Perinatal Epidemiology. 2013;27(6):553–563. doi: 10.1111/ppe.12077. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Nilsen RM, Vollset SE, Gjessing HK, Skjærven R, Melve KK, Schreuder P, Alsaker ER, Haug K, Daltveit AK, Magnus P. Self-selection and bias in a large prospective pregnancy cohort in Norway. Paediatric and Perinatal Epidemiology. 2009;23(6):597–608. doi: 10.1111/j.1365-3016.2009.01062.x. [DOI] [PubMed] [Google Scholar]
  30. Øien RA, Klin A, Saulnier C, Chawarska K, McPartland JC, Nordahl-Hansen A, Volkmar FR. In memoriam: Domenic V. Cicchetti, PhD, 1937–2019. Journal of Autism and Developmental Disorders. 2019;49(9):3475–3476. doi: 10.1007/s10803-019-04143-5. [DOI] [Google Scholar]
  31. Øien RA, Schjølberg S, Volkmar FR, Shic F, Cicchetti DV, Nordahl-Hansen A, Stenberg N, Hornig M, Havdahl A, Øyen AS, Ventola P, Susser ES, Eisemann MR, Chawarska K. Clinical features of children with autism who passed 18-month screening. Pediatrics. 2018;141(6):e20173596. doi: 10.1542/peds.2017-3596. [DOI] [PubMed] [Google Scholar]
  32. Øien RA, Vambheim SM, Hart L, Nordahl-Hansen A, Erickson C, Wink L, Eisemann MR, Shic F, Volkmar FR, Grodberg D. Sex-differences in children referred for assessment: An exploratory analysis of the autism mental status exam (AMSE) Journal of Autism and Developmental Disorders. 2018;48(7):2286–2292. doi: 10.1007/s10803-018-3488-y. [DOI] [PubMed] [Google Scholar]
  33. Ozonoff S, Iosif AM, Baguio F, Cook IC, Hill MM, Hutman T, Rogers SJ, Rozga A, Sangha S, Sigman M, Steinfeld MB, Young GS. A prospective study of the emergence of early behavioral signs of autism. Journal of the American Academy of Child & Adolescent Psychiatry. 2010;49(3):256–266.e2. doi: 10.1016/j.jaac.2009.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Ozonoff S, Young GS, Landa RJ, Brian J, Bryson S, Charman T, Chawarska K, Macari SL, Messinger D, Stone WL, Zwaigenbaum L, Iosif AM. Diagnostic stability in young children at risk for autism spectrum disorder: A baby siblings research consortium study. Journal of Child Psychology and Psychiatry. 2015;56(9):988–998. doi: 10.1111/jcpp.12421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Psychological Corporation . Wechsler abbreviated scale of intelligence. San Antonio, TX: The Psychological Corporation; 1999. [Google Scholar]
  36. Pandey J, Verbalis A, Robins DL, Boorstein H, Klin A, Babitz T, Chawarska K, Volkmar F, Green J, Barton M, Fein D. Screening for autism in older and younger toddlers with the Modified Checklist for Autism in Toddlers. Autism. 2008;12(5):513–535. doi: 10.1177/1362361308094503. [DOI] [PubMed] [Google Scholar]
  37. Robins DL, Casagrande K, Barton M, Chen C-MA, Dumont-Mathieu T, Fein D. Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHAT-R/F) Pediatrics. 2014;133(1):37–45. doi: 10.1542/peds.2013-1813. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: An initial study investigating the early detection of autism and pervasive developmental disorders. Journal of Autism and Developmental Disorders. 2001;31(2):131–144. doi: 10.1023/a:1010738829569. [DOI] [PubMed] [Google Scholar]
  39. Roid GH, Pomplun M. The stanford-binet intelligence scales. New York: The Guilford Press; 2012. [Google Scholar]
  40. Salomone E, Beranová Š, Bonnet-Brilhault F, Lauritsen MB, Budisteanu M, Buitelaar J, et al. Use of early intervention for young children with autism spectrum disorder across Europe. Autism. 2015;20(2):233–249. doi: 10.1177/1362361315577218. [DOI] [PubMed] [Google Scholar]
  41. Shattuck PT, Durkin M, Maenner M, Newschaffer C, Mandell DS, Wiggins L, Lee L-C, Rice C, Giarelli E, Kirby R, Baio J, Pinto-Martin J, Cuniff C. Timing of identification among children with an autism spectrum disorder: Findings from a population-based surveillance study. Journal of the American Academy of Child & Adolescent Psychiatry. 2009;48(5):474–483. doi: 10.1097/chi.0b013e31819b3848. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Snow AV, Lecavalier L. Sensitivity and specificity of the Modified Checklist for Autism in Toddlers and the Social Communication Questionnaire in preschoolers suspected of having pervasive developmental disorders. Autism. 2008;12(6):627–644. doi: 10.1177/1362361308097116. [DOI] [PubMed] [Google Scholar]
  43. Sparrow SS, Cicchetti DV, Balla DA. Vineland adaptive behavior scales:(Vineland II), survey interview form/caregiver rating form. Livonia, MN: Pearson Assessments; 2005. [Google Scholar]
  44. Stenberg N, Bresnahan M, Gunnes N, Hirtz D, Hornig M, Lie KK, Lipkin WI, Lord C, Magnus P, Kjennerud TR, Schjølberg S, Surén P, Susser E, Svendsen BK, Tetzchner S, Øyen AS, Stoltenberg C. Identifying children with autism spectrum disorder at 18 months in a general population sample. Paediatric and Perinatal Epidemiology. 2014;28(3):255–262. doi: 10.1111/ppe.12114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Stoltenberg C, Schjølberg S, Bresnahan M, Hornig M, Hirtz D, Dahl C, Lie KK, Reichborn-Kjennerud T, Schreuder P, Alsaker E, Øyen A-S, Magnus P, Surén P, Susser E, Lipkin WI. The Autism Birth Cohort: A paradigm for gene-environment-timing research. Molecular Psychiatry. 2010;15(7):676–680. doi: 10.1038/mp.2009.143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Sturner R, Howard B, Bergmann P, Morrel T, Landa R, Walton K, Marks D. Accurate autism screening at the 18-month well-child visit requires different strategies than at 24 months. Journal of Autism and Developmental Disorders. 2017;47(10):3296–3310. doi: 10.1007/s10803-017-3231-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Surén P, Saasen-Havdahl A, Bresnahan M, Hirtz D, Hornig M, Lord C, Kjennerud TR, Schjølberg S, Øyen AS, Magnus P, Susser E, Lipkin WI, Stoltenberg C. Sensitivity and specificity of early screening for autism. BJPsych Open. 2019;5(3):e41. doi: 10.1192/bjo.2019.34. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Yuen T, Carter MT, Szatmari P, Ungar WJ. Cost-effectiveness of universal or high-risk screening compared to surveillance monitoring in autism spectrum disorder. Journal of Autism and Developmental Disorders. 2018;48(9):2968–2979. doi: 10.1007/s10803-018-3571-4. [DOI] [PubMed] [Google Scholar]
  49. Zwaigenbaum L, Bauman ML, Fein D, Pierce K, Buie T, Davis PA, et al. Early screening of autism spectrum disorder: Recommendations for practice and research. Pediatrics. 2015;136(Supplement):S41–S59. doi: 10.1542/peds.2014-3667d. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of Autism and Developmental Disorders are provided here courtesy of Springer

RESOURCES