Abstract
Objective
Atypical development, behavioral difficulties, and academic underachievement are common morbidities in children with a history of congenital heart defects and impact quality of life. Language and social-cognitive deficits have been described, which are associated with autism spectrum disorders. The current study aimed to assess the rates of autism spectrum disorders in a large sample of children with a history of congenital heart defects and to assess medical, behavioral, and individual factors that may be associated with the risk of autism spectrum disorders.
Design
Participants included 195 children with a history of congenital heart defects, who are followed in a large-scale longitudinal study. Measures included behavioral data from 4-year-old neurodevelopmental evaluations and parent-report data from a later annual follow-up.
Results
Using established cut-offs on an autism spectrum disorder screener, children with congenital heart defects showed higher rates of “possible” autism spectrum disorders than national rates, (Chi-square Test of Equal Proportions), all ps < .05. A stepwise variable selection method was used to create a “best prediction model” and multivariable logistic regression was used to identify variables predicting diagnostic status. Factors associated with diagnostic risk included medical (delayed sternal closure, prematurity, positive genetic findings), behavioral (cognitive, language, attention issues), and individual (socioeconomic, cultural/racial) variables. ROC analyses identified a cut-off of 7 to maximize sensitivity/specificity based on parent-reported diagnosis.
Conclusions
Risk of autism spectrum disorder-screening status in children with congenital heart defects was higher than expected from population rates. Findings highlight the need for referral to a specialist to assess the presence and severity of social-communication issues and congenital heart defects population-specific screening thresholds for children with concern for autism spectrum disorders.
Keywords: autism, serious congenital heart defects, APOE genotype
Introduction
With significant advances in medical management, children with serious congenital heart defects (CHD) are surviving into adolescence. Delayed and atypical development, behavioral difficulties, and academic underachievement together are more common morbidities in this population than chronic or later medical complications (e.g., unplanned operations).1 Furthermore, neurodevelopmental and behavioral concerns have an impact on the quality of life, and ultimate educational and occupational attainments.1 A better understanding of the developmental challenges in this population will promote appropriate clinical care, service delivery and, hopefully, outcomes.
Multiple studies have shown that children with surgically-corrected CHD demonstrate significantly more neuropsychological difficulties than typically-developing children.2,3 Furthermore, researchers have suggested that children with CHD may be at increased risk for social-cognitive and social-communication deficits4, similar to those characteristic of children with autism spectrum disorders (ASDs).5 Neufield and colleagues (2008) reported that four children in their sample of 65 five-year olds with a history of transposition of the great arteries (TGA) and an arterial switch operation met criteria for an ASD. 6 Longitudinal follow-up studies with individuals with a history of severe CHD suggest that issues with social cognition and self-reported ASD-associated traits continue into adolescence.7,8 These findings highlight the potential severity and chronicity of social issues.
Additionally, past research has highlighted the complex interplay between genetic susceptibility, medical intervention, and increasing developmental/academic expectations for children with CHD, underscoring the need to understand both the trajectory of behavioral outcomes and the contributing risk factors.9 Neurobehavioral outcomes are likely related to a complex interaction of individual (e.g., genetic susceptibility, ethnicity, birth weight) and medical management factors.10
Overall, the literature highlights significant inter-individual variation in developmental outcomes1 and the need for early intervention11 and special education.12 Therefore, an accurate assessment of the proportion of children in this population screening positive for an ASD and the factors contributing to their diagnostic status is essential to inform future research efforts and clinical management. The relationship between medical and patient factors and an ASD diagnosis may elucidate a clearer predictive relationship for social concerns.
The research questions addressed in this manuscript are as follows: first, are children with a history of serious CHD and infant surgery at increased risk for positive results on a ASD screener relative to the general population?13 Second, what are the relative contributions of individual/genetic, behavioral, and medical management factors to the likelihood of screening positive for an ASD? The information gained through this investigation will directly inform patient care, service delivery, and research efforts to decrease morbidity in this developmentally-vulnerable population.
Methods
Participants
Children in the current study were participants in a large cohort with CHD previously described through longitudinal neurodevelopmental evaluations.9 Briefly, data were collected as part of a prospective study of neurodevelopmental outcomes in children with apo-lipoprotein E (APOE) polymorphisms after infant cardiac surgery. Data collection was approved by The Children's Hospital of Philadelphia Institutional Review Board. The original sample consisted of neonates and infants who required surgical repair of congenital heart disease between 1998 and 2003. Eligibility requirements included surgery within the first six months of life for the treatment of serious CHD. Surgical interventions involved cardiopulmonary bypass, with or without DHCA. Exclusion criteria included (1) multiple congenital abnormalities, (2) recognizable genetic/phenotypic syndrome other than chromosome 22q11.2 microdeletion syndrome, and (3) language other than English spoken in the home. Participants in the current study were not recruited due to a specific concern regarding social development, but rather were evaluated in the context of routine follow-up and developmental tracking of this vulnerable population.
The original study group included 675 eligible infants, with 550 (81%) enrolled.9 APOE genotyping was completed with 540 (98%) of the enrolled children; of these participants, 486 were alive and eligible for follow-up between their fourth and fifth birthdays, of which 381 (78%) participated. As previously reported, the only significant difference between those who did and did not participate in the 4-year-old follow-up was underrepresentation of patients who identified their ethnicity as “Black, Non-Hispanic” (21% versus 29%).9 Detailed neurodevelopmental findings from the 4-year-old examinations are presented in Gaynor et al. (2010).14
As part of subsequent follow-up, 381 participants were mailed parent-report questionnaires in 2010 (two-to-seven years after their 4-year-old evaluation). Of the remaining eligible participants, 216 (56%) returned completed packets; 195 completed both the 4-year-old evaluation and the subsequent mailing and were therefore included in the current risk model analyses.1 Demographic information for the original sample is presented in Table 1.
Table 1. Participant Characteristics.
Baseline (N=550) | 4-Year Follow Up (N=381) | |
---|---|---|
Age* | 4.79 (0.2) | 9.83 (1.3) |
Age at First Surgery (Days)* | 41.04 (53.1) | 42.36 (53.9) |
Sex** | ||
Female | 229 (41.6%) | 165 (43.3%) |
Male | 312 (58.4%) | 216 (56.7%) |
Birth Weight (kg)* | 3.08 (0.7) | 3.12 (0.6) |
Gestational Age (weeks)* | 38.36 (2.3) | 38.45 (2.1) |
Ethnicity** | ||
APOE Genotype | ||
∊2∊2 | 3 (0.5%) | |
∊2∊3 | 64 (12%) | |
∊2∊4 | 14 (3%) | |
∊3∊3 | 323 (59%) | |
∊3∊4 | 124 (23%) | |
∊4∊4 | 12 (2%) | |
Diagnostic Groups | ||
Hypoplastic left heart syndrome | 121 (22%) | |
Tetralogy of Fallot | 83 (15%) | |
Ventricular septal defects with or without coarctation | 77 (14%) | |
Transposition of the great arteries | 45 (8%) | |
Genetic Category**† | ||
Normal | 332 (60.4%) | 296 (77.7%) |
Suspect/Abnormal/Unknown | 218 (39.6%) | 85 (22.3%) |
Race/Ethnicity**† | ||
American Indian/Alaskan Native | 7 (1.3%) | 7 (1.8%) |
Asian | 17 (3.1%) | 15 (3.9%) |
Black | 126 (22.9%) | 80 (21.0%) |
Hispanic | 31 (5.6%) | 18 (4.7%) |
Other | 11 (2.0%) | 0 (0%) |
White | 358 (65.1%) | 261 (68.5%) |
Delayed Sternal Closure*†† | 0.14 (0.3) | 0.11 (0.3) |
Mother's Level of Education** | ||
Less Than High School | - | 19 (5.0%) |
High School/Some College | - | 164 (43.3%) |
College | - | 132 (34.8%) |
Graduate School or More | - | 64 (16.9%) |
Socioeconomic Status** | ||
Menial Service Workers | - | 13 (3.4%) |
Semi-Skilled Workers | - | 31 (8.2%) |
Clerical/Sales Workers | - | 78 (20.6%) |
Technical/Minor Professionals | - | 120 (31.7%) |
Business/Professionals | - | 137 (36.2%) |
CBCL PDP (T-score)* | - | 55.36 (7.7) |
WPPSI-III FSIQ (Standard Score)* | - | 95.02 (19.1) |
Note.
Data presented in Mean (SD)
Data presented in N (%)
CBCL PDP, Child Behavior Checklist Pervasive Developmental Problems; WPPSI-III FSIQ, Wechsler Preschool and Primary Scale of Intelligence, Third Edition Full Scale IQ
When comparing the current sample of children compared to the original sample, differences of p < .0001 and
p = .003 were observed; all other comparisons resulted in p > .05.
Measures
Measures in the current analyses included selected assessment tools from the 4-year-old neurodevelopmental evaluations and parent-report information/questionnaires from the subsequent 2010 mailing. Relevant measures are listed in Table 2.15
Table 2. 2010 Mailing and Four-Year Evaluation Assessment Tools.
Name | Description | |
---|---|---|
Child Behavior Checklist (CBCL) | Parent-report questionnaire of atypical development; the CBCL Pervasive Developmental Problems (PDP) scale has high sensitivity and specificity when detecting atypical development more generally, but sensitivity and specificity are lower when differentiating ASDs from other categories of atypical development.1 | 4-year follow up |
Expressive One-Word Picture Vocabulary Test, Third Edition (EOWPVT-III) | Clinician-administered assessment of expressive vocabulary | 4-year follow up |
ADHD Rating Scale, Fourth Edition (ADHD-IV) | Parent-report measure of symptoms associated with attention-deficit/hyperactivity disorder | 4-year follow up |
Preschool Language Scale, Fourth Edition (PLS-4) | Clinician-administered assessment of expressive and receptive language | 4-year follow up |
Preschool and Kindergarten Behavior Scales (PKBS) | Parent-report rating scale of social skills and problem behavior | 4-year follow up |
Wechsler Preschool and Primary Scale of Intelligence, Third Edition (WPPSI-III) | Clinician-administered, standardized assessment of intellectual functioning | 4-year follow up |
SCQ | Parent-completed questionnaire that is widely used to screen children (mental age > 4 years) for ASDs. The SCQ is not a diagnostic instrument, but rather a tool for identifying children who should be referred for a more comprehensive evaluation. The Lifetime Form of the SCQ gathers data on a child's entire developmental history. | 2010 Annual follow-up |
Annual Follow-Up Survey | Parent-completed history form of current demographic, family, health, and educational status, which included questions about ASDs | 2010 Annual follow-up |
Note:
Narzisi A, Calderoni S, Maestro S, Calugi S, Mottes E, Muratori F. Child Behavior Check List 1½-5 as a tool to identify toddlers with autism spectrum disorders: A case-control study. Res Dev Disabil. 2013;34(4):1179-1189. doi:10.1016/j.ridd.2012.12.020.
From the 2010 mailing, parent-report of an ASD (via the health history from) was used as a clinical marker of ASD diagnosis. More specifically, parents were asked “Have you ever been told your child has: (Check any that apply) Autism, Asperger syndrome, pervasive developmental disorder (PPD)” among other options. The Social Communication Questionnaire (SCQ) was used as a parent-report screening measure for ASD.16 A sum score of ≥ 15 indicates a “possible” ASD. The SCQ aims to quantify the extent to which social and communicative functioning is consistent with a diagnosis of an ASD. A comprehensive, neurodevelopmental diagnostic evaluation is required to confirm clinical diagnoses; however, the SCQ has been shown to be the most efficacious ASD screening tool,17 parallel the gold standard diagnostic measures (e.g., Autism Diagnostic Observation Schedule and Autism Diagnostic Interview, Revised), and has been used to characterize ASD prevalence in other patient groups.18,19 According to the creators of the SCQ, a lower cutoff scores (≥ 12) could be considered for investigations with younger individuals and with informants who are less familiar with the traits/behaviors associated with autism than the original norming sample.20 Other researchers have also used ROC curve analyses to determine population-specific cutoffs (in order to maximize the predictive value specific to developmental/medical populations). Johnson et al (2011), for example, found that a cutoff score of ≥ 14 was more appropriate in a sample of extremely pre-term children when assessed at 11-years old.21 It is important to emphasize that a positive screening does not constitute a formal diagnosis of an ASD; failed screening indicates that a child may be at risk for an ASD diagnosis and comprehensive assessment is needed to confirm diagnostic status and to rule out other neurodevelopmental issues.
Analytic plan- Prevalence
The rate of positive results on a ASD screener in this sample was compared to the 2010 CDC rates of ASD prevalence (1:68)22 using a Chi-square Test of Equal Proportions. Analyses were conducted using the established SCQ cutoff score of ≥ 15. Additional analyses were conducted using a research-supported cutoff score of ≥ 12, as well as parent-reported ASD diagnoses (to reflect clinical diagnoses). Of note, parent-reported diagnoses did not consistently match children identified by SCQ screening.
Analytic plan- Population-specific cutoff score
The optimal SCQ cutoff to reflect parent-reported diagnosis on the health history form was determined using ROC analyses (i.e., area under the curve). The optimal cutoff for this sample is defined as the value that maximizes both sensitivity and specificity of predicting parent-reported diagnosis.
Analytic plan- Predictive models
The stepwise variable selection method was used to create a “best prediction model” using the patient factors and behavioral data collected from the 4-year old evaluation. All significant univariate variables were included in this selection method. Factors were identified that increased or decreased the probability of screening positive on the SCQ. A multivariable logistic regression was then used to identify the variables that accounted for the most variance in diagnostic status. Since there was some concern that some patient factors may be associated with some of the 4-year behavioral outcomes, sensitivity analyses were conducted to assess multicollinearity. While some variables were correlated with each other, multicollinearity analyses indicate that this correlation was not strong enough to affect the results of the models (i.e., Variance Inflation Factors [VIFs] of 1.60 or less).
Results
The prevalence of ASDs
A significantly higher proportion of children in this study were identified via SCQ screening and/or parent-reported diagnosis than predicted based on national rates of ASDs at the time of assessment, ps < .05 (Table 3). Compared to the national rate of ASD diagnoses (1:68; 1.47%), children with CHD screened positive for an ASD at a rate of 1:30.9 (3.2%) using conservative, established cutoffs.
Table 3. Number of participants meeting criteria for an ASD (n=216).
Diagnostic Criteria | N (%)† |
---|---|
SCQ ≥ 15 | 7 (3.2%)* |
SCQ ≥ 12 | 19 (8.8%)*** |
SCQ ≥ 7 | 71 (32.9%)*** |
Parent-reported† | 16 (7.4%)*** |
Composite (SCQ ≥ 12 and/or Parent-reported) | 29 (13.4%)*** |
Note.
Significant difference compared to 2010 CDC rate at the p < 0.05 level,
Significant difference compared to 2010 CDC rate at the p < 0.0001 level;
Parent-reported ASD diagnosis via 2010 annual follow-up history form; SCQ, Social Communication Questionnaire
Of those with a failed screening for ASD, the following percent were also positively identified as having 22q.11.2 microdeletion syndrome: zero (0%) at SCQ ≥ 15; zero (0%) at SCQ ≥ 12; two (0.4%) using the composite variable; and six (2.8%) at SCQ ≥ 7. These findings suggest that failed ASD screening is not primarily driven by individuals with a confirmed diagnosis of 22q.11.2 microdeletion syndrome.
ROC analyses
The optimal cutoff value for this sample, which maximizes both sensitivity and specificity is 7 (n = 71). Using a value of ≥ 7 as the SCQ cutoff yields a sensitivity of 0.75 and a specificity of 0.71.
Predictive Models: Factors contributing to ASD risk
The variables associated with risk of screening positive on the SCQ are organized by (1) factors associated with increased risk and (2) factors associated with decreased risk. Results are listed by diagnostic reporting method in Tables 4 (medical/patient factors) and 5 (4-year-old assessment behavioral factors).
Table 4. Univariate Logistic regression findings by Diagnostic criteria (Patient factors).
SCQ ≥ 15 | SCQ ≥ 12 | SCQ ≥ 7 | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||
Factor (unit) | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ |
Factors associated with increased risk | ||||||||||||
Genetic disorder (categorical) | 5.15 | 1.11 | 23.87 | 0.036 | 2.95 | 1.11 | 7.82 | 0.030 | 3.04 | 1.56 | 5.91 | 0.001 |
APOE Genotype 22 & 23 (categorical) | 3.08 | 0.57 | 16.80 | 0.190 | 4.09 | 1.40 | 11.93 | 0.010 | 2.72 | 1.19 | 6.25 | 0.018 |
Postoperative Length of Stay after first surgery (days) | 1.02 | 0.98 | 1.07 | 0.260 | 1.01 | 0.98 | 1.05 | 0.520 | 1.04 | 1.01 | 1.08 | 0.007 |
Cumulative DHCA Time First Operation to 4 Years (minutes) | 0.99 | 0.95 | 1.02 | 0.410 | 0.99 | 0.97 | 1.02 | 0.440 | 1.01 | 1.00 | 1.03 | 0.024 |
Confirmed Genetic Disorder (yes/no) | 6.38 | 1.34 | 30.36 | 0.020 | 3.16 | 1.03 | 9.70 | 0.044 | 6.70 | 2.65 | 17.00 | <0.001 |
Delayed Sternal Closure after Surgery (yes/no) | 11.33 | 2.38 | 53.97 | 0.002 | 4.09 | 1.40 | 11.93 | 0.010 | 1.59 | 0.69 | 3.67 | 0.280 |
Factors associated with decreased risk | ||||||||||||
Maternal Education (categorical) | 2.04 | 0.39 | 10.80 | 0.400 | 0.78 | 0.30 | 2.05 | 0.62 | 0.42 | 0.23 | 0.77 | 0.005 |
SES Status Class (categorical) | 0.53 | 0.12 | 2.46 | 0.420 | 0.47 | 0.18 | 1.27 | 0.14 | 0.35 | 0.18 | 0.66 | 0.001 |
APOE Genotype 33 (categorical) | 0.11 | 0.01 | 0.93 | 0.044 | 0.29 | 0.11 | 0.80 | 0.016 | 0.61 | 0.34 | 1.08 | 0.090 |
Normal Genetic Status (yes/no) | 0.19 | 0.04 | 0.90 | 0.036 | 0.34 | 0.13 | 0.90 | 0.030 | 0.33 | 0.17 | 0.64 | 0.001 |
Gestational Age (weeks) | 0.73 | 0.56 | 0.95 | 0.020 | 1.00 | 0.99 | 1.01 | 0.490 | 0.92 | 0.80 | 1.06 | 0.250 |
Bolded numbers indicate significant at the 0.05 level.
SCQ ≥ 15
Using an SCQ cutoff score of ≥ 15, patient factors, operative management factors, and 4-year neurodevelopmental screening factors were significant predictors, ps < .05.
Univariate analyses indicated that the following variables were associated with increased risk of screening positive on the SCQ: medical/patient factors- having a possible genetic abnormality; having a confirmed genetic abnormality; having a delayed sternal closure; behavioral factors at 4-years- having more parent-rated developmental problems symptoms of ADHD.
The following variables were found to be associated with a decreased risk of screening positive on the SCQ: medical/patient factors- having the APOE genotype 33; older gestational age; having no genetic abnormalities; behavioral factors at 4-years- having better language skills; having better social/behavioral skills; and having a higher IQ.
Delayed sternal closure and pervasive developmental problems at 4-years (CBCL PDP) were independent predictors of diagnostic status in the univariate models. However, multivariable analysis showed that when the model was adjusted for the above predictors, only CBCL PDP was a significant predictor of diagnostic status (Table 6).
Table 6. Multivariable models of ASD diagnosis (based on step-wise regression analyses).
Odds Ratio | 95% Wald Confidence Limits | P-value | ||
---|---|---|---|---|
SCQ ≥ 15 | ||||
Delayed Sternal Closure | 5.990 | 0.935 | 38.383 | 0.059 |
CBCL PDP T-Score | 1.163 | 1.062 | 1.272 | 0.001 |
| ||||
SCQ ≥ 12 | ||||
PKBS-2 Social Skill Total | 0.933 | 0.884 | 0.984 | 0.011 |
CBCL PDP T-Score | 1.083 | 1.013 | 1.159 | 0.020 |
| ||||
SCQ ≥ 7 | ||||
PKBS Social Skill Total | 0.934 | 0.896 | 0.973 | 0.001 |
ADHD-IV Hyperactivity-Impulsivity Score | 1.078 | 1.006 | 1.155 | 0.034 |
WPPSI-III FSIQ Standard Score | 0.971 | 0.952 | 0.922 | 0.006 |
Note. CBCL PDP, Child Behavior Checklist Pervasive Developmental Problems; PKBS-2, Preschool and Kindergarten Behavior Scales, Second Edition; ADHD-IV, Attention-Deficit/Hyperactivity Disorder, Fourth Edition; WPPSI-III FSIQ, Wechsler Preschool and Primary Scale of Intelligence, Third Edition Full Scale IQ
SCQ cutoff ≥ 12
Analyses were then conducted using the research-supported SCQ cutoff of ≥ 12. Factors contributing to risk of screening positive on the SCQ (n = 19) are also listed in Tables 4 and 5. The only additional significant variable (compared to the SCQ cutoff at ≥ 15 analyses) was that those with APOE ε2 allele were at 4.09 increased odds of ASD compared to the other genotypes. The multivariable analyses identified social skills and pervasive developmental problems as independent predictors and accounting for the most variance in diagnostic status, 35.1%, after controlling for all other variables in the model.
Table 5. Univariate Logistic regression findings by Diagnostic criteria (4-year old neurobehavioral evaluation findings).
SCQ ≥ 15 | SCQ ≥ 12 | SCQ ≥ 7 | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||
Factor (unit) | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ | Odds Ratio | Lower 95% CL | Upper 95% CL | P-value^ |
Factors associated with increased risk | ||||||||||||
CBCL PDP (T-score point) | 1.18 | 1.09 | 1.29 | <.001 | 1.15 | 1.09 | 1.21 | <0.001 | 1.11 | 1.06 | 1.16 | <0.001 |
CBCL Total Problems (T-score point) | 1.12 | 1.04 | 1.19 | 0.002 | 1.11 | 1.06 | 1.17 | <0.001 | 1.09 | 1.06 | 1.13 | <0.001 |
CBCL Internalizing Problems (T-score point) | 1.16 | 1.06 | 1.26 | 0.001 | 1.13 | 1.07 | 1.20 | <0.001 | 1.08 | 1.05 | 1.12 | <0.001 |
CBCL Externalizing Problems (T-score point) | 1.08 | 1.02 | 1.15 | 0.016 | 1.08 | 1.03 | 1.12 | 0.001 | 1.07 | 1.04 | 1.10 | <0.001 |
ADHD-IV Inattentive Scale (point) | 1.29 | 1.13 | 1.47 | 0.001 | 1.25 | 1.14 | 1.38 | <0.001 | 1.19 | 1.12 | 1.28 | <0.001 |
ADHD-IV Hyperactivity-Impulsivity Scale (point) | 1.15 | 1.02 | 1.29 | 0.020 | 1.16 | 1.07 | 1.25 | <0.001 | 1.15 | 1.09 | 1.22 | <0.001 |
Factors associated with decreased risk | ||||||||||||
EOWPVT-III (Standard Score point) | 0.98 | 0.92 | 1.04 | 0.420 | 0.99 | 0.96 | 1.02 | 0.510 | 0.96 | 0.95 | 0.98 | <0.001 |
PLS-4 Expressive Communication Score (Standard Score point) | 0.92 | 0.88 | 0.96 | 0.001 | 0.96 | 0.93 | 0.99 | 0.002 | 0.96 | 0.94 | 0.98 | <0.001 |
PKBS (Total Score point) | 0.90 | 0.85 | 0.95 | <0.001 | 0.90 | 0.86 | 0.94 | <0.001 | 0.91 | 0.88 | 0.94 | <0.001 |
WPPSI-III FSIQ (Standard Score point) | 0.90 | 0.85 | 0.95 | <0.001 | 0.96 | 0.94 | 0.99 | 0.004 | 0.96 | 0.94 | 0.98 | <0.001 |
Bolded numbers indicate significance at the 0.05 level.
SCQ cutoff ≥ 7
Logistic regression analyses were then conducted using the optimal cutoff of ≥ 7 (identified via ROC analyses), results are listed in Tables 4, 5, and 6, respectively. The multivariable analyses identified social skills at 4-years, pervasive developmental problems at 4-years, and intellectual functioning at 4-years as independent predictors and accounting for the most variance, after controlling for all other variables in the model.
Composite variable (SCQ ≥ 12 and/or parent-reported diagnosis)
Additionally, analyses were conducted using both SCQ and parent-reported diagnosis to capture children identified by either method. The only unique variable in this univariate analysis was race: participants who are not of Caucasian race have a 53.1% (95% CI: 0.1%, 78%) decreased odds of being identified as having an ASD [OR: 0.469 (95% CI: 0.222, 0.999)], p = 0.0497. The multivariable model identified pervasive developmental problems at 4-years and inattention at 4-years as independent predictors and accounting for the most variance in diagnostic status.
Discussion
The current study found that children with a history of severe CHD requiring infant surgery are at higher risk for screening positive on a well-established ASD screener when compared to rates of ASDs in the general population.
It is important to note, however, that this risk is associated with a variety of genetic, individual, operative management, and behavioral/developmental factors. When using conservative cutoffs, delayed sternal closure and parent-reported pervasive developmental problems at 4-years of age were significantly associated with ASD-screening status. When evaluating the utility of more experimental screening cutoff points, (i.e., SCQ ≥ 7, 12, or 15), it appears that medical variables were more predictive of ASD-screening status when using more conservative cutoff scores. These findings are consistent with previous work showing that surgical intervention, while necessary for survival, introduces a multitude of risk factors for complicating neurobehavioral development, including pre- and post-operative brain injury23 and intra- and post-operative hemodynamic factors.24 Timing of diagnosis has also found to be linked to developmental outcomes.25 Unfortunately, the patient and management factors identified as predictors of risk are largely non-modifiable.
Behavioral variables were associated with a positive ASD-screening status regardless of cutoff point. Importantly, children with more domain-general neurocognitive issues at 4-years-old (e.g., cognitive, language, and attention issues) are at higher risk and need to be assessed for ASD-related issues: there may be higher false positive rates in populations with more neurodevelopmental and domain-general cognitive issues, highlighting the need for comprehensive ASD-diagnostic assessments to confirm current findings. Finally, although socioeconomic and cultural/racial factors were not independently associated with screening results, they are important factors to consider, particularly in light of research highlighting ethnic disparity in ASD diagnosis.26 Taken together, these findings support that early medical factors and behavioral performance at 4-years-old can help to suggest which children may be in need of additional follow-up and intervention to promote adequate neurodevelopmental progress. However, it should be emphasized that early developmental screening (beginning at 9-months) and ASD screening beginning at 18-months of age should be routine, as suggested by the American Academy of Pediatrics (AAP; July 2006), in order to initiate needed interventions earlier to promote better outcomes. The current study reports on data collected at age 4-years in order to evaluate potential associated factors via available data, not as a suggestion that neurodevelopmental screening should begin at this age.
It is also important to highlight the utility of using lower thresholds for concern in this medically-complex population. According to current results, a cutoff of ≥ 7 on the SCQ best reflected parent-reported diagnoses via the health history form, which likely take a broader developmental/functional context into account. If more conservative cutoffs are used, there is the risk of missing children in need of a more thorough evaluation, although this more liberal screening increases the rate of false positively identified children. Recent studies have found relatively low false positive rates in the “general” population, though failed screening may be more likely for children with other neurodevelopmental disorders: Chandler et al. (2007) found that 5.3% of their “general” population sample screened positive on the SCQ at a cutoff of ≥ 15; however, 12 of 13 children screening positive had a neurodevelopmental diagnosis from a community clinician (e.g., intellectual disability; seven of which were an ASD diagnosis).27 Furthermore, a recent study highlighted that children with comorbid attentional problems may be at risk for delayed ASD diagnoses;28 a lower screening threshold for this vulnerable population may serve to ensure that children with primary social issues are not overlooked due to their more general neurocognitive delays. Therefore, a lower threshold should be used clinically, in order to best identify those children in this vulnerable population who require additional assessment to clarify neurodevelopmental issues and to provide them with the most appropriate therapeutic services.
Overall, findings from this study are in line with past research showing that children with a history of CHD are at higher risk of academic, behavioral, cognitive, social, and quality-of-life challenges.1,9 Even within this population, Gaynor et al. (2009) previously documented that children with the APOE ∊2 allele were rated as having more impaired social skills than children with the APOE ∊4 allele.9 Calderon et al. (2010) found that seven-year old children with a history of TGA and neonatal arterial switch operations showed greater rates of failure on false belief (theory of mind) tasks compared to controls (measuring the ability to recognize another person's perspective).34 Calderon et al. (2012) also noted that children with prenatal diagnoses received significantly higher theory of mind scores than children with postnatal diagnosis of TGA, highlighting the potential role of medical management factors in social-cognitive development.35 Although not diagnostic of an ASD, these findings highlight that children with CHD are experiencing social-cognitive and communication difficulties and are in need of services to support more typical social development. The current findings are generally consistent with these past results and add to the current literature by presenting factors that may affect ASD-diagnostic risk.
The exploratory nature of this project confers some limitations. First, clinical diagnosis was not confirmed in this study and both diagnostic variables were provided by parent report. As with any screener, children may screen positive for other reasons (e.g., general cognitive/language delays) and, therefore, require ASD-diagnostic clarification. Future studies would benefit from examining factors contributing to diagnostic risk in children with clinically-confirmed diagnoses of ASD. Formal diagnostic clarification via structured parent interview and semi-structured child-focused interactive measures will be important for this goal, in order to confirm clinical diagnoses and provide a more nuanced understanding of social cognitive and social behavioral clinical presentations. Additionally, item-based analyses of the SCQ could be explored, to better understand specific observations bringing these children to the clinical attention of community providers. Second, the low base rate of positive ASD-screening in this sample may have limited power to detect additional relationships between variables. The low response rate of completed packets (56%) is also a limitation. Finally, inherent in the exploratory nature of this study, we chose to conduct multiple comparisons to best describe the relationship between variables. We understand that this introduces the risk of Type 1 error. Readers should interpret the precise relationships with caution and we encourage further analysis and replication to better determine how these preliminary findings fare with alternative thresholds for significance.
Conclusions
In conclusion, although previous research has clearly described the neurodevelopmental risks for children with serious CHD requiring infant cardiac surgery, this study is the first known analysis to document the rates of positive screening for ASD specifically in a large sample, as well as the factors that may be associated with ASD risk. Rates of positive ASD-screening were higher than expected from population rates and was related to both medical/patient factors and behavioral performance at the age of 4-years. Findings highlight the need for careful, early neurodevelopmental tracking in childhood, with ASD screening beginning at 18-months of age and, for some children, referral to a specialist to assess the presence/severity of social-cognitive and communication issues. Our findings suggest that a lower threshold for screening is more applicable in this high-risk population, to ensure that children in need of services are referred to the appropriate diagnostic and therapeutic providers. Additionally, our findings show that screening results do not always match with clinical diagnoses, which emphasizes the need for comprehensive clinical assessment of ASDs and other developmental disorders.
Acknowledgments
Funding source: This work was supported by a grant from the Fannie E. Rippel Foundation, an American Heart Association National Grant-in-Aid (9950480N), HL071834 from the National Institutes of Health, and the Daniel M. Tabas Endowed Chair in Pediatric Cardiothoracic Surgery.
Footnotes
Conflict of Interest Statement: The authors have no conflicts of interest to disclose.
Financial Disclosure Statement: The authors have no financial relationships relevant to this article to disclose.
Author note: Jessica L. Bean Jaworski is now at Baystate Medical Center.
- Shih T-H & Fan X. Comparing response rates from web and mail surveys: A meta-analysis. Field Methods. 2008:20(3):249-271.
- Asch DA, Jedrziewski MK, & Christakis, NA. Response rates to mail surveys published in medical journals. Journal of Clinical Epidemiology. 1997:50(10):1129-1136.
Author Contributions: Jessica L. Bean Jaworski, PhD participated in the conceptualization of this project, drafted the initial manuscript, and approved the final manuscript for submission.
Thomas Flynn, PhD, ABPP participated in the conceptualization of this project and review of the manuscript.
Nancy Burnham, RN, MSN, CRNP participated in the coordination of the parent project, data preparation, data analysis and interpretation of this project, edited the manuscript, and approved the final manuscript for publication.
Jesse L. Chittams, MS participated in design and concept of the analysis, data interpretation, edited the manuscript, and approved the final manuscript for submission.
Therese Sammarco, MS participated in data analysis and interpretation, edited the manuscript, and approved the final manuscript for submission.
Marsha Gerdes, PhD participated in the clinical evaluation of this cohort of patients and helped to edit the manuscript and approve the final manuscript for publication.
Judy C. Bernbaum, MD participated in the clinical evaluation of this cohort of patients and helped to edit the manuscript and approve the final manuscript for publication.
Robert R. Clancy, MD obtained neurological historical data and performed the neurological examinations at the 4 year follow up assessment of this cohort, edited the manuscript, and approved the final manuscript for publication.
Cynthia B. Solot, MA, CCC-SLP participated in the clinical evaluation of this cohort of patients and helped to edit the manuscript and approve the final manuscript for publication.
Elaine H. Zackai, MD participated in evaluation of cohort to exclude syndromic subjects.
Donna M. McDonald-McGinn, MS, LCGC participated in evaluation of cohort to exclude syndromic subjects, edited the manuscript and approved the final manuscript for submission.
J. William Gaynor, MD participated in the design and management of the parent project, conceptualization of this project, data analysis and interpretation, edited the initial manuscript, and approved the final manuscript for submission.
References
- 1.Wernovsky G. Current insights regarding neurological and developmental abnormalities in children and young adults with complex congenital cardiac disease. Cardiol Young. 2006;16(1):92–104. doi: 10.1017/S1047951105002398. [DOI] [PubMed] [Google Scholar]
- 2.McCusker CG, Doherty NN, Molloy B, et al. Determinants of neuropsychological and behavioural outcomes in early childhood survivors of congenital heart disease. Arch Dis Child. 2007;92(2):137–141. doi: 10.1136/adc.2005.092320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Miatton M, De Wolf D, François K, Thiery E, Vingerhoets G. Neuropsychological performance in school-aged children with surgically corrected congenital heart disease. J Pediatr. 2007;151(1):73–78. doi: 10.1016/j.jpeds.2007.02.020. [DOI] [PubMed] [Google Scholar]
- 4.Bellinger DC. Are children with congenital cardiac malformations at increased risk of deficits in social cognition? Cardiol Young. 2008;18(1):3–9. doi: 10.1017/S104795110700176X. [DOI] [PubMed] [Google Scholar]
- 5.American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th. Washington, DC: Author; 2013. [Google Scholar]
- 6.Neufeld RE, Clark BG, Robertson CMT, et al. Five-year neurocognitive and health outcomes after the neonatal arterial switch operation. J Thorac Cardiovasc Surg. 2008;136(6):1413–1421.e2. doi: 10.1016/j.jtcvs.2008.05.011. [DOI] [PubMed] [Google Scholar]
- 7.Bellinger DC, Wypij D, Rivkin MJ, et al. Adolescents with d-transposition of the great arteries corrected with the arterial switch procedure: Neuropsychological assessment and structural brain imaging. Circulation. 2011;124(12):1361–1369. doi: 10.1161/CIRCULATIONAHA.111.026963. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Bellinger D, Rivkin M, DeMaso D, et al. Adolescents with tetralogy of Fallot: neuropsychological assessment and structural brain imaging. Cardiol Young. 2014;25(2):338–347. doi: 10.1017/S1047951114000031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Gaynor JW, Nord AS, Wernovsky G, et al. Apolipoprotein E genotype modifies the risk of behavior problems after infant cardiac surgery. Pediatrics. 2009;124(1):241–250. doi: 10.1542/peds.2008-2281.Apolipoprotein. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Gaynor JW, Wernovsky G, Jarvik GP, et al. Patient characteristics are important determinants of neurodevelopmental outcome at one year of age after neonatal and infant cardiac surgery. J Thorac Cardiovasc Surg. 2007;133(5):1344–1353. doi: 10.1016/j.jtcvs.2006.10.087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hoskoppal A, Roberts H, Kugler J, Duncan K, Needelman H. Neurodevelopmental outcomes in infants after surgery for congenital heart disease: a comparison of single-ventricle vs. two-ventricle physiology. Congenit Hear Dis. 2010;5(2):90–95. doi: 10.1111/j.1747-0803.2009.00373.x. [DOI] [PubMed] [Google Scholar]
- 12.Shillingford AJ, Glanzman MM, Ittenbach RF, Clancy RR, Gaynor JW, Wernovsky G. Inattention, hyperactivity, and school performance in a population of school-age children with complex congenital heart disease. Pediatrics. 2008;121(4):e759–e767. doi: 10.1542/peds.2007-1066. [DOI] [PubMed] [Google Scholar]
- 13.Center for Disease Control and Prevention. Prevalence of autism spectrum disorders--Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. Morb Mortal Wkly report. 2012;61(3):1–19. http://www.ncbi.nlm.nih.gov/pubmed/22456193. [PubMed] [Google Scholar]
- 14.Gaynor JW, Gerdes M, Nord AS, et al. Is cardiac diagnosis a predictor of neurodevelopmental outcome after cardiac surgery in infancy? J Thorac Cardiovasc Surg. 2010;140(6):1230–1236. doi: 10.1016/j.jtcvs.2010.07.069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Narzisi A, Calderoni S, Maestro S, Calugi S, Mottes E, Muratori F. Child Behavior Check List 1½-5 as a tool to identify toddlers with autism spectrum disorders: A case-control study. Res Dev Disabil. 2013;34(4):1179–1189. doi: 10.1016/j.ridd.2012.12.020. [DOI] [PubMed] [Google Scholar]
- 16.Rutter Bailey A, Lord CM. Social Communication Questionnaire. Los Angeles, CA: 2003. [Google Scholar]
- 17.Charman T, Baird G, Simonoff E, et al. Efficacy of three screening instruments in the identification of autistic-spectrum disorders. Br J Psychiatry. 2007;191:554–559. doi: 10.1192/bjp.bp.107.040196. [DOI] [PubMed] [Google Scholar]
- 18.Towbin KE, Pradella A, Gorrindo T, Pine DS, Leinbenluft E. Autism Spectrum Traits in Children with Mood and Anxiety Disorders. J Child Adolesc Psychopharmacol. 2005;15(3):452–467. doi: 10.1007/s10803-012-1575-z. [DOI] [PubMed] [Google Scholar]
- 19.Saemundsen E, Ludvigsson P, Hilmarsdottir I, Rafnsson V. Autism Spectrum Disorders in Children with Seizures in the First Year of Life-A Population-Based Study. Epilepsia. 2007;48(9):1724–1730. doi: 10.1111/j.1528-1167.2007.01150.x. [DOI] [PubMed] [Google Scholar]
- 20.Corsello C, Hus V, Pickles A, et al. Between a ROC and a hard place: Decision making and making decisions about using the SCQ. J Child Psychol Psychiatry Allied Discip. 2007;48(9):932–940. doi: 10.1111/j.1469-7610.2007.01762.x. [DOI] [PubMed] [Google Scholar]
- 21.Johnson S, Hollis C, Hennessy E, Kochhar P, Wolke D, Marlow N. Screening for autism in preterm children: diagnostic utility of the Social Communication Questionnaire. Arch Dis Child. 2011;96(1):73–77. doi: 10.1136/adc.2010.194795. [DOI] [PubMed] [Google Scholar]
- 22.Report MW. Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2010. MMWR Surveill Summ. 2014;63(2):1–21. http://www.ncbi.nlm.nih.gov/pubmed/24670961. [PubMed] [Google Scholar]
- 23.Miller SP, McQuillen PS, Vigneron DB, et al. Preoperative brain injury in newborns with transposition of the great arteries. Ann Thorac Surg. 2004;77(5):1698–1706. doi: 10.1016/j.athoracsur.2003.10.084. [DOI] [PubMed] [Google Scholar]
- 24.Hsia TY, Gruber PJ. Factors influencing neurologic outcome after neonatal cardiopulmonary bypass: What we can and cannot control. Ann Thorac Surg. 2006;81(6):S2381–S2388. doi: 10.1016/j.athoracsur.2006.02.074. [DOI] [PubMed] [Google Scholar]
- 25.Kumar RK, Newburger JW, Gauvreau K, Kamenir SA, Hornberger LK. Comparison of outcome when hypoplastic left heart syndrome and transposition of the great arteries are diagnosed prenatally versus when made only postnatally. Am J Cardiol. 1999;83(12):1649–1653. doi: 10.1016/s0002-9149(99)00172-1. [DOI] [PubMed] [Google Scholar]
- 26.Mandell DS, Wiggins LD, Carpenter LA, et al. Racial/ethnic disparities in the identification of children with autism spectrum disorders. Am J Public Health. 2009;99(3):493–498. doi: 10.2105/AJPH.2007.131243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chandler S, Charman T, Baird G, et al. Validation of the Social Communication Questionnaire in a Population Cohort of Children with Autism Spectrum Disorders. J Am Acad Child Adolesc Psychiatry. 2007;46(10):1324–1332. doi: 10.1097/chi.0b013e31812f7d8d. [DOI] [PubMed] [Google Scholar]
- 28.Miodovnik A, Harstad E, Sideridis G, Huntington N. Timing of the Diagnosis of Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorder. Pediatrics. 2015;136(4) doi: 10.1542/peds.2015-1502. [DOI] [PubMed] [Google Scholar]
- 29.Eigsti IM, de Marchena AB, Schuh JM, Kelley E. Language acquisition in autism spectrum disorders: A developmental review. Res Autism Spectr Disord. 2011;5(2):681–691. doi: 10.1016/j.rasd.2010.09.001. [DOI] [Google Scholar]
- 30.Suh J, Eigsti IM, Naigles L, Barton M, Kelley E, Fein D. Narrative performance of optimal outcome children and adolescents with a history of an Autism Spectrum Disorder (ASD) J Autism Dev Disord. 2014;44(7):1681–1694. doi: 10.1007/s10803-014-2042-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Jarrold C, Boucher J, Smith P. Symbolic play in autism: A review. J Autism Dev Disord. 1993;23(2):281–307. doi: 10.1007/BF01046221. http://www.ncbi.nlm.nih.gov/pubmed/7687245. [DOI] [PubMed] [Google Scholar]
- 32.Sigman M, Ungerer JA. Cognitive and language skills in autistic, mentally retarded, and normal children. Dev Psychol. 1984;20(2):293–302. doi: 10.1037//0012-1649.20.2.293. [DOI] [Google Scholar]
- 33.Bellinger DC, Newburger JW. Neuropsychological, psychosocial, and quality-of-life outcomes in children and adolescents with congenital heart disease. Prog Pediatr Cardiol. 2010;29(2):87–92. doi: 10.1016/j.ppedcard.2010.06.007. [DOI] [Google Scholar]
- 34.Calderon J, Bonnet D, Courtin C, Concordet S, Plumet MH, Angeard N. Executive function and theory of mind in school-aged children after neonatal corrective cardiac surgery for transposition of the great arteries. Dev Med Child Neurol. 2010;52(12):1139–1144. doi: 10.1111/j.1469-8749.2010.03735.x. [DOI] [PubMed] [Google Scholar]
- 35.Calderon J, Angeard N, Moutier S, Plumet MH, Jambaqué I, Bonnet D. Impact of prenatal diagnosis on neurocognitive outcomes in children with transposition of the great arteries. J Pediatr. 2012;161(1):94–98.e1. doi: 10.1016/j.jpeds.2011.12.036. [DOI] [PubMed] [Google Scholar]