Skip to main content
UKPMC Funders Author Manuscripts logoLink to UKPMC Funders Author Manuscripts
. Author manuscript; available in PMC: 2017 Feb 28.
Published in final edited form as: J Dev Behav Pediatr. 2016 Jan;37(1):88–102. doi: 10.1097/DBP.0000000000000238

Prognostic Factors for Behavioral Problems and Psychiatric Disorders in Children Born Very Preterm or Very Low Birth Weight: A Systematic Review

Louise Linsell *, Reem Malouf *, Samantha Johnson , Joan Morris , Jennifer J Kurinczuk *, Neil Marlow §
PMCID: PMC5330463  EMSID: EMS67402  PMID: 26703327

Abstract

Objective

Risk factors associated with adverse behavioral outcomes in very preterm (VPT) or very low birth weight (VLBW) infants are poorly understood. The aim of this article is to identify prognostic factors for behavioral problems and psychiatric disorders in children born ≤32 weeks gestational age or with birth weight ≤1250 g.

Method

A systematic review was conducted using MEDLINE, Embase, and Pyscinfo databases to identify studies published between January 1, 1990 and June 1, 2014 reporting multivariable prediction models for behavioral problems or psychiatric disorders in VPT/VLBW children. Fifteen studies were identified and 2 independent reviewers extracted key information on study design, outcome definition, risk factor selection, model development, reporting, and conducted a risk of bias assessment.

Results

The 15 studies included reported risk factor analyses for the following domains: general behavioral problems (n = 8), any psychiatric disorder (n = 2), autism spectrum symptoms/disorders (n = 5), and attention deficit/hyperactivity disorder (n = 1). Findings were inconclusive because of the following: small number of studies in each domain, heterogeneity in outcome measures, lack of overlap in the risk factors examined, and differences in strategies for dealing with children with neurological impairments.

Conclusion

There is a lack of evidence concerning risk factors for behavior problems and psychiatric disorders among VPT/VLBW survivors. This review has identified the need for further research examining the etiology of disorders of psychological development in the VPT/VLBW population to refine risk prediction and identify targets for intervention. Large well-conducted studies that use standard diagnostic evaluations to assess psychiatric disorders throughout childhood and adolescence are required.

Index terms: risk factors, child psychiatry, behavior and emotional disorders, autistic spectrum disorder, attention deficit hyperactivity disorder, preterm infants, very low birth weight, systematic review


Advances in obstetric and neonatal care have led to a steady increase in the survival rate of preterm children,1,2 but this has also been accompanied by an increase in the prevalence of long-term sequelae such as neurodevelopmental impairment and psychiatric disorders. Studies using behavioral screening questionnaires have shown that children born very preterm (VPT; ≤32 weeks gestation) and with very low birth weight (VLBW; ≤1250 g) are at increased risk of social, emotional, and attention problems and internalizing problems (anxiety/depression) compared with term-born controls.3 Clinically significant behavior problems on screening questionnaires have been reported in 13% to 46% of VPT/VLBW children.4 However screening tools are designed to have a high rate of sensitivity, to identify children who are at risk of developing a psychiatric disorder and for whom further assessment would be beneficial,57 and thus the rates of diagnosed disorders is typically lower. Studies using diagnostic evaluations have reported an excess of attention deficit/hyperactivity disorders (ADHDs), autism spectrum disorders (ASDs), and psychiatric disorders in general compared with term-born controls.8,9 A recent review of clinical cohort studies reported that the prevalence of Diagnostic and Statistical Manual of Mental Disorders10–based ADHD diagnoses ranged between 16% to 19% in VPT/VLBW children, with an increase in odds of 2 to 3 compared with termborn peers.4 ASDs are less common, with a median prevalence of 0.6% in the general population, but 2 studies have reported that 3.6% of extremely low birth weight children (≤1000 g)11 and 8% of extremely preterm (≤28 weeks gestation) children,12 respectively, met diagnostic criteria when assessed between 8 to 11 years. Behavioral problems in VPT/VLBW children have been shown to persist into adolescence,13,14 and there is evidence that the risk of being diagnosed with psychiatric disorders in adulthood increases with decreasing gestational age.15,16

The pattern of behavioral problems observed in VPT/VLBW children has been shown to be similar across different countries, despite cultural differences and disparity in neonatal care, implicating some underlying biological mechanism.17 It has been suggested that a “preterm behavioral phenotype” may exist, characterized by sociocommunicative and emotional problems and inattention.4 The mechanisms underlying this neurobehavioral profile are unclear, although several explanations have been proposed.18 The VPT/VLBW newborn brain is extremely vulnerable, and clinical and environmental factors that disturb a critical period of brain development that normally takes place in utero may be highly influential. Exposure to prolonged hospitalizations and therapeutic interventions may disrupt normal neurodevelopment, even in the absence of focal brain injury. This is compounded by the stressful environment of a busy neonatal intensive care unit with a high noise level, constant bright lighting, multiple monitoring devices, and reduced opportunity for parent-infant interaction. Early exposure to such a sustained level of stress may have an adverse impact on brain development, akin to that observed in adults.19 Later environmental influences in early infancy and childhood, such as parental mental health, caregiving style, or limited contact with peers and family due to prolonged periods of hospitalization/illness, may impede the development of coping strategies, emotional regulation, attachment, and other social skills,20 all of which are more likely to occur after VPT/VLBW birth.

Early identification of behavioral problems in VPT/VLBW infants may prevent the development of psychiatric disorders later in life; however, the risk factors associated with adverse behavioral outcomes in this population are poorly understood. The aim of this article is to perform a systematic review of articles reporting multivariable outcome prediction models for behavioral problems and psychiatric disorders in the VPT/VLBW population, to identify robust predictors of outcome.

This article is part of a wider comprehensive systematic review of risk factors for poor neurodevelopmental outcomes in VPT/VLBW survivors, conducted to consolidate the evidence on risk to inform future prognostic research.

Methods

The methods for the overall systematic review have previously been published in a review protocol (http://www.crd.york.ac.uk/PROSPERO/), registration number CRD42014006943 (see Supplemental Digital Content 1, http://links.lww.com/JDBP/A93).

Search Strategy

Three electronic search strategies were devised in the MEDLINE, Embase, and Psycinfo databases (see Boxes S1–S3, Supplemental Digital Content 2, http://links.lww.com/JDBP/A94) using the National Institutes of Health Medical Subject Headings (NIH MeSH). The searches identified any journal articles published from January 1, 1990 to June 1, 2014 reporting a multivariable risk prediction model for a neurodevelopmental outcome assessed after the age of 18 months in very preterm/very low birth weight (VLBW) children. No language restrictions were made. The bibliographies of all articles included for data extraction were hand searched for further eligible articles.

Eligibility Criteria

Articles were included in the review if they satisfied the following eligibility criteria: (1) contained original data, (2) study population was born after January 1, 1990, (3) study population was ≤32 weeks gestational age (GA) or with birth weight ≤1250 g and not a highly select group (based on other clinical criteria), and (4) 1 objective was to perform a multivariable risk factor analysis (>2 variables) of a neurodevelopmental outcome assessed after 18 months of age.

All study designs were included, and 1990 was chosen as a cutoff date for year of birth because surfactant therapy was adopted routinely into clinical care in many countries around this time. This was a transition from the “pre-surfactant” era of high mortality and morbidity to the “surfactant era” of improved survival and prognosis.21,22 There were also improvements in the use of assisted ventilation, prophylactic infection control, and antenatal steroid therapy around this time. The birth weight cutoff of ≤1250 g was chosen to exclude the subset of more mature but extremely growth restricted children included in the typical ≤1500 g VLBW cohort, which can cause heterogeneity and lead to confounding bias when examining the relationship between risk factors and outcome.23

Explanatory prognostic factor studies that investigate the causal pathway between a single prognostic factor and an outcome (ideally adjusted for confounders) and estimate effect size are not included in this review. In these types of study, other risk factors are included based on the change in the regression coefficient of the prognostic factor under study, whereas in multivariable outcome prediction models, risk factors are included in the model based on their predictive ability in relation to the outcome. Current guidelines recommend not combining these 2 distinct types of study as their objectives and model building strategies differ, which, when synthesized, could lead to biased results.24,25

Data Extraction

All articles identified by the search strategies were screened on title and abstract for definite exclusions and duplicates (Screen 1). For the remaining articles, the full text was retrieved and the inclusion criteria were applied (Screen 2). The 2 screens were performed by the author (LL) in the first instance, but if there was uncertainty about the eligibility of an article, it was screened independently by a second reviewer (RM). If a decision could not be reached, it was referred to the rest of author review team (JK, NM, and JM). Non-English articles included in the review were fully translated. Multiple articles based on the same cohort of children underwent a panel review (LL, RM, and NM). Those reporting the same outcome domain (cognitive, motor, behavior, hearing, vision) at the same age of assessment (<5 years and ≥5 years) were assessed on relevance to the review, and only 1 article was selected for data extraction. For all articles eligible for inclusion, both reviewers (LL and RM) independently completed a full data extraction form and risk of bias assessment on a customized MS Access 2010 database. Every single item entered was manually cross-checked for discrepancies at a face-to-face meeting. These were discussed and resolved or referred to the rest of the author review team if agreement could not be reached.

The following data items were extracted: study design, participant setting, center selection, study location, year of birth, GA, birth weight, age at assessment, selection criteria of study population, sample size, completeness of data at follow-up, details of outcomes assessed, number of candidate risk factors assessed, variable selection, treatment of continuous variables, adjustment for confounders, method of analysis, model assumptions checked, missing data analysis, presentation of multivariable model, details of risk factors included in final model, strength of association, statistical validation, and clinical validation. If critical information was missing or unclear, the corresponding author was contacted once by email for clarification.

Risk of Bias Assessment

Overwhelming evidence shows that the conduct and reporting of published articles describing the development or validation prediction models are poor,26 which has led to the development of quality assessment tools specific for these types of study. In this review, the quality of studies was assessed according to a modified version of the Quality in Prognostic Studies tool, which is a standardized set of criteria recommended for use in reviews of prognosis27 (see Table S1, Supplemental Digital Content 3, http://links.lww.com/JDBP/A95). The tool focuses on 6 areas of potential bias pertinent to studies of prognosis: study participation, study attrition, prognostic factor measurement, outcome measurement, confounding measurement and account, and statistical analysis. Studies were graded as (yes/partly/no) for each domain and classified as having a low-moderate risk of bias if they were graded as (yes) or (partly) in all 6 bias domains and moderate-high risk of bias otherwise.

Data Synthesis and Reporting

Results were presented in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.28 Risk factors that were statistically significant (p < .05) in the final model were reported for each study. In studies that reported multiple models, for example, for different disorders, subscales of a global score, or further sensitivity analyses, all models are referenced in the results tables for completeness, but only the significant risk factors from the main models are presented. Studies were grouped according to type of outcome studied; general behavioral problems, psychiatric disorder, autism spectrum disorder, and attention deficit/hyperactivity disorder, and according to age of assessment; early childhood (<5 years) and middle childhood (≥5 years). Assessments in early infancy can be unreliable and based on more general behavioral screeners, whereas assessments in later childhood tend to have higher specificity, particularly if based on strict diagnostic criteria; hence, risk factors may differ.

Results

The searches for the comprehensive systematic review retrieved 44,500 articles for the comprehensive review of risk factors for neurodevelopmental outcomes, and after removing duplicates, the first screen on title and abstract was performed on 32,283 articles (Fig. 1). For 29,999, the title or abstract clearly indicated that the topic of the article was not relevant to the review question or did not satisfy one of the inclusion criteria. The remaining 2284 articles were screened on full text, applying the full set of eligibility criteria. Eligibility was unclear in 136 (6%), and these were reviewed by the second independent reviewer (RM), or the author was contacted (where uncertainty was due to missing information). After applying the eligibility criteria, 91 articles from 48 cohort populations containing multivariable risk factor analyses were eligible for inclusion (studies based in any center participating in the National Institute of Child Health and Human Development Neonatal Research Network [NICHD NRN] follow-up program were classified as belonging to the same cohort). After panel review, a further 13 articles were excluded as they reported the same outcome domain at the same age of assessment in the same cohort as another article with a more relevant objective; the remaining 78 articles were included in the data extraction for the comprehensive systematic review. No further articles were identified in the hand search of bibliographies. This review article summarizes the results of the 15 studies (from 9 cohort populations) reporting risk factor analyses for a behavioral or psychiatric (defined as a diagnosis appearing in Diagnostic and Statistical Manual of Mental Disorders [DSM-IV-TR]) outcome.9,11,12,2940 Two articles containing behavioral outcomes were excluded because of cohort overlap.41,42 The remaining 63 of the 78 studies did not contain behavioral or psychiatric outcomes.

Figure 1.

Figure 1

Flow diagram.

Study Characteristics

The main study design was prospective cohort (n = 14), and there was 1 randomized controlled trial.31 Of the 14 prospective cohorts, 7 were ascertained from all live births in a geographically defined region,9,12,29,32,34,35,40 5 were recruited from a single centre neonatal intensive care unit (NICU),11,30,33,36,37 and 3 from multiple NICUs.31,38,39 Studies were conducted in 7 countries: United States (n = 4), UK or England (n = 4), Australia (n = 2), France (n = 2), and 1 study each from Germany, Netherlands, and New Zealand. The median sample size was 219 (range, 75–1228) and 2 studies had more than 1000 participants.32,34 Five studies were restricted to extremely preterm (EPT) children, <27 weeks35,38,40 and <26 weeks,9,12 and 2 studies excluded multiple births.32,34 The risk of bias assessment classified 4 studies as low-moderate risk of bias and 11 studies as moderate-high risk of bias (Fig. 2).

Figure 2.

Figure 2

Risk of bias assessment of the 15 behavioral studies included in the review.

The 15 studies included in the review comprised 47 risk factor analyses for behavioral or psychiatric outcomes. Some studies reported a model for a global score and also models for each subdomain, whereas others reported additional models adjusting for concurrent factors such as cognition and language. The median number of candidate risk factors considered at the outset in each study was 16 (range, 7–42). For the initial screening of candidates to be entered the final model, 5 studies included them all and 7 included those with a p value below a set threshold after initial screening. The most popular method of model building after initial screening was to include all factors screened (n = 6 studies) and stepwise selection (n = 5 studies). Only 6 of the 15 studies reported the number of participants included in the final model presented. One study assessed model discrimination using the area under the receiver operating curve,38 but apart from that no studies performed any type of statistical or clinical validation.

Risk Factors for General Behavioral Problems

Eight studies contained a risk factor analysis for general behavioral problems (Table 1); 5 studies assessed outcome below 5 years of age2933 and 3 studies above 5 years.3436 Six of the studies excluded and/or adjusted for neurodevelopmental delay or cognitive impairment.29,3135 All studies used validated, parent report behavioral screening questionnaires, the most common being the Strengths and Difficulties Questionnaire (SDQ)47 (n = 4).3235 The Total Difficulties Score consists of 4 (5-item) subscales: conduct problems, inattention-hyperactivity, emotional symptoms, and peer problems. One study29 used the Child Behavior Checklist (CBCL),45 which is a 99-item questionnaire with 6 syndrome scales that are combined to give an overall Total Problem score: anxious/depressed, withdrawn, aggressive, destructive, sleep problems, and somatic behavior. The 169-item Infant-Toddler Symptom Checklist (ITSEA)46 and its brief 42-item version (BITSEA)43 were used by 2 studies.30,31 Both checklists include items measuring internalizing and externalizing problems, dysregulation, and socioemotional competence. Both the SDQ and ITSEA/BITSEA have been shown to be highly correlated with the CBCL.43,49 One study used the Vineland Adaptive Behavior Scales Screener,48 which measures adaptive functioning in the domains of communication, socialization, and daily living skills.

Table 1.

Summary of Studies Reporting Risk Factor Analyses for General Behavioral Problems in Children Born Very Preterm or with Very Low Birth Weight

Study Reference Country and Recruitment Period Age of Assessment (yrs) GA (wks)/Birth Weight (g) Design and Participants Number (%) of Survivors Assesseda Outcome Measure (Continuous [cts] Unless Otherwise Specified) Exclusion Criteria and/or Adjustment for Concurrent Neurodevelopmental Delay Significant Risk Factors for Poorer Outcome (p < .05) in Final Model
Early childhood <5 yr
   Stoelhorst et al29,b The Netherlands, 1996–1997 2 <32 wks PC of all live births in 3 Dutch health regions comprising 9% of the population 160 (68%) Total problem score, internalizing and externalizing scale from the CBCL; parent report Adjusted for: neurological abnormalities at 2 yr Total problem: SGA
Internalizing: SGA
Externalizing: none significant
   Spittle et al30 Australia, 2001–2003 2 <30 wks or <1250 g PC study of infants admitted to a single center NICU and enrolled in Victorian Infant Brain Studies (Melbourne) 188 (84%) Externalizing, internalizing, dysregulation, and competence domains from ITSEA; parent report None Internalizing: higher social riskc
Externalizing: none significant
Dysregulation: none significant
Competence: lower BW, PN steroids, female sex, moderate-severe WMA
   Peralta-Carcelen et al31 United States, 1999–2001 2.5 <1000 g Infants admitted to the NICU of 15 centers participating in the multicenter NICHD NRN routine FUP and enrolled in a glutamine supplementation RCT 696 (60%) Total competence (≤15th vs >15th centile) and total problem score (≥75th vs <75th centile) from BITSEA; parent report Excluded: blind, deaf, syndrome (n = 30)
Adjusted for: CP, abnormal neurological examination, MDI <70, and PDI <70 from BSID-II at 2.5 yr
Total competence: Hispanic or non-white ethnicity, MDI <70 and PDI <70 from BSID-II at 2.5 yr
Total problem: female sex, lower household income, MDI <70, and PDI <70 from BSID-II at 2.5 yr
   Delobel-Ayoub et al32 France, 1997 3 <33 wks PC of all live births in 9 French regions comprising one-third of all births (EPIPAGE Study); excluded multiples 1228 (69%) Total difficulties score from SDQ (≤10th vs >10th centile of control group); parent report Excluded: blind, deaf, severe CP (n = 63)
Adjusted for: neurodevelopmental delay and health status at 3 yr
Hospitalization in last year, lower maternal age, lower maternal education, neurodevelopmental delay, and poor health status at 3 yr
   Jones et al33 New Zealand, 1998–2000 4 <33 wks PC of infants admitted to a single center NICU (Christchurch) 105 (98%) Social competence composite score;d parent report Excluded from all: blind (n = 1)
Model 1: risk factors to term
Model 2: adjusted for family functioning and parenting 2–4 yr
Model 3: adjusted for factors in model 2 plus IQ at 4 yr
Model 1: family SES, male sex, severity of neonatal WMA
Model 2: male sex, higher maternal anxiety at 2–4 yr, negative and intrusive parenting at 4 yr
Model 3: GA <28 wks, higher maternal anxiety at 2–4 yr, negative and intrusive parenting at 4 yr, lower IQ at 4 yr
Middle childhood ≥5 yr
   Delobel-Ayoub et al34 France, 1997 5 <33 wks PC of all live births in 9 French regions comprising one-third of all births (EPIPAGE Study); excluded multiples 1102 (59%) Total difficulties score from SDQ (≤10th vs >10th centile of control group); parent report Excluded: blind, deaf, severe CP (n = 63)
Adjusted for: IQ and development (parent reported) at 5 yr
Hospitalizations in last 5 yr, lower maternal age, poor maternal mental well-being in previous month, lower IQ, and delayed development at 5 yr
   Stahlmann et al35 Germany, 1997–1999 7–9 <27 wks PC of all live births in all 8 perinatal centers in Schleswig-Holstein 75 (82%) Total difficulties score from SDQ; parent report Adjusted for: IQ at 7–9 yr Lower maternal education, IQ <70 at 7–9 yr
   Taylor et al36,e United States, 1992–1995 8 <1000 g PC of infants admitted to a single center NICU (Ohio) participating in the multicenter NICHD NRN routine FUP 204 (86%) Adaptive behavior composite score from the VABSS (cts and <1SD below mean of control group); parent report Each risk factor was fitted separately and adjusted sex, race, parental SES, family stressors, and family resources (p values not reported) Model 1 (cts score): longer neonatal hospital stay, outborn
Model 2 (<70 vs ≥70): longer neonatal hospital stay, NRI >3
a

Percentage of survivors assessed for outcome measure specified.

b

Nine models reported in total; total problem score, internalizing and externalizing scales and the 6 syndrome scores that comprise the total score.

c

Social risk was based on a composite measure of 6 social risk factors: family structure, education of primary caregiver, occupation and employment status of primary income earner, language spoken at home, and maternal age at birth.

d

Social competence composite score was derived by the authors by summing subscale scores across the following measures: SDQ, Behavioral Inventory of Executive Function—Preschool version (BRIEF-P), Emotional Regulation Checklist (ERC), Infant-Toddler Symptom Checklist (ITSC), Emotional Regulation subscale from BSID-II, and Penn Interactive Peer Play Scale (PIPPS). Three models were reported; the full model adjusting for IQ is reported in this review.

e

Two models for Adaptive behavior composite and its 3 domains reported; one based on dichotomous outcome and one based on continuous outcome. BITSEA, Brief Infant-Toddler Social and Emotional Screening43; BSID, Bayley Scales of Infant Development44; BW, birth weight; CBCL, Child Behavior Checklist45; CP, cerebral palsy; EPIPAGE, Etude Epidemiologique sur les Petits Ages Gestationnels; FUP, follow-up; GA, gestational age; IQ, intelligence quotient; ITSEA, Infant-Toddler Social and Emotional Assessment46; MDI, Mental Developmental Index from the BSID-II; NICU, neonatal intensive care unit; NICHD NRN, National Institutes of Child Health and Human Development Neonatal Research Network; NRI, neonatal risk index; PC, prospective cohort; PDI, Psychomotor Developmental Index from the BSID-II; PN, postnatal; RCT, randomized controlled trial; SES, socioeconomic status; SDQ, Strengths and Difficulties Questionnaire47; SGA, small for gestational age; VABSS, Vineland Adaptive Behavior Scales Screener48; and WMA, white matter abnormality.

There was only 1 low-moderate risk of bias study (which also had a sample size >1000) among this group of 8 studies examining general behavioral problems.32 Factors that were found to be significant predictors for behavioral problems at 3 years of age in this study were hospitalization after neonatal discharge, lower maternal age, lower level of maternal education, and neurodevelopmental delay/poor health status measured at the time of assessment. The later study in the same cohort at 5 years of age34 had similar findings. All 8 studies entered some indicator of socioeconomic deprivation into the final model, for example, education, income, social risk, and 5 found at least 1 of these factors significantly related to behavioral problems.3033,35 In the 6 studies that adjusted for neurodevelopmental delay or general cognitive ability at the time of assessment, 5 studies found a significant association between these factors and poorer behavioral outcomes.3135 Two studies reported that female sex and 1 study reported that male sex was significantly associated with behavioral problems, but 5 of the studies did not find sex significant in the final model. Overall, there was not enough overlap in the risk factors identified in this small group of studies to provide any conclusive evidence about prognostic factors for general behavioral problems.

Risk Factors for Psychiatric Disorders

Seven studies reported risk factor analyses for psychiatric disorders (Table 2); 2 for any DSM-IV-TR10 diagnosis,9,37 5 for autism spectrum disorder (ASD) symptoms or diagnoses,11,12,3840 and 1 for attention deficit/hyperactivity disorder (ADHD)11 (this study also reported a model for ASD).

Table 2.

Summary of Studies Reporting Risk Factor Analyses for Psychiatric Disorders in Children Born Very Preterm or with Very Low Birth Weight

Study Reference Country and Recruitment Period Age of Assessment (yrs) GA (wks)/Birth Weight (g) Design and Participants Number (%) of Survivors Assesseda Outcome Measure (Continuous [cts] Unless Otherwise Specified) Exclusion Criteria and/or Adjustment for Concurrent Neurodevelopmental Delay Significant Risk Factors for Poorer Outcome (p < .05) in Final Model
Any psychiatric disorder: diagnosis
   Treyvaud et al37 Australia, 2001–2003 7 <30 wks or <1250 g PC study of infants admitted to a single center NICU and enrolled in Victorian Infant Brain Studies (Melbourne) 177 (79%) DAWBA, parent report; DSM-IV-TR diagnosis assigned using scoring algorithm and clinical judgment of 2 blinded reviewers None Brain abnormality at term, female sex, socialemotional problems at 5 yr (SDQ), higher familial social risk at 7 yrb
   Johnson et al9 UK and Republic of Ireland, 1995 10–12 <26 wks PC of all live births in the UK and Republic of Ireland (EPICURE Study) 219 (71%) DAWBA, parent report; DSM-IV-TR diagnosis assigned using scoring algorithm and clinical judgment of 2 blinded reviewers None NEC, internalizing behavior problems at 2.5 yr (CBLC), pervasive attentional and conduct problems at 6 yr (SDQ), serious functional disability at 6 yr
   Autism spectrum symptoms: dimensional measure
   Wong et al39 England, 2010–2012 1.8–2.2 <33 wks Infants attending routine FUP in 13 centers (London); neonatal data extracted retrospectively 141 (70%) Q-CHAT score; parent report Excluded: CP or severe neurosensory impairment (n = 10)
Adjusted for: language composite score from BSID-III at 2 yr
Higher deprivation, non-white ethnicity, BSID-III language composite score at 2 yr
   Johnson et al12 UK and Republic of Ireland, 1995 10–12 <26 wks PC of all live births in the UK and Republic of Ireland (EPICURE Study) 219 (71%) Total score from SCQ; parent report None No breast milk, IQ <2 SD at 6 yr, pervasive attentional and peer problems at 6 yr (SDQ), withdrawn (CBCL) at 2.5 yr
Autism spectrum disorder: positive screen
   Stephens et al38 United States, 2008–2010 1.5–1.9 <27 wks PC of infants admitted to the NICU of 15 centers participating in the multicenter NICHD NRN routine FUP 554 (74%) 1+ positive screen on 3 tests: PDDST-II (parent report), Response to Joint Attention and Response to Name (ADOS, direct observation) Excluded from all: severe CP, blind, deaf (n = 31)
Model 1: unadjusted
Model 2: adjusted for cognition and language at 18 m
Model 3: adjusted for cognition, language, and behavior at 18 m
Model 1: lower BW, non-white ethnicity, male sex
Model 2: male sex, lower cognitive and language composite score from BSID-III at 18 m
Model 3: lower cognitive and language composite score from BSID-III at 18 m, higher problem and lower competence score from BITSEA at 18 m
   Moore et al40,c England, 2006 2 <27 wks PC of all live births in England (EPICURE-2 Study) 559 (54%) Positive M-CHAT screen; parent report Model 1: full cohort
Model 2: excluded neurosensory impairment (n = 72)
Model 3: excluded any disability (n = 320)
Model 1: severe BPD, any CUSS abnormality, PN steroids, positive blood culture ≥72 hr, male sex
Model 2: positive blood culture ≥72 hr
Model 3: any CUSS abnormality, positive blood culture <72 hr and ≥72 hr, male sex
   Hack et al11 United States, 1992–1995 8 <1000 g PC of infants admitted to a single center NICU (Ohio) participating in the multicenter NICHD NRN routine FUP 219 (97%) CSI-4 based on DSM-IV-TR diagnostic criteria; parent report Each risk factor was fitted separately and adjusted sex, race, parental SES (p values not reported) BPD
Autism spectrum disorder: diagnosis
   Johnson et al12 UK and Republic of Ireland, 1995 10–12 <26 wks PC of all live births in the UK and Republic of Ireland (EPICURE Study) 219 (71%) DAWBA; parent report; DSM-IV-TR diagnosis assigned using scoring algorithm and clinical judgment of 2 blinded reviewers None Cognitive impairment at 6 yr, pervasive peer problems at 6 yr (SDQ)
Attention deficit/hyperactivity disorder: positive screen
   Hack et al11 United States, 1992–1995 8 <1000 g PC of infants admitted to a single center NICU (Ohio) participating in the multicenter NICHD NRN routine FUP 219 (97%) CSI-4 based on DSMIV-TR diagnostic criteria; parent report Each risk factor was fitted separately and adjusted sex, race, parental SES (p values not reported) None significant for hyperactive, inattentive, or combined type of ADHD
a

Percentage of survivors assessed for outcome measure specified.

b

Familial social risk was based on a composite measure of 6 social risk factors: family structure, education of primary caregiver, occupation and employment status of primary income earner, language spoken at home, and maternal age at birth.

c

Five further models were reported: 3 models using only risk factors known at birth for the full cohort, excluding all disability and excluding neurosensory disability; 2 models with more stringent criteria for a positive screen. ADHD, attention deficit/hyperactivity disorder; ADOS, Autism Diagnostic Observation Scales50; BPD, bronchopulmonary dysplasia; BSID, Bayley Scales of Infant Development44; BW, birth weight; BITSEA, Brief Infant-Toddler Social and Emotional Screening; CBCL, Child Behavior Checklist45; CP, cerebral palsy; CSI-4, Parent Child Symptom Inventory51; CUSS, cranial ultrasound abnormality; DAWBA, Development And Well-Being Assessment52; DSM-IV-TR, Diagnostic and Statistical Manual of Mental Disorders10; FUP, follow-up; GA, gestational age; M-CHAT, Modified Checklist for Autism in Toddlers53; IQ, intelligence quotient; NICU, neonatal intensive care unit; NICHD NRN, National Institutes of Child Health and Human Development Neonatal Research Network; NEC, necrotizing enterocolitis; PDDST, Pervasive Developmental Disorders Screening Test54; PC, prospective cohort; PN, postnatal; Q-CHAT, Quantitative Checklist for Autism in Toddlers55; SES, socioeconomic status; SDQ, Strengths and Difficulties Questionnaire47; and SCQ, Social Communication Questionnaire.56

Both studies examining the risk of any psychiatric disorder used the Development And Well-Being Assessment (DAWBA),52 which is a structured psychiatric evaluation administered to parents and teachers. In both studies, a DSM-IV-TR diagnosis was assigned by 2 blinded clinical psychologists aided by the DAWBA computer scoring algorithm for common childhood diagnoses, such as ADHD, ASD, and emotional and conduct disorders. The DAWBA has good concurrent validity when compared with clinical diagnoses.52 In the moderate-high risk of bias study conducted at 7 years of age,37 the prevalence of any DSM-IV-TR diagnosis was 24% in very preterm children, which was similar to 23% prevalence rate reported by the low-moderate risk of bias study conducted at 10 to 12 years of age in EPT children.9 The first study screened 11 candidate risk factors in a univariate analysis and retained 4 significant factors in the final model: brain abnormality at term, female sex, socioemotional problems at 5 years (SDQ), and higher familial social risk at 7 years (familial social risk was based on a composite measure of 6 social risk factors: family structure, education of primary caregiver, occupation and employment status of primary income earner, language spoken at home, and maternal age at birth). The second study entered 34 candidate risk factors into a multivariate forward stepwise regression model and retained 5 significant factors in the final model: necrotizing enterocolitis, internalizing behavior problems at 2.5 years (CBCL), pervasive attentional and conduct problems at 6 years (SDQ), and serious neurodevelopmental disability at 6 years. These findings suggest that behavioral problems identified by screening tests in infancy and early childhood may help to identify children at risk of developing a psychiatric disorder in later childhood.

The 5 studies examining risk factors for ASD were divided into those that assessed ASD symptoms using dimensional measures,12,39 the rate of positive screens using screening tools,11,38,40 and diagnoses made using a diagnostic evaluation12 (Table 2). The 2 studies reporting risk factor analyses for ASD symptoms were not comparable with respect to age of assessment, outcome measure used, gestational age group, exclusion criteria, risk of bias, and had no significant risk factors in common.12,39 However, similar to the findings for general behavioral problems (Table 1) and any psychiatric disorders (Table 2), markers of social deprivation and language development,39 and earlier cognitive and behavioral assessments12 were reported to be significantly associated with ASD symptoms later in childhood.

Of the 3 studies that presented risk factor analyses for a positive ASD screen, 2 were conducted in early childhood.38,40 One was a low-moderate risk of bias study38 that defined cases as children with at least 1 positive screen from 3 different screening tests at 18 months (Pervasive Developmental Disorders Screening Test-II54 and 2 items adapted from the Autism Diagnostic Observation Scales50). The second was a moderate-high risk of bias study40 that used the 23-item Modified Checklist for Autism in Toddlers53 at 2 years. The third study, also at moderate-high risk of bias, was conducted in later childhood at 8 years11 using the 12 items related to Autistic Disorder from the Parent Child Symptom Inventory.51 Among these studies, the prevalence of a positive ASD screen varied greatly; 20%, 41%, and 2%, respectively, likely reflecting differences in population denominators and screening tools. Bronchopulmonary dysplasia and male sex were significant risk factors in 2 of 3 of these studies, but there were no other significant risk factors in common. The low-moderate risk of bias ASD screening study38 presented 2 additional models adjusting for language, cognition, and social-emotional behavioral problems, at the same age of assessment, all of which were significant.

Only 1 low-moderate risk of bias study conducted at 10 to 12 years of age assigned ASD diagnosis based on standard diagnostic DSM-IV-TR criteria, using the DAWBA.12 The prevalence of an ASD diagnosis was 8% (n = 16 cases): 13 (6.5%) with autistic disorder and 3 (1.5%) with pervasive developmental disorder not otherwise specified. The risk prediction model was based on any ASD diagnosis and after entering 42 candidate variables sequentially into a multivariate stepwise model, only 2 factors remained significant; cognitive impairment and pervasive peer problems at 6 years of age (SDQ).

The only study that presented a risk factor analysis for a positive screen for ADHD11 did not report any significant risk factors for either hyperactive, inattentive, or the combined type of ADHD. The prevalence of a positive screen for ADHD was reported to be 17% (n = 37) in this study.

Discussion

Summary of Findings

The 8 studies reporting risk factor analysis for general behavioral problems (Table 1) in children born very preterm (VPT)/very low birth weight (VLBW) all had a moderate to high risk of bias, with 1 exception,32 and the screening tools used were fairly heterogeneous with different subdomains assessed. The modeling of outcome scores also varied with some studies reporting the proportion of children scoring above the cutoff for a positive screen and others analyzing continuous scores. The studies also differed in the way children with neurodevelopmental delay or disability were handled in the design and analysis; some studies excluded them completely, some adjusted for motor and/or cognitive impairment, and some adopted both or neither strategy. There was also a lack of commonality in the risk factors studied for prognosis; therefore, it was difficult to synthesize the results and reach any meaningful conclusion. The only factors that seemed to be consistent predictors of general behavioral problems were markers of socioeconomic deprivation and neurodevelopmental or cognitive delay, but apart from these, there was no clear evidence about the prognostic value of any other risk factors studied.

Two studies examined the risk of developing a Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) psychiatric disorder in later childhood9,37 and reported that social-emotional and behavioral problems identified by screening questionnaires in infancy or early childhood were predictive of later disorders. This finding is supported by other studies that have examined the predictive validity of screening tests and the stability of diagnoses over time.57,58 Early screening tests are known to identify a large number of false-positives, particularly in impaired populations with high rates of neurologic and cognitive impairment,5 so the positive predictive value for later psychiatric diagnoses may be low. There is also a lack of evidence about how sensitive these general screening tests are for predicting specific types of DSM-IV-TR disorder. However, there is evidence of enhanced specificity in prediction in VPT/extremely preterm (EPT) populations for both general disorders and specific behavioral outcomes.59 Given the stability in neurodevelopmental and behavioral outcomes in VPT/VLBW children, early screening may thus have greater predictive validity and clinical utility in preterm populations.

The only factors consistently associated with autism spectrum disorder (ASD) symptoms, positive screen or diagnosis, were cognitive or language impairment, and poor performance on a behavioral screening test earlier in childhood. Aside from this, no clear evidence emerged for any other risk factors. The number of cases with an ASD diagnosis was very small in the study conducted in later childhood using DSM-IV-TR–based diagnostic criteria,12 so a lack of power means that results should be interpreted with caution. Only 1 study presented a risk factor analysis for a positive screen for attention deficit/hyperactivity disorder (ADHD) and no significant factors were identified.11

Explanation of Findings

An explanation for the inconclusive findings, beside the small number of studies examining each type of disorder and the lack of commonality in the candidate risk factors studied, is the several different strategies used for dealing with confounding due to neurologic and cognitive impairment. In some studies, the whole cohort was included, representing the whole spectrum of disability in the VPT/VLBW population. In other studies, children with neurological and/or cognitive impairment were excluded from the modeling process to identify risk factors in a more homogeneous population and to eliminate the noise created by additional impairments. Other studies attempted to achieve this by adjusting for these factors in the analysis. The risk factors for a psychiatric disorder in the absence of any impairment may be very different from those factors, which are prognostic for behavioral difficulties accompanying profound impairment. Therefore, the strategy for dealing with motor, neurosensory, and cognitive impairment in risk factor analyses, in terms of exclusion and/or adjustment, will crucially affect the findings. Adjustment for cognitive impairment is particularly problematic as it is frequently associated with psychiatric conditions in the term population; adjustment in a VPT/VLBW population where cognitive delay is more common and part of the preterm phenotype might lead to overcorrection.60

Very preterm/VLBW children with motor or cognitive impairment have been reported to be at higher risk of developing behavioral and emotional problems, compared with VPT/VLBW children with no impairments.61 It is possible that the challenge of living with a profound impairment could induce feelings of anxiety, insecurity, and detachment, which then manifests as a behavioral problem. However, the high rate of problems in children with neurodevelopmental impairments may also be related to measurement issues. In a cohort of 2-year-old EPT children, Kuban et al62 reported that increased odds of a positive screen for autism using the Modified Checklist for Autism in Toddlers (M-CHAT) among those unable to sit or stand was 23-fold, 8-fold in those with a major vision or hearing impairment, and 13-fold in those with severe cognitive impairment, compared with EPT children without such impairments. Moore et al40 reported similar findings in a cohort of EPT children at 2 years; 16.5% of children without disability screened positive on the M-CHAT compared with 96% with severe motor impairment, 56% with cognitive impairment, and all children with a significant vision or hearing impairment. However, such findings should be interpreted with caution, as many items on the M-CHAT rely on an intact motor, hearing, and vision function, which leads to an inflated false-positive rate among children with impairment(s) of these functions. Indeed, a recent study has shown that screening for autism using the M-CHAT questionnaire was especially confounded in a preterm population.63 However, the rate of positive screens was still 3-fold higher among unimpaired EPT children compared with unselected populations;62 hence, neurological impairment cannot be the sole explanation for the differences observed. Even so, it is difficult to disentangle the etiology of neurobehavioral disorders in the context of the neurological sequelae that follow VPT birth.

Strengths and Limitations

We used a broad search filter with no language restriction to capture all studies with exploratory risk factor analyses, which is recommended in this type of review.64 No further articles were identified in the hand search of bibliographies of all studies included, so it is unlikely that there were any major omissions. The study cohorts spanned a 20-year period and represent diverse international populations with differing methods of ascertainment and clinical practices, which may also explain the inconclusive results. Also, studies did not consider the same sets of candidate factors. Some prognostic factors for behavioral problems are likely to be interrelated; therefore, we focused our systematic review on studies in which multivariable prediction models were used as these take account of any multicollinearity between variables during the development process. One challenge in this review was the lack of independence between observations, arising from studies based on the same cohort population or single studies reporting more than 1 model. We selected studies for inclusion before data synthesis was conducted using standard rules, although it was difficult apply a strict set of criteria for each case. There was no evidence that gestational age (GA) was a predictor of behavioral or psychiatric problems, despite recent studies demonstrating a gradient of risk of poor neurodevelopment with decreasing GA across the full GA spectrum.65,66 However, this review included only a restricted range of children born VPT/VLBW. A significant association with GA may be more likely to be observed if children born across the full spectrum of GA were studied.

Recommendations

This systematic review points the need for further well-conducted research investigating risk factors for psychiatric disorders and behavioral problems in the VPT/VLBW population. Such conditions are common after VPT birth and can have an adverse impact on the lives of children and their families. As such, the identification of predictive factors is important for understanding etiological mechanisms and for developing appropriate screening, intervention, and treatment strategies. Studies with larger sample sizes and greater power are needed for studying childhood psychiatric disorders in this population, particularly for less common conditions such as ASD or ADHD. Longer term follow-up with outcome evaluations beyond 18 to 24 months is also needed, as the risk for psychiatric disorders cannot be reliably assessed at this age and because of the natural course of some disorders, which may onset later in childhood. Furthermore, prognosis is likely to be a dynamic process with social and environmental factors potentially superseding the influence of early clinical and biological factors as the child grows up. This review included studies using both GA and birth weight criteria to define the study population, but future studies evaluating behavioral problems and psychiatric disorders in preterm infants should use cohorts defined solely by GA. This avoids the distorted birth weight distribution created in the study population when GA is paired with a birth weight criterion.

The risk of bias assessment identified a number of improvements that could be made to the design, conduct, and reporting of future studies that should be made in accordance with the recent TRIPOD guidelines on the transparent reporting of prognostic research.26 We recommend as standard the reporting of attrition and missing data, the use of standard diagnostic evaluations to assess outcome, the evaluation of a broad range of biologic and social risk factors over time, and a clear statement and rationale as to the inclusion or exclusion of children with cognitive or neurologic impairment. Future studies could also go beyond the scope of fitting risk factor models and test the robustness of their performance over time and in other independent cohorts using methods of statistical validation.

Supplementary Material

Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal’s Web site (www.jdbp.org).

Supplementary material 1
Supplementary material 2
Supplementary material 3

Acknowledgments

The authors thank Nia Wyn Roberts (MSc Econ), Outreach Librarian, Bodleian Health Care Libraries, Knowledge Centre, ORC Research Building, Old Road Campus, Headington, Oxford OX3 7DQ for her input and expertise during the search phase of the review.

This article presents independent research funded by the National Institute for Health Research (NIHR). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Supported by a NIHR Doctoral Research Fellowship Award, NIHR-DRF-2012-05-206.

Footnotes

Disclosure: The authors declare no conflict of interest.

References

  • 1.Tucker J, McGuire W. Epidemiology of preterm birth. BMJ. 2004;329:675–678. doi: 10.1136/bmj.329.7467.675. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Goldenberg RL, Culhane JF, Iams JD, et al. Epidemiology and causes of preterm birth. Lancet. 2008;371:75–84. doi: 10.1016/S0140-6736(08)60074-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Farooqi A, Hagglof B, Sedin G, et al. Mental health and social competencies of 10 to 12 year-old children born at 23 to 25 weeks of gestation in the 1990s: a Swedish national prospective follow-up study. Pediatrics. 2007;120:118–133. doi: 10.1542/peds.2006-2988. [DOI] [PubMed] [Google Scholar]
  • 4.Johnson S, Marlow N. Preterm birth and childhood psychiatric disorders. Pediatr Res. 2011;69(5 pt 2):11R–18R. doi: 10.1203/PDR.0b013e318212faa0. [DOI] [PubMed] [Google Scholar]
  • 5.Johnson S, Hollis C, Hennessy E, et al. Screening for autism in preterm children: diagnostic utility of the social communication questionnaire. Arch Dis Child. 2011;96:73–77. doi: 10.1136/adc.2010.194795. [DOI] [PubMed] [Google Scholar]
  • 6.Glascoe FP. Screening for developmental and behavioral problems. Ment Retard Dev Disabil Res Rev. 2005;11:173–179. doi: 10.1002/mrdd.20068. [DOI] [PubMed] [Google Scholar]
  • 7.Limperopoulos C, Bassan H, Sullivan NR, et al. Positive screening for autism in ex-preterm infants: prevalence and risk factors. Pediatrics. 2008;121:758–765. doi: 10.1542/peds.2007-2158. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Bhutta AT, Cleves MA, Casey PH, et al. Cognitive and behavioral outcomes of school-aged children who were born preterm: a meta-analysis. JAMA. 2002;288:728–737. doi: 10.1001/jama.288.6.728. [DOI] [PubMed] [Google Scholar]
  • 9.Johnson S, Hollis C, Kochhar P, et al. Psychiatric disorders in extremely preterm children: longitudinal finding at age 11 years in the EPICure study. J Am Acad Child Adolesc Psychiatry. 2010;49:453–463.e1. [PubMed] [Google Scholar]
  • 10.American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th ed. Washington, DC: American Psychiatric Association; 2000. [Google Scholar]
  • 11.Hack M, Taylor HG, Schluchter M, et al. Behavioral outcomes of extremely low birth weight children at age 8 years. J Dev Behav Pediatr. 2009;30:122–130. doi: 10.1097/DBP.0b013e31819e6a16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Johnson S, Hollis C, Kochhar P, et al. Autism spectrum disorders in extremely preterm children. J Pediatr. 2010;156:525–531.e2. doi: 10.1016/j.jpeds.2009.10.041. [DOI] [PubMed] [Google Scholar]
  • 13.Indredavik MS, Vik T, Heyerdahl S, et al. Psychiatric symptoms and disorders in adolescents with low birth weight. Arch Dis Child Fetal Neonatal Ed. 2004;89:F445–F450. doi: 10.1136/adc.2003.038943. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Saigal S, Pinelli J, Hoult L, et al. Psychopathology and social competencies of adolescents who were extremely low birth weight. Pediatrics. 2003;111:969–975. doi: 10.1542/peds.111.5.969. [DOI] [PubMed] [Google Scholar]
  • 15.Moster D, Terje R, Markestad T. Long-term medical and social consequences of preterm birth. N Engl J Med. 2008;359:262–273. doi: 10.1056/NEJMoa0706475. [DOI] [PubMed] [Google Scholar]
  • 16.Lindstrom K, Lindblad F, Hjern A. Psychiatric morbidity in adolescents and young adults born preterm: a Swedish national cohort study. Pediatrics. 2009;123:e47–e53. doi: 10.1542/peds.2008-1654. [DOI] [PubMed] [Google Scholar]
  • 17.Hille ET, den Ouden AL, Saigal S, et al. Behavioural problems in children who weigh 1000g or less at birth in four countries. Lancet. 2001;357:1641–1643. doi: 10.1016/S0140-6736(00)04818-2. [DOI] [PubMed] [Google Scholar]
  • 18.Perlman JM. Neurobehavioral deficits in premature graduates of intensive care—potential medical and neonatal environmental risk factors. Pediatrics. 2001;108:1339–1348. doi: 10.1542/peds.108.6.1339. [DOI] [PubMed] [Google Scholar]
  • 19.Sapolsky RM. Why stress is bad for your brain. Science. 1996;273:749–750. doi: 10.1126/science.273.5276.749. [DOI] [PubMed] [Google Scholar]
  • 20.Burnett AC, Anderson PJ, Cheong J, et al. Prevalence of psychiatric diagnoses in preterm and full-term children, adolescents and young adults: a meta-analysis. Psychol Med. 2011;41:2463–2474. doi: 10.1017/S003329171100081X. [DOI] [PubMed] [Google Scholar]
  • 21.Baron IS, Rey-Casserly C. Extremely preterm birth outcome: a review of four decades of cognitive research. Neuropsychol Rev. 2010;20:430–452. doi: 10.1007/s11065-010-9132-z. [DOI] [PubMed] [Google Scholar]
  • 22.Hack M, Fanaroff AA. Outcomes of children of extremely low birthweight and gestational age in the 1990’s. Early Hum Dev. 1999;53:193–218. doi: 10.1016/s0378-3782(98)00052-8. [DOI] [PubMed] [Google Scholar]
  • 23.Arnold CC, Kramar MS, Hobbs CA, et al. Very low birth weight: a problematic cohort for epidemiologic studies of very small or immature neonates. Am J Epidemiol. 1991;134:604–613. doi: 10.1093/oxfordjournals.aje.a116133. [DOI] [PubMed] [Google Scholar]
  • 24.Van den Berg T, Heymans MW, Leone SS, et al. Overview of data-synthesis in systematic reviews of studies on outcome prediction models. BMC Med Res Methodol. 2013;13:42. doi: 10.1186/1471-2288-13-42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Riley RD, Hayden JA, Steyerberg EW, et al. Prognosis research strategy (PROGRESS) 2: prognostic factor research. PLoS Med. 2013;10:e1001380. doi: 10.1371/journal.pmed.1001380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Collins G, Reitsma JB, Altman DG, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. J Clin Epidemiol. 2015;68:134–143. doi: 10.1016/j.jclinepi.2014.11.010. [DOI] [PubMed] [Google Scholar]
  • 27.Hayden JA, Van der Windt DA, Cartwright JL, et al. Asessing bias in studies of prognostic factors. Ann Intern Med. 2013;158:280–286. doi: 10.7326/0003-4819-158-4-201302190-00009. [DOI] [PubMed] [Google Scholar]
  • 28.Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535. doi: 10.1136/bmj.b2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Stoelhorst GM, Martens SE, Rijken M, et al. Behaviour at 2 years of age in very preterm infants (gestational age < 32 weeks) Acta Paediatr. 2003;92:595–601. [PubMed] [Google Scholar]
  • 30.Spittle AJ, Treyvaud K, Doyle LW, et al. Early emergence of behavior and social-emotional problems in very preterm infants. J Am Acad Child Adolesc Psychiatry. 2009;48:909–918. doi: 10.1097/CHI.0b013e3181af8235. [DOI] [PubMed] [Google Scholar]
  • 31.Peralta-Carcelen M, Bailey K, Rector R, et al. Behavioral and socioemotional competence problems of extremely low birth weight children. J Perinatol. 2013;33:887–892. doi: 10.1038/jp.2013.78. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Delobel-Ayoub M, Kaminski M, Marret S, et al. Behavioral outcome at 3 years of age in very preterm infants: the EPIPAGE study. Pediatrics. 2006;117:1996–2005. doi: 10.1542/peds.2005-2310. [DOI] [PubMed] [Google Scholar]
  • 33.Jones KM, Champion PR, Woodward LJ. Social competence of preschool children born very preterm. Early Hum Dev. 2013;89:795–802. doi: 10.1016/j.earlhumdev.2013.06.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Delobel-Ayoub M, Arnaud C, White-Koning M, et al. Behavioral problems and cognitive performance at 5 years of age after very preterm birth: the EPIPAGE study. Pediatrics. 2009;123:1485–1492. doi: 10.1542/peds.2008-1216. [DOI] [PubMed] [Google Scholar]
  • 35.Stahlmann N, Rapp M, Herting E, et al. Outcome of extremely premature infants at early school age: health-related quality of life and neurosensory, cognitive, and behavioral outcomes in a population-based sample in northern Germany. Neuropediatrics. 2009;40:112–119. doi: 10.1055/s-0029-1243166. [DOI] [PubMed] [Google Scholar]
  • 36.Taylor HG, Klein N, Drotar D, et al. Consequences and risks of <1000-g birth weight for neuropsychological skills, achievement, and adaptive functioning. J Dev Behav Pediatr. 2006;27:459–469. doi: 10.1097/00004703-200612000-00002. [DOI] [PubMed] [Google Scholar]
  • 37.Treyvaud K, Ure A, Doyle LW, et al. Psychiatric outcomes at age seven for very preterm children: rates and predictors. J Child Psychol Psychiatry. 2013;54:772–779. doi: 10.1111/jcpp.12040. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Stephens BE, Bann CM, Watson VE, et al. Screening for autism spectrum disorders in extremely preterm infants. J Dev Behav Pediatr. 2012;33:535–541. doi: 10.1097/DBP.0b013e31825fd0af. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Wong HS, Huertas-Ceballos A, Cowan FM, et al. Evaluation of early childhood social-communication difficulties in children born preterm using the quantitative checklist for autism in toddlers. J Pediatr. 2014;164:26–33. doi: 10.1016/j.jpeds.2013.07.013. [DOI] [PubMed] [Google Scholar]
  • 40.Moore T, Johnson S, Hennessy E, et al. Screening for autism in extremely preterm infants: problems in interpretation. Dev Med Child Neurol. 2012;54:514–520. doi: 10.1111/j.1469-8749.2012.04265.x. [DOI] [PubMed] [Google Scholar]
  • 41.Charkaluk ML, Truffert P, Fily A, et al. Neurodevelopment of children born very preterm and free of severe disabilities: the Nord-Pas de Calais Epipage cohort study. Acta Paediatr. 2010;99:684–689. doi: 10.1111/j.0803-5253.2010.01695.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Messinger D, Lambert B, Bauer CR, et al. The relationship between behavior ratings and concurrent and subsequent mental and motor performance in toddlers born at extremely low birth weight. J Early Interv. 2010;32:214–233. doi: 10.1177/1053815110380917. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Briggs-Gowan MJ, Carter AS, Irwin JR, et al. The brief infant toddler social and emotional assessment: screening for social-emotional problems and delays in competence. J Pediatr Psychol. 2004;29:143–155. doi: 10.1093/jpepsy/jsh017. [DOI] [PubMed] [Google Scholar]
  • 44.Bayley N. Bayley Scales of Infant Development-II. 2nd ed. San Antonio, TX: Psychological Corporation; 1993. [Google Scholar]
  • 45.Achenbach TM. Manual for the Child Behavior Checklist/2-3 and 1992 Profile. Burlington, Canada: University of Vermont, Department of Psychiatry; 1992. [Google Scholar]
  • 46.Briggs-Gowan MJ, Carter AS. The Infant Toddler Social and Emotional Assessment (ITSEA). Pre-Publication Version. Boston, MA: Yale University; 2000. [Google Scholar]
  • 47.Goodman R. The Strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;1997:581–586. doi: 10.1111/j.1469-7610.1997.tb01545.x. [DOI] [PubMed] [Google Scholar]
  • 48.Sparrow SS, Carter AS, Cicchetti DV. Vineland Screener: Overview, Reliability, Validity, Administration and Scoring. New Haven, CT: Yale University; 2000. [Google Scholar]
  • 49.Goodman R, Scott S. Comparing the strengths and difficulties questionnaire and the child behavior checklist: is small beautiful? J Abnorm Child Psychol. 1999;27:17–24. doi: 10.1023/a:1022658222914. [DOI] [PubMed] [Google Scholar]
  • 50.Lord C, Rutter M, DiLavore PC. Autism Diagnostic Observation Schedule Manual. Los Angeles, CA: Western Psychological Services; 2001. [Google Scholar]
  • 51.Gadow KD, Sprafkin J. Child Symptom Inventory-4 Norms Manual. Stony Brook, NY: Checkmate Plus Ltd; 1997. [Google Scholar]
  • 52.Goodman R, Ford T, Richards H, et al. The development and well-being assessment: description and initial valuation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry. 2000;41:645–655. [PubMed] [Google Scholar]
  • 53.Robins DL, Dumont-Mathieu TM. Early screening for autism spectrum disorders: update on modified checklist for autism in toddlers and other measures. J Dev Behav Pediatr. 2006;27(suppl 2):S111–S119. doi: 10.1097/00004703-200604002-00009. [DOI] [PubMed] [Google Scholar]
  • 54.Siegel B. Pervasive Developmental Disorders Screening Test-II. San Antonio, TX: PsychCorp; 2004. [Google Scholar]
  • 55.Allison C, Baron-Cohen S, Wheelwright S, et al. The Q-CHAT (Quantitative Checklist for Autism in Toddlers): a normally distributed quantitative measure of autistic traits at 18–24 months of age: preliminary report. J Autism Dev Disord. 2008;38:1414–1425. doi: 10.1007/s10803-007-0509-7. [DOI] [PubMed] [Google Scholar]
  • 56.Rutter M, Bailey A, Lord C. The Social Communication Questionnaire. Los Angeles, CA: Western Psychological Services; 2003. [Google Scholar]
  • 57.Treyvaud K, Doyle LW, Lee KJ, et al. Social-emotional difficulties in very preterm and term 2 year olds predict specific social-emotional problems at the age of 5 years. J Pediatr Psychol. 2012;37:779–785. doi: 10.1093/jpepsy/jss042. [DOI] [PubMed] [Google Scholar]
  • 58.Gray RF, Indurkhya A, McCormick MC. Prevalence, stability, and predictors of clinically significant behavior problems in low birth weight children at 3, 5, and 8 years of age. Pediatrics. 2004;114:736–743. doi: 10.1542/peds.2003-1150-L. [DOI] [PubMed] [Google Scholar]
  • 59.Johnson S, Marlow N. Growing up after extremely preterm birth: lifespan mental health outcomes. Semin Fetal Neonatal Med. 2014;19:97–104. doi: 10.1016/j.siny.2013.11.004. [DOI] [PubMed] [Google Scholar]
  • 60.Dennis M, Francis DJ, Cirino PT, et al. Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders. J Int Neuropsychol Soc. 2009;15:331–343. doi: 10.1017/S1355617709090481. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Doyle LW, Bowman E, Callanan C, et al. Postnatal corticosteroids and sensorineural outcome at 5 years of age. J Paediatr Child Health. 2000;36:256–261. doi: 10.1046/j.1440-1754.2000.00493.x. [DOI] [PubMed] [Google Scholar]
  • 62.Kuban KC, O’Shea MT, Allred EN, et al. Positive screening on the Modified Checklist for Autism in Toddlers (M-CHAT) in extremely low gestational age newborns. J Pediatr. 2009;154:535–540. doi: 10.1016/j.jpeds.2008.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Guy A, Seaton SE, Boyle EM, et al. Infants born late/moderately preterm are at increased risk for a positive autism screen at 2 years of age. J Pediatr. 2015;166:269–275. doi: 10.1016/j.jpeds.2014.10.053. [DOI] [PubMed] [Google Scholar]
  • 64.Geersing GJ, Bouwmeester W, Zuithoff P, et al. Search filters for finding prognostic and diagnostic prediction studies in medline to enhance systematic reviews. PLoS One. 2012;7:e32844. doi: 10.1371/journal.pone.0032844. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.MacKay DF, Smith GCS, Dobbie R, et al. Gestational age at delivery and special educational need: retrospective cohort of 407,503 schoolchildren. PLoS Med. 2010;7:e1000289. doi: 10.1371/journal.pmed.1000289. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Poulsen G, Wolke D, Kurinczuk JJ, et al. Gestational age and cognitive ability in early childhood: a population-based cohort study. Paediatr Perinat Epidemiol. 2013;27:371–379. doi: 10.1111/ppe.12058. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary material 1
Supplementary material 2
Supplementary material 3

RESOURCES