Skip to main content
Thyroid logoLink to Thyroid
. 2012 Feb;22(2):178–186. doi: 10.1089/thy.2011.0318

Maternal Thyroid Autoimmunity During Pregnancy and the Risk of Attention Deficit/Hyperactivity Problems in Children: The Generation R Study

Akhgar Ghassabian 1,,2, Jacoba J Bongers-Schokking 3, Yolanda B de Rijke 4,,5, Nina van Mil 1,,2, Vincent WV Jaddoe 6,,7, Sabine MPF de Muinck Keizer-Schrama 3, Herbert Hooijkaas 8, Albert Hofman 6, Willy Visser 9, Gustavo C Roman 10, Theo J Visser 4, Frank C Verhulst 2, Henning Tiemeier 2,,6,
PMCID: PMC3271370  PMID: 22175242

Abstract

Background

Maternal thyroid status and autoimmunity during pregnancy have been associated with impaired development of the offspring in animal and human studies. Our objective was to examine whether elevated titers of maternal thyroid peroxidase antibodies (TPOAbs) in early pregnancy increased the risk of cognitive impairment and problem behavior in preschool children. Second, we aimed at exploring to what extent any effect on child behavior was mediated by maternal thyroid parameters during pregnancy.

Methods

In the Generation R Study, a population-based cohort of 3139 children and their mothers, we measured maternal thyroid parameters (thyrotropin [TSH], free Thyroxine, and TPOAbs) at 13.5±1.8 weeks of gestation. Children's verbal and nonverbal cognitive functioning was measured at 2.5 years using the Language Development Survey and the Parent Report of Children Abilities. At 3 years, children's behavior was assessed using the Child Behavior Checklist.

Results

Elevated titers of TPOAbs during pregnancy did not predict the verbal and nonverbal cognitive functioning of the children. However, elevated titers of TPOAbs in mothers were associated with externalizing problems in children (odds ratio [OR]=1.64, 95% confidence interval [CI]: 1.17–2.29, p=0.004). In particular, children of TPOAb-positive mothers were at a higher risk of attention deficit/hyperactivity problems (OR=1.77, 95% CI: 1.15–2.72, p=0.01). To explore whether the effect of maternal TPOAbs on child problem behavior was mediated by maternal thyroid parameters, we added maternal TSH to the model. After correcting for TSH, the effect of TPOAbs on externalizing problems was attenuated slightly but remained significant (OR=1.56, 95% CI: 1.14, 2.14, p=0.005).

Conclusions

Our findings imply that the elevated titers of TPOAbs during pregnancy impact children's risk of problem behavior, in particular, attention deficit/hyperactivity. The observed effect is only partially explained by maternal TSH levels. These findings may point to a specific mechanism of Attention Deficit/Hyperactivity Disorder in children. Nevertheless, we can only speculate about public health implication of the study, as there is no specific treatment for TPOAb-positive pregnant women with normal thyroid function. Further investigation is needed to explore whether TPOAb-positive pregnant women and their children can benefit from close monitoring and early detection of developmental delay in populations at risk.

Introduction

In women of reproductive age, autoimmunity is the most common cause of thyroid dysfunction in iodine-sufficient areas. Although slightly down-regulated during pregnancy (1), thyroid autoantibodies are seen in 10% of women even with normal thyroid function (2). Among thyroid autoantibodies, Thyroid Peroxidase Antibodies (TPOAbs) are considered the most sensitive and specific marker of thyroid autoimmunity (3). Previous studies showed that, in women with normal thyrotropin (TSH) and free thyroxine (fT4), elevated titers of TPOAbs are associated with pregnancy complications (4), preterm birth (5), abnormal fetal growth (6), and prenatal/postnatal depression symptoms (7,8).

An effect of maternal thyroid dysfunction during pregnancy on the cognitive function of the child such as intelligence and language is well recognized (9,10). In addition, there is evidence for the association between thyroid function and attention deficit/hyperactivity disorder (ADHD) (1113). Previously, we reported that maternal thyroid dysfunction in early pregnancy predicted impaired cognition and attention deficit/hyperactivity problems in preschool children (14,15). This led us to explore whether elevated titers of TPOAbs in pregnant women underlie the relation of maternal thyroid dysfunction with the offspring's cognitive and behavioral development. Few studies address the role of maternal TPOAbs during pregnancy and the association with cognitive functioning of the child (16,17). Within a sample of about 300 pregnant women, Pop et al. reported that the children of TPOAb-positive women with normal thyroid status are at a risk of cognitive dysfunction (17). They argued that it is “autoimmunity rather than thyroid hormone insufficiency” which affects the child's development. Recent evidence on the role of the autoimmune process in the psychiatric disorders in childhood supports this theory (18,19). In a retrospective study within a general population sample, Li et al. found that maternal thyroid hormones and TPOAbs were associated with intelligence and motor scores in young children. It is less clear whether maternal thyroid autoimmunity during pregnancy can affect the child's problem behavior, in particular, attention deficit/hyperactivity problems. Elevated titer of TPOAbs in pregnant woman may primarily affect the child's cognition and behavior by causing some degree of thyroid dysfunction in the mother or the child. However, down-regulated general autoimmune condition of the mother during pregnancy may also be a possible explanatory pathway for the association of maternal TPOAbs with child behavior and cognition (for conceptual model, see Supplementary Fig. S1; Supplementary Data are available online at www.liebertonline.com/thy).

Against this background, we designed the present study to examine whether maternal thyroid autoimmunity during the first half of pregnancy increases the risk of cognitive impairment and problem behavior in preschool children. First, we studied whether maternal thyroid autoimmunity predicted the risk of verbal and nonverbal cognitive impairment and problem behavior, in particular, attention deficit/hyperacidity problems. Second, we explored whether any effect is mediated by maternal plasma TSH during pregnancy.

Materials and Methods

Study design and participants

This study was carried out within the Generation R Study, a population-based cohort from early fetal life onward in Rotterdam, the Netherlands. Pregnant women with expected delivery date between April 2002 and January 2006 in the city of Rotterdam were eligible and were invited to participate in the study during their first prenatal visit. While enrollment ideally took place in early pregnancy, it was also possible until after the birth of the child. In total, 9778 mothers and their children were enrolled in the study (participation rate 61%). Blood sampling was performed in about 70% of the participants in early pregnancy (<18 weeks of gestation), from which 4804 pregnant women had their thyroid parameters measured in the blood and gave consent for postnatal assessment. The design and cohort profile of the Generation R Study has been described in detail by Jaddoe et al. (2023). In our sample, 34 women had a history of thyroid medication during pregnancy and were excluded from all analyses. The remaining 4770 pregnant women were eligible for analyses. Of these, we obtained the follow-up data of the behavior in 3139 children.

Although maternal blood sampling had been performed during pregnancy, the measurement of thyroid parameters was performed after the delivery of the child. The parents, as the information source for all outcome measures, were not informed about the results of the tests (except one clinical case that was excluded from this study). The anonymity of respondents was preserved within all steps of data gathering and analyses. The Medical Ethics Committee of the Erasmus Medical Center, Rotterdam, approved the study. Written informed consent was obtained from adult participants.

Problem behavior, verbal and nonverbal cognition were assessed using two mailed questionnaires. The questionnaires were available in three languages (Dutch, English, and Turkish). If needed, further support for verbal translation of questionnaires was available in Arabic, Portuguese (Cape Verdeans), and French. The parents chose the language of the questionnaire they received.

Thyroid parameters

Maternal blood samples were collected in early pregnancy (mean=13.5±1.8 weeks of gestation, range: 7.9–17.9 weeks). In addition, the cord blood was obtained immediately after birth in 2121 neonates of the study population. Within 24 hours after sampling, the maternal and cord blood samples were stored at −70°C. The TSH, fT4, and TPOAb were determined in batches, which had been stored for 6 months, using chemiluminescence assays (Vitros ECI Immunodiagnostic System Ortho Clinical Diagnostics, Rochester, NY). The interassay and intra-assay coefficients of variation for TSH were 2.5%–4.1% and 1.0%–1.2% as previously reported (14). The respective coefficients for fT4 were 4.7%–5.4% and 1.4%–2.7%. Maternal TPOAbs were measured using the Phadia 250 immunoassay (Phadia AB, Uppsala, Sweden). TPOAb status was defined as positive when the plasma concentrations were ≥100 IU/mL using the laboratory's reference values. To rule out the effect of cut-off choice, we also tested an alternative cut-off of 60 IU/mL to define TPOAb-positive women. We used the reference values for maternal thyroid parameters as recommended by The Endocrine Society Clinical Practice Guideline (2007) (24).

Verbal and nonverbal cognitive functioning

We used the Language Development Survey (LDS) to identify children with language delay (25). From a checklist of 310 words, the caregivers (mostly mothers) were asked to circle the words that the child used spontaneously and indicate whether the child combined two or more words together. The LDS could be filled out for a child whose first language was not Dutch, English, or Turkish if one of the parents could read one of these languages in which we provided the questionnaires. For words the child said in another language, the parents could add a letter to the Dutch version of the test. The LDS is an instrument with excellent test-retest reliability and extremely high validity. It has high sensitivity and specificity, which makes it a proper instrument for the identification of language delay in toddlers (25,26). It has been shown to predict language and language-related problems later in life (27). We obtained a vocabulary sum score by adding the number of words and a total score of phrase length from the average number of words in a phrase. Gender- and age-specific percentiles were derived in our sample as described in the Manual for ASEBA Preschool Forms and Profiles (25). Vocabulary scores ≤15th percentile and phrase scores ≤20th percentile suggest delayed language development as recommended by Achenbach and Rescorla (25). These age- and gender-specific cut-offs were derived by calculating a cumulative frequency distribution of vocabulary scores and lengths of phrase in a normalized sample of boys and girls. The Cronbach's alpha coefficient of the LDS in our sample was 0.99.

Nonverbal cognitive functioning of the children was assessed using the parent-administered and the parent-report parts of the Parent Report of Children's Ability (PARCA) (28). The parent-administered part has 22 items and assesses three subsets of functioning in children: matching-to-sample, block building, and imitation. The parent-report part consists of 26 questions on qualitative abilities, symbolic play, planning and organizing, adaptive behaviors, and memory. The PARCA can provide valid estimates of the child's nonverbal cognitive abilities at the age of two. The parent-administered and parent-report components of PARCA are good predictors of the child's cognitive performance by tester-administered assessments (28). Using PARCA, the parents have the chance to assess their children's performance in a natural environment, whereas standard cognitive testing requires young children to perform in the presence of a stranger. Nonverbal cognitive delay was defined as nonverbal cognitive scores below the 15th age- and gender-specific percentile as previously described in another study of this cohort (15).

Among the group with data on TPOAbs, the parents of the 3020 children filled out the questionnaires when their children were at 2.5 years (31±2 months).

Problem behavior

We used the Child Behavior Checklist 1½–5 (CBCL/1½–5) for preschoolers to obtain a standardized rating of the child's problem behavior by parents (25). The CBCL/1½–5 contains 99 problem items, scored on seven empirically based syndromes that were derived by factor analyses: emotionally reactive, anxious/depressed, somatic complaints, withdrawn, sleep problems, attention problems, and aggressive behavior. Two broad groupings of syndromes can be derived from CBCL/1½–5: internalizing and externalizing problem scores. The internalizing score is derived by summing the following subscales: emotionally reactive, anxious/depressed, somatic complains, and withdrawn. The externalizing scale consists of the attention problems and aggressive behavior scales. The parents were asked to rate emotions and behavior of their child based on the preceding 2 months on a 3-point scale: 0=not true, 1=somewhat or sometimes true, and 2=very true or often true. The 8-day stability estimate and the internal consistency (Cronbach's alpha) of internalizing and externalizing syndrome scales of CBCL/1½–5 vary between 0.88 and 0.92 (29). The reliability and validity of the Dutch translation has been demonstrated (30), and the syndrome scales derived from CBCL/1½–5 had a good fit in 23 studies across diverse societies (31).

In the present study, we also used the scales consistent with diagnostic categories of the 4th edition of Diagnostic and Statistical Manual (DSM-IV): affective problems, anxiety problems, attention deficit/hyperactivity problems, and oppositional defiant problems, in order to translate the findings to the standard psychiatric classification.

The CBCL/1½–5 was completed by 3139 mothers (mean age of children=37±1 months) and 2624 fathers (mean age of children=37±1 months). We assessed problem behavior in children at the age of 3 years when attention can be assessed reliably. The correlation coefficients (r) between mother and father ratings of internalizing and externalizing scales were 0.54 (p<0.001) and 0.56 (p<0.001), respectively. These correlations are in line with the mean correlation (r=0.60) between parents, reported in a review of multi-informant assessment (32). The IntraClass Correlation Coefficient for mother and father reported behavior at 3 years was 0.70 for internalizing and 0.71 for externalizing problems.

Covariates

We selected the possible confounders on the basis of literature (5,17,33,34). Information on maternal age, educational level, and ethnicity were asked via questionnaires at the time of enrollment. Educational level was the highest education completed and was classified as primary (no or only primary education), secondary (lower or intermediate vocational education), and higher education (higher vocational education or university). The child's national origin was defined on the basis of origin of mother, father, and grandparents. We classified national origin as Western or Nonwestern. Maternal smoking was assessed twice, once at the time of enrollment and the second time during the 30th week of gestation, to record whether mothers had never smoked, stopped smoking when pregnant, or continued smoking during pregnancy. We used the Brief Symptom Inventory (BSI) to measure maternal depressive symptoms during pregnancy (35). The BSI is a validated self-report questionnaire with 53 items that define a spectrum of psychiatric disorders in the previous 7 days. High validity and reliability has been reported for the Dutch translation of the instrument (36). The six-item scale of depressive symptoms was derived from the BSI. The ability of BSI to identify clinical depression (using cut-off scores) has been demonstrated within a subsample of Generation R study [see publication by Henrichs et al. (37)]. The child's gender and birth weight were derived from medical records. To define gestational age at birth, we used the last menstrual period of the mother and ultrasound examination of the fetus at the first prenatal visit.

Statistical analysis

We used independent sample t-test, Mann–Whitney U tests, and chi-square statistics to explore whether the nonresponse was selective. In the association analyses, the determinants were maternal TPOAb status or plasma levels of TSH. Maternal TSH was used as continuous variable in the models and divided by its standard deviation to enable comparison.

The associations between maternal TPOAb status and the child cognitive function and problem behavior were explored using logistic regressions. Subsequently, we examined whether any observed effect of TPOAbs on internalizing and externalizing scales was accounted for by more specific symptoms using the DSM-oriented scales. A Generalized Estimating Equation (GEE) approach was used to precisely estimate the overall effect of TPOAbs on problem behavior as repeatedly rated by mothers and by fathers (pooled effect). Moreover, such an overall estimate reduces the errors derived from multiple comparisons.

The CBCL/1½–5 scores were dichotomized, as the scores were not normally distributed and results based on dichotomized scores can then be interpreted as problem behavior. Achenbach and Rescorla suggest using the scores for borderline cut-off (83rd percentile for the broad band syndrome scales and 93rd percentile for the DSM-oriented scales) if the users wished to dichotomize children's scores as being clearly in the normal range versus high enough to warrant concern (25). These cut-offs have been widely used by other researchers to define children with problems (29,38). The population-based study of Dutch norms showed that Dutch children score lower on the behavioral/emotional problems than the American norms (30). Therefore, in the present study, we used the scores for 83rd (for broad band syndrome scale) and 93rd (for DSM-oriented subscales) derived from Dutch norm sample as cut-off points to define children with problems. We also tested an alternative cut-off (80th percentile) that was previously used in another study of the Generation R cohort (39) to examine consistency and whether any effect was observed only due to the choice of the cut-off.

Elevated titers of TPOAbs in pregnant women may be related to the child's behavior, because antibodies affect the thyroid status of the mother, which, in turn, is associated with child neurodevelopment. To test this pathway from TPOAbs to child behavior, we additionally adjusted the models for maternal TSH as a marker of thyroid status.

The models were adjusted for gender (except if gender-specific scores were used) and ethnicity of the child, maternal age, smoking habits, and gestational age at the time of blood sampling for thyroid measurements when appropriate. Confounders were selected if the effect estimates of maternal TPOAbs changed more than 5% in the models (40). Furthermore, we additionally controlled for maternal depressive symptoms to investigate to what extent any association between elevated titers of TPOAbs in mother and child behavior is explained by an effect on maternal psychopathology (7,41).

We applied a Bonferroni adjustment to correct for multiple comparisons in the association between maternal thyroid antibody status and four child outcome measures (verbal and nonverbal cognitive development and internalizing and externalizing problem behavior): α level 0.05/4=0.0125.

To handle the missing values in maternal TSH levels in the mediation analyses, we used multiple imputations. Imputations were based on the relationships between information on the other thyroid parameters and all covariates measured. Five independent datasets were generated, and pooled estimates for those datasets were calculated.

Nonresponse analyses

Nonresponse analysis showed some differences between 3139 participants included in the analyses and the eligible individuals who were excluded because of missing information on behavior (n=1,631). The children who were excluded from the analyses had lower birth weight (mean difference: 117 g, p<0.001). The women whose children were not included because of missing behavioral data were younger (mean age difference=2.9 years, p<0.001), less educated (14.1% vs. 33.3% higher education, p<0.001), and were more likely to continue smoking during pregnancy (24.9% vs. 13.8%, p<0.001).

The mothers of the children who were excluded from the analyses because of missing data on CBCL/1½–5 had higher TSH levels than those included (mean difference=0.13, p=0.002). The TPOAb status of the mothers during early pregnancy was not associated with responsiveness to CBCL/1½–5.

To investigate whether the missing cord blood data introduced bias in the association between maternal TPOAb status and child cord blood thyroid parameters, we ran a nonresponse analysis. Among the study population, there was no significant difference between the group with cord blood data (TSH or fT4) and those with missing information of cord blood with regard to maternal TPOAb status (p=0.27).

Results

In total, 147 (4.7%) women had TPOAb levels higher than 100 IU/mL and were defined as TPOAb-positive. Of the remainder, 40 had TPOAb levels between 60–100 IU/mL. Plasma TSH was higher in TPOAb-positive than TPOAb-negative women (3.81±4.13 vs. 1.53±1.04, mean difference=2.28±0.12, p<0.001). fT4 did not differ between the TPOAb-negative and positive women (15.40±3.72 vs. 15.06±4.80, mean difference=0.34±0.33, p=0.29).

Next, we examined whether maternal TPOAbs were associated with neonatal thyroid status. The fT4 and TSH levels in child cord blood did not differ between TPOAb-positive and TPOAb-negative women (mean difference for fT4=0.55±0.22, p=0.55, and mean difference for TSH=0.26±0.92, p=0.78).

Maternal and child characteristics are shown in Table 1. Pregnant women who were TPOAb negative or TPOAb positive had relatively similar education levels (33.3% vs. 35.4% for higher levels of education). About 14% of the TPOAb-negative women continued smoking during pregnancy. This percentage was 10.2% in TPOAb-positive women.

Table 1.

Participants' Characteristics (n=3,139)

 
Maternal TPOAb statusa
  Negative (n=2992) Positive (n=147) p
Maternal characteristics
 Age at the time of enrollment (years) 31.2 (4.3) 31.1 (4.3) 0.84
 Education (%)
  Primary 13.7 13.9  
  Secondary 53.1 50.7  
  High 33.3 35.4 0.87
 Smoking (%)
  Never 76.9 76.5  
  Until pregnancy was known 9.1 13.2  
  Continued during pregnancy 14.0 10.3 0.16
 Depressive symptoms during pregnancyb 0.00 (0.00, 0.17) 0.00 (0.00, 0.17) 0.71
Maternal thyroid parameters
 TSH (mIU/L) 1.33 (0.82, 2.02) 3.15 (1.76, 4.28) <0.001
 fT4 (nM) 15.00 (13.28, 16.85) 14.82 (12.67, 16.48) 0.29
Child characteristics
 Female gender (%) 50.5 49.0 0.68
 Ethnicity (%)
  Western 80.1 76.0  
  Nonwestern 19.9 24.0 0.28
 Birth weight (g) 3449 (562) 3483 (589) 0.49
 Gestational age at birth, week 40.1 (39.1, 41.0) 40.0 (39.3, 41.1) 0.79
Cord blood thyroid parametersc
 TSH (mIU/L) 9.60 (6.60, 14.73) 10.45 (6.52, 14.58) 0.78
 fT4 (nM) 20.54 (18.57, 22.76) 20.48 (18.94, 22.02) 0.55
Delayed vocabulary development (%) 3.5 4.3 0.63
Delayed phrase development (%) 4.9 8.2 0.16
Nonverbal cognitive delay (%) 14.0 16.2 0.51
The Child Behavior Checklist score
 Internalizing scores, mother-rated at 3 years 4.9 (4.8) 5.1 (4.4) 0.58
 Internalizing scores, father-rated at 3 years 5.3 (5.0) 5.9 (5.1) 0.14
 Externalizing scores, mother-rated at 3 years 8.3 (6.1) 9.2 (6.4) 0.09
 Externalizing scores, father-rated at 3 years 9.2 (6.5) 10.3 (6.8) 0.04

Data values report children included in one or more analyses. Numbers are means (SD) unless otherwise indicated.

a

The plasma levels>100 IU/mL were defined as positive.

b

Measured by Brief Symptom Inventory.

c

Neonatal thyroid parameters were available in 2,121 individuals.

TPOAbs, thyroid peroxidase antibodies; TSH, thyrotropin; fT4, free thyroxine.

We found that elevated titers of TPOAbs during the first half of pregnancy did not predict language development in children at 2.5 years (OR=0.99 for delayed vocabulary development, 95% CI: 0.39–2.50, p=0.98 and OR=1.49 for delayed phrase development, 95% CI: 0.71–3.12, p=0.28). Children of TPOAb-positive mothers did not have a higher risk than children of TPOAb-negative mothers to develop nonverbal cognitive delay (OR=1.09, 95% CI: 0.67–1.77, p=0.74).

Table 2 summarizes the association between maternal TPOAbs and internalizing problem scores in children at 3 years. Elevated titers of TPOAbs in pregnant women were not associated with internalizing problems in the offspring (whether problems were rated by mother or father). In line with this finding, there was no association between maternal TPOAbs and affective or anxiety problems.

Table 2.

Maternal Thyroid Peroxidase Antibodies During Pregnancy and Child's Internalizing Problem, the Generation R Study

 
Maternal rating
Paternal rating
Maternal and paternal rating
Determinant: TPOAb-positivea OR (95% CI) p OR (95% CI) p OR (95% CI) p
Outcome measures:
 Internalizing problems 1.20 (0.78–1.85) 0.40 1.17 (0.73–1.88) 0.50 1.21 (0.84–1.74) 0.31
  DSM-oriented subscales
   Affective Problems 0.96 (0.51–1.80) 0.90 1.31 (0.66–2.59) 0.44 1.02 (0.63–1.65) 0.95
   Anxiety Problems 1.27 (0.74–2.17) 0.39 1.14 (0.61–2.13) 0.69 1.27 (0.81–2.00) 0.29

Total of children in one or more analyses is 3139. The models were adjusted for child's gender and ethnicity, maternal age, cigarette smoking, and time of thyroid sampling during pregnancy.

a

The TPOAbs levels>100 IU/mL were defined as positive.

OR, odds ratio; CI, confidence interval.

The relation between elevated titers of TPOAbs in mothers during early pregnancy and externalizing problem scores in the children are presented in Table 3. Children of TPOAb-positive women had about 60% higher risk of developing externalizing problems than children of TPOAb-negative women (OR=1.60 for problems rated by mothers, 95% CI: 1.08–2.38, p=0.02). A very similar association was found with father-rating problems (OR=1.61, 95% CI: 1.04–2.49, p=0.03). Using a GEE approach to pool mother and father-rating problem behavior, we found that children of TPOAb-positive mothers were at an increased risk for externalizing problems at 3 years (OR=1.64 for mother- and father-rating problems, 95% CI: 1.17–2.29, p=0.004). This association remained significant after correction for multiple comparisons (α level 0.0125). Next, in the subsequent analyses of the DSM-oriented scales, we found that children of TPOAb-positive mothers were at an increased risk to obtain high scores on the attention deficit/hyperactivity problems as rated by fathers (OR=1.89, 95% CI: 1.16–3.07, p=0.01). The findings were similar for attention deficit/hyperactivity problems rated by mothers, but did not reach significance (OR=1.60, 95% CI: 0.90–2.87, p=0.11). To show the effect of elevated titers of TPOAbs on child problem behavior independent of the rater, we performed further analyses, using the GEE approach to pool mother and father rating of behavior. We observed an association between elevated titers of TPOAbs and the risk of attention deficit/hyperactivity problems (OR=1.77, 95% CI: 1.15–2.72, p=0.01). The association between maternal TPOAbs and the risk of attention deficit/hyperactivity in children remained significant after adjustment for multiple comparisons. No association was found between elevated titers of TPOAbs and the oppositional deviant problems scores.

Table 3.

Maternal Thyroid Peroxidase Antibodies During Pregnancy and Child's Externalizing Problem, the Generation R Study

 
Maternal rating
Paternal rating
Maternal and paternal rating
Determinant: TPOAb-positivea OR (95% CI) p OR (95% CI) p OR (95% CI) p
Outcome measures:
 Externalizing problems 1.60 (1.08–2.38) 0.02 1.61 (1.04–2.49) 0.03 1.64 (1.17–2.29) 0.004
  DSM-oriented subscales
   Attention Deficit/Hyperactivity Problems 1.60 (0.90–2.87) 0.11 1.89 (1.16–3.07) 0.01 1.77 (1.15–2.72) 0.01
   Oppositional Deviant Problems 1.46 (0.91–2.34) 0.12 1.36 (0.73–2.52) 0.33 1.39 (0.95–2.03) 0.09

Total of children in one or more analyses is 3139. The models were adjusted for child's gender and ethnicity, maternal age, cigarette smoking, and time of thyroid sampling during pregnancy.

a

The TPOAbs levels>100 IU/mL were defined as positive.

The results were essentially unchanged if we added maternal depressive symptoms to the analyses (data not shown).

Next, we explored whether altered thyroid status of the mother explained the relation between TPOAbs and externalizing behavior in the offspring. First, we found that TPOAb status was associated with TSH levels in pregnant women (mean plasma TSH in TPOAb-positive women=3.83±4.13 vs. mean plasma TSH in TPOAb-negative women=1.53±1.04, p< 0.001). Second, as previously reported (14), maternal TSH was associated with children's externalizing problems rated by mothers and by fathers (B=0.18 per SD of TSH, 95% CI: 0.02–0.34, p=0.03). Third, after adding maternal TSH to the model, the effect of maternal TPOAbs on externalizing problems of the children was attenuated by 8% only and remained significant (OR=1.56, 95% CI: 1.14, 2.14, p=0.005).

In similar analyses, the alternative cut-off for TPOAb levels and CBCL/1½–5 scores was used, but the results remained essentially unchanged.

Discussion

In the present study, we found no association between elevated titers of TPOAbs in the mother during early pregnancy and cognitive functioning in the offspring. However, elevated titers of TPOAbs during early pregnancy increased the risk of externalizing problems in preschool children. Further analysis indicated that this effect was largely accounted for by problems tapped by the CBCL/1½–5 attention deficit/hyperactivity problem scale. Interestingly, the association between TPOAb status of the mother and externalizing problems in the children was largely independent of maternal thyroid status.

Elevated titers of TPOAbs in mothers during early pregnancy increased the risk of problem behavior in children, in particular, attention deficit/hyperactivity problems. There are several possible explanations for the observed association. First, high titers of TPOAbs are commonly seen with elevated serum TSH (4,17). We also showed that TPOAb-positive women had higher TSH than TPOAb-negative women. Thyroid autoimmunity is not always associated with low fT4 and clinical consequences. However, in pregnancy, autoimmune damage to the thyroid gland affects its capacity to compensate for high demand. Therefore, maternal autoimmunity can lead to insufficient supply of maternal thyroid hormones to the child, and, subsequently, cause neuropsychological problems. In the present study, the effect of elevated titers of TPOAbs on the child's behavior was not exclusively mediated by plasma levels of TSH as a marker of maternal thyroid status. In other words, it is unlikely that the change in maternal thyroid function during pregnancy is the only explanatory factor behind the observed association of TPOAbs and child behavior. Thus, other explanations should be discussed. Second, maternal autoimmunity (specifically maternal TSH receptor-blocking antibody) is a common cause of transient hypothyroidism in their infants, because maternal antibodies pass the placenta (42). The effect of maternal antibodies on the thyroid function of the child may persist until the antibodies disappear from the child's circulation a few months after birth. Elevated titers of maternal TPOAbs and TSH receptor-blocking antibodies may co-exist and lead to transient subclinical hypothyroidism in infants. In the present study, we did not find any differences in the thyroid parameters of child cord blood between TPOAb-positive and TPOAb-negative women. Therefore, our data do not support a role of the child's thyroid parameters in the association between maternal TPOAb status and the child's behavior. However, measurement of child's thyroid parameters in the cord blood may not be the optimal way to assess the thyroid function of neonates. Third, an autoimmune process could explain the relation of maternal TPOAbs with problem behavior in the children. Thyroid autoimmunity may be a marker of a preexisting subclinical autoimmune condition of the mothers; such an immune process could cause the developmental problems of the offspring, as maternal antibodies pass through the placenta. There is growing evidence for the role of the autoimmune process in neuropsychiatric symptoms in children (18,19). Lastly, external factors such as genetic risk factors and maternal depressive symptoms could explain the relation between maternal TPOAbs and child behavior. However, in the present study, we adjusted for the last risk factor. Further investigations are needed to elucidate the possible mechanisms by which maternal thyroid autoimmunity affects the child's problem behavior.

Elevated titers of maternal TPOAbs were not associated with verbal or nonverbal cognitive function in this large cohort of children. Possibly, brain regions crucial to behavior and emotion control such as amygdala and thalamus are more susceptible to thyroid autoimmunity or other immune processes as compared with those crucial to cognitive abilities. This mechanism, however, is speculative and should be tested by animal or imaging studies. Moreover, our negative findings are not consistent with previous studies of thyroid antibodies and child intelligence (16,17). While our negative results are based on parent report of cognition, the other studies used observational measurements of cognition that are not feasible in large population-based studies.

This study had several strengths. It is a population-based study with a large sample size. Antibody levels were measured as the major etiology of thyroid dysfunction in iodine-sufficient areas. The information on numerous potential confounders was available. The child's problem behavior was rated by both mother and father to obtain the effect of maternal thyroid autoimmunity on the child's behavior independent of the rater. The correlation coefficient (r) between mother and father rating of behavior in our sample was in line with the data reported in the review on cross-informants' correlations of child behavior (32). We asked both mother and father to rate their child's problem behavior as recommended by the experts. Since we studied preschool children, teacher reports on child's behavior were not available. Multi-informant rating scales of the child's behavior are highly recommended and widely used in routine clinical practice to assist clinicians in decision making (43).

Several possible limitations of this study should also be discussed. First, we measured maternal thyroid parameters only once. Therefore, any interpretation about the interaction between the thyroid parameters and steroid hormones throughout the pregnancy and after delivery was not possible. Second, the children's cognition and behavior were parent-report information. However, a high validity of parent-report measures on child's ability has been previously described (25,28). It is very unlikely that the use of parent-report measures introduced systematic bias, as parents were blind to the results of thyroid measurement. In addition, we cannot rule out the effect of non-response to our questionnaires and loss to follow-up on the possible relationship between thyroid autoimmunity and the child's behavior.

The findings of this large population-based study have clinical and public health implications. They may point to a specific mechanism of ADHD in children. Currently, we can only speculate about a public health implication, as there is no specific treatment for TPOAb-positive pregnant women with normal thyroid function. Possible suggestions are to screen for thyroid antibodies during pregnancy and to adopt a low threshold for thyroid parameters in women who were antibody positive if interventions are considered. Further investigation is needed to explore whether TPOAb-positive pregnant women and their children can benefit from close monitoring and early detection of developmental delay in the populations at risk.

Supplementary Material

Supplemental data
Supp_Data.pdf (47.8KB, pdf)

Acknowledgments

The first phase of Generation R was supported by Erasmus Medical Center Rotterdam, the Erasmus University Rotterdam, and the Netherlands Organization for Health Research and Development (ZonMw 10.000.1003). Measurements of thyroid parameters have been made possible by a generous financial gift of Ortho Clinical Diagnostics (Rochester, NY), Jan Dekker/Ludgardine Bouwman Foundation, Fa. Merck, and Foundation Zeist. The work of Dr. Henning Tiemeier and Dr. Frank C. Verhulst was supported by a research grant from the European Community's 7th Framework Programme (FP7/2008–2013) under grant agreement 212652 (NUTRIMENTHE project, “The Effect of Diet on the Mental Performance of Children”). The work of Akhgar Ghassabian was supported by a grant from the Netherlands Organization for Health Research and Development (ZonMW “Geestkracht” program 10.000.1003). The work of Dr. Roman is supported by a grant from The Nancy Lurie Marks (NLM) Family Foundation, Wellesley, Massachusetts, USA.

The Generation R study is conducted by Erasmus Medical Center Rotterdam in close collaboration with the faculty of Social Sciences of Erasmus University Rotterdam, the Municipal Health Service Rotterdam area, the Rotterdam Homecare Foundation, and the Stichting Trombosedienst & Artsenlaboratorium Rijnmond (STAR), Rotterdam. The authors gratefully acknowledge the contribution of general practitioners, hospitals, midwifes, and pharmacies in Rotterdam. The contribution of Mr. H. van Toor and Mrs. B.C.M. Dufour-van den Goorbergh, laboratory technicians, is highly appreciated.

Disclosure Statement

F.C.V. is the contributing editor of The Achenbach System of Empirically Based Assessment, from which he receives remuneration. For the other authors, no competing financial interest exists.

References

  • 1.Weetman AP. Immunity, thyroid function and pregnancy: molecular mechanisms. Nat Rev. 2010;6:311–318. doi: 10.1038/nrendo.2010.46. [DOI] [PubMed] [Google Scholar]
  • 2.Mandel SJ. Hypothyroidism and chronic autoimmune thyroiditis in the pregnant state: maternal aspects. Best Pract Res Clin Endocrinol Metab. 2004;18:213–224. doi: 10.1016/j.beem.2004.03.006. [DOI] [PubMed] [Google Scholar]
  • 3.Mariotti S. Caturegli P. Piccolo P. Barbesino G. Pinchera A. Antithyroid peroxidase autoantibodies in thyroid diseases. J Clin Endocrinol Metab. 1990;71:661–669. doi: 10.1210/jcem-71-3-661. [DOI] [PubMed] [Google Scholar]
  • 4.Prummel MF. Wiersinga WM. Thyroid autoimmunity and miscarriage. Eur J Endocrinol. 2004;150:751–755. doi: 10.1530/eje.0.1500751. [DOI] [PubMed] [Google Scholar]
  • 5.Haddow JE. Cleary-Goldman J. McClain MR. Palomaki GE. Neveux LM. Lambert-Messerlian G. Canick JA. Malone FD. Porter TF. Nyberg DA. Bernstein PS. D'Alton ME. Thyroperoxidase and thyroglobulin antibodies in early pregnancy and preterm delivery. Obstet Gynecol. 2010;116:58–62. doi: 10.1097/AOG.0b013e3181e10b30. [DOI] [PubMed] [Google Scholar]
  • 6.Mannisto T. Vaarasmaki M. Pouta A. Hartikainen AL. Ruokonen A. Surcel HM. Bloigu A. Jarvelin MR. Suvanto-Luukkonen E. Perinatal outcome of children born to mothers with thyroid dysfunction or antibodies: a prospective population-based cohort study. J Clin Endocrinol Metab. 2009;94:772–779. doi: 10.1210/jc.2008-1520. [DOI] [PubMed] [Google Scholar]
  • 7.Pop VJ. Wijnen HA. Lapkienne L. Bunivicius R. Vader HL. Essed GG. The relation between gestational thyroid parameters and depression: a reflection of the downregulation of the immune system during pregnancy? Thyroid. 2006;16:485–492. doi: 10.1089/thy.2006.16.485. [DOI] [PubMed] [Google Scholar]
  • 8.Kuijpens JL. Vader HL. Drexhage HA. Wiersinga WM. van Son MJ. Pop VJ. Thyroid peroxidase antibodies during gestation are a marker for subsequent depression postpartum. Eur J Endocrinol. 2001;145:579–584. doi: 10.1530/eje.0.1450579. [DOI] [PubMed] [Google Scholar]
  • 9.Haddow JE. Palomaki GE. Allan WC. Williams JR. Knight GJ. Gagnon J. O'Heir CE. Mitchell ML. Hermos RJ. Waisbren SE. Faix JD. Klein RZ. Maternal thyroid deficiency during pregnancy and subsequent neuropsychological development of the child. N Engl J Med. 1999;341:549–555. doi: 10.1056/NEJM199908193410801. [DOI] [PubMed] [Google Scholar]
  • 10.Pop VJ. Brouwers EP. Vader HL. Vulsma T. van Baar AL. de Vijlder JJ. Maternal hypothyroxinaemia during early pregnancy and subsequent child development: a 3-year follow-up study. Clin Endocrinol (Oxf) 2003;59:282–288. doi: 10.1046/j.1365-2265.2003.01822.x. [DOI] [PubMed] [Google Scholar]
  • 11.Kooistra L. Crawford S. van Baar AL. Brouwers EP. Pop VJ. Neonatal effects of maternal hypothyroxinemia during early pregnancy. Pediatrics. 2006;117:161–167. doi: 10.1542/peds.2005-0227. [DOI] [PubMed] [Google Scholar]
  • 12.Hauser P. Zametkin AJ. Martinez P. Vitiello B. Matochik JA. Mixson AJ. Weintraub BD. Attention deficit-hyperactivity disorder in people with generalized resistance to thyroid hormone. N Engl J Med. 1993;328:997–1001. doi: 10.1056/NEJM199304083281403. [DOI] [PubMed] [Google Scholar]
  • 13.Vermiglio F. Lo Presti VP. Moleti M. Sidoti M. Tortorella G. Scaffidi G. Castagna MG. Mattina F. Violi MA. Crisa A. Artemisia A. Trimarchi F. Attention deficit and hyperactivity disorders in the offspring of mothers exposed to mild-moderate iodine deficiency: a possible novel iodine deficiency disorder in developed countries. J Clin Endocrinol Metab. 2004;89:6054–6060. doi: 10.1210/jc.2004-0571. [DOI] [PubMed] [Google Scholar]
  • 14.Ghassabian A. Bongers-Schokking JJ. Henrichs J. Jaddoe VW. Visser TJ. Visser W. de Muinck Keizer-Schrama SM. Hooijkaas H. Steegers EA. Hofman A. Verhulst FC. van den Ende J. de Rijke YB. Tiemeier H. Maternal thyroid function during pregnancy and parent-report problem behavior of the offspring up to age three years. The Generation R Study. Pediatr Res. 2011;69:454–459. doi: 10.1203/PDR.0b013e3182125b0c. [DOI] [PubMed] [Google Scholar]
  • 15.Henrichs J. Bongers-Schokking JJ. Schenk JJ. Ghassabian A. Schmidt HG. Visser TJ. Hooijkaas H. de Muinck Keizer-Schrama SM. Hofman A. Jaddoe VV. Visser W. Steegers EA. Verhulst FC. de Rijke YB. Tiemeier H. Maternal thyroid function during early pregnancy and cognitive functioning in early childhood: the generation R study. J Clin Endocrinol Metab. 2010;95:4227–4234. doi: 10.1210/jc.2010-0415. [DOI] [PubMed] [Google Scholar]
  • 16.Li Y. Shan Z. Teng W. Yu X. Li Y. Fan C. Teng X. Guo R. Wang H. Li J. Chen Y. Wang W. Chawinga M. Zhang L. Yang L. Zhao Y. Hua T. Abnormalities of maternal thyroid function during pregnancy affect neuropsychological development of their children at 25–30 months. Clin Endocrinol (Oxf) 2010;72:825–829. doi: 10.1111/j.1365-2265.2009.03743.x. [DOI] [PubMed] [Google Scholar]
  • 17.Pop VJ. de Vries E. van Baar AL. Waelkens JJ. de Rooy HA. Horsten M. Donkers MM. Komproe IH. van Son MM. Vader HL. Maternal thyroid peroxidase antibodies during pregnancy: a marker of impaired child development? J Clin Endocrinol Metab. 1995;80:3561–3566. doi: 10.1210/jcem.80.12.8530599. [DOI] [PubMed] [Google Scholar]
  • 18.Murphy TK. Kurlan R. Leckman J. The immunobiology of Tourette's disorder, pediatric autoimmune neuropsychiatric disorders associated with Streptococcus, and related disorders: a way forward. J Child Adolesc Psychopharmacol. 2010;20:317–331. doi: 10.1089/cap.2010.0043. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Martino D. Defazio G. Giovannoni G. The PANDAS subgroup of tic disorders and childhood-onset obsessive-compulsive disorder. J Psychosom Res. 2009;67:547–557. doi: 10.1016/j.jpsychores.2009.07.004. [DOI] [PubMed] [Google Scholar]
  • 20.Jaddoe VW. van Duijn CM. van der Heijden AJ. Mackenbach JP. Moll HA. Steegers EA. Tiemeier H. Uitterlinden AG. Verhulst FC. Hofman A. The Generation R Study: design and cohort update until the age of 4 years. Eur J Epidemiol. 2008;23:801–811. doi: 10.1007/s10654-008-9309-4. [DOI] [PubMed] [Google Scholar]
  • 21.Jaddoe VW. van Duijn CM. van der Heijden AJ. Mackenbach JP. Moll HA. Steegers EA. Tiemeier H. Uitterlinden AG. Verhulst FC. Hofman A. The Generation R Study: design and cohort update 2010. Eur J Epidemiol. 2010;25:823–841. doi: 10.1007/s10654-010-9516-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Jaddoe VW. Bakker R. van Duijn CM. van der Heijden AJ. Lindemans J. Mackenbach JP. Moll HA. Steegers EA. Tiemeier H. Uitterlinden AG. Verhulst FC. Hofman A. The Generation R Study Biobank: a resource for epidemiological studies in children and their parents. Eur J Epidemiol. 2007;22:917–923. doi: 10.1007/s10654-007-9209-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Jaddoe VW. Mackenbach JP. Moll HA. Steegers EA. Tiemeier H. Verhulst FC. Witteman JC. Hofman A. The Generation R Study: design and cohort profile. Eur J Epidemiol. 2006;21:475–484. doi: 10.1007/s10654-006-9022-0. [DOI] [PubMed] [Google Scholar]
  • 24.Abalovich M. Amino N. Barbour LA. Cobin RH. De Groot LJ. Glinoer D. Mandel SJ. Stagnaro-Green A. Management of thyroid dysfunction during pregnancy and postpartum: an endocrine society clinical practice guideline. J Clin Endocrinol Metab. 2007;92:S1–S47. doi: 10.1210/jc.2007-0141. [DOI] [PubMed] [Google Scholar]
  • 25.Achenbach TM. Rescorla LA. Manual for ASEBA Preschool Forms & Profiles. University of Vermont, Research Center for Children, Youth, & Families; Burlington, VT: 2000. [Google Scholar]
  • 26.Rescorla L. The Language Development Survey: a screening tool for delayed language in toddlers. J Speech Hear Disord. 1989;54:587–599. doi: 10.1044/jshd.5404.587. [DOI] [PubMed] [Google Scholar]
  • 27.Rescorla L. Age 17 Language and reading outcomes in late-talking toddlers: support for a dimensional perspective on language delay. J Speech Lang Hear Res. 2009;52:16–30. doi: 10.1044/1092-4388(2008/07-0171). [DOI] [PubMed] [Google Scholar]
  • 28.Saudino KJ. Dale PS. Oliver B. Petrill SA. Richardson V. Rutter M. Simonoff E. Stevenson J. Plomin R. The validity of parent-based assessment of the cognitive abilities of 2-year-olds. Br J Dev Psychol. 1998;16:349–363. [Google Scholar]
  • 29.Gross D. Fogg L. Young M. Ridge A. Cowell JM. Richardson R. Sivan A. The equivalence of the Child Behavior Checklist/1 1/2–5 across parent race/ethnicity, income level, and language. Psychol Assess. 2006;18:313–323. doi: 10.1037/1040-3590.18.3.313. [DOI] [PubMed] [Google Scholar]
  • 30.Tick NT. van der Ende J. Koot HM. Verhulst FC. 14-year changes in emotional and behavioral problems of very young Dutch children. J Am Acad Child Adolesc Psychiatry. 2007;46:1333–1340. doi: 10.1097/chi.0b013e3181337532. [DOI] [PubMed] [Google Scholar]
  • 31.Ivanova MY. Achenbach TM. Rescorla LA. Harder VS. Ang RP. Bilenberg N. Bjarnadottir G. Capron C. De Pauw SS. Dias P. Dobrean A. Doepfner M. Duyme M. Eapen V. Erol N. Esmaeili EM. Ezpeleta L. Frigerio A. Goncalves MM. Gudmundsson HS. Jeng SF. Jetishi P. Jusiene R. Kim YA. Kristensen S. Lecannelier F. Leung PW. Liu J. Montirosso R. Oh KJ. Plueck J. Pomalima R. Shahini M. Silva JR. Simsek Z. Sourander A. Valverde J. van Leeuwen KG. Woo BS. Wu YT. Zubrick SR. Verhulst FC. Preschool psychopathology reported by parents in 23 societies: testing the seven-syndrome model of the child behavior checklist for ages 1.5–5. J Am Acad Child Adolesc Psychiatry. 2010;49:1215–1224. doi: 10.1016/j.jaac.2010.08.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Achenbach TM. McConaughy SH. Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;101:213–232. [PubMed] [Google Scholar]
  • 33.Abbassi-Ghanavati M. Casey BM. Spong CY. McIntire DD. Halvorson LM. Cunningham FG. Pregnancy outcomes in women with thyroid peroxidase antibodies. Obstet Gynecol. 2010;116:381–386. doi: 10.1097/AOG.0b013e3181e904e5. [DOI] [PubMed] [Google Scholar]
  • 34.Shields B. Hill A. Bilous M. Knight B. Hattersley AT. Bilous RW. Vaidya B. Cigarette smoking during pregnancy is associated with alterations in maternal and fetal thyroid function. J Clin Endocrinol Metab. 2009;94:570–574. doi: 10.1210/jc.2008-0380. [DOI] [PubMed] [Google Scholar]
  • 35.Derogatis LR. Manual. 3rd. National Computer System, Inc.; Minneapolis, MN: 1993. The Brief Symptom Inventory (BSI): Administration, Scoring, Procedures. [Google Scholar]
  • 36.de Beurs E. Brief Symptom Inventory, Handleiding. PITS; Leiden, the Netherlands: 2004. [Google Scholar]
  • 37.Henrichs J. Schenk JJ. Roza SJ. van den Berg MP. Schmidt HG. Steegers EA. Hofman A. Jaddoe VW. Verhulst FC. Tiemeier H. Maternal psychological distress and fetal growth trajectories: the Generation R Study. Psychol Med. 2010;40:633–643. doi: 10.1017/S0033291709990894. [DOI] [PubMed] [Google Scholar]
  • 38.Roza SJ. van Batenburg-Eddes T. Steegers EA. Jaddoe VW. Mackenbach JP. Hofman A. Verhulst FC. Tiemeier H. Maternal folic acid supplement use in early pregnancy and child behavioural problems: the Generation R Study. Br J Nutr. 2010;103:445–452. doi: 10.1017/S0007114509991954. [DOI] [PubMed] [Google Scholar]
  • 39.Cents RA. Tiemeier H. Luijk MP. Jaddoe VW. Hofman A. Verhulst FC. Lambregtse-van den Berg MP. Grandparental anxiety and depression predict young children's internalizing and externalizing problems: the Generation R study. J Affect Disord. 2010;128:95–105. doi: 10.1016/j.jad.2010.06.020. [DOI] [PubMed] [Google Scholar]
  • 40.Rothman KJ. Greenland S. Lash TL. Modern Epidemiology. 3rd. Lippincott-Raven publishers; Philadelphia: 2008. [Google Scholar]
  • 41.Velders FP. Dieleman G. Henrichs J. Jaddoe VW. Hofman A. Verhulst FC. Hudziak JJ. Tiemeier H. Prenatal and postnatal psychological symptoms of parents and family functioning: the impact on child emotional and behavioural problems. Eur Child Adolesc Psychiatry. 2011;20:341–350. doi: 10.1007/s00787-011-0178-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Dussault JH. Fisher DA. Thyroid function in mothers of hypothyroid newborns. Obstet Gynecol. 1999;93:15–20. doi: 10.1016/s0029-7844(98)00369-x. [DOI] [PubMed] [Google Scholar]
  • 43.Rutter M. Bishop D. Pine D. Scott S. Stevenson JS. Taylor EA. Thapar A. Rutter's Child and Adolescent Psychiatry. 5th. Blackwell Publishing; Malden, MA: 2010. pp. 521–542. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental data
Supp_Data.pdf (47.8KB, pdf)

Articles from Thyroid are provided here courtesy of Mary Ann Liebert, Inc.

RESOURCES