Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Oct 1.
Published in final edited form as: Brain Imaging Behav. 2017 Oct;11(5):1302–1315. doi: 10.1007/s11682-016-9634-2

Structural brain anomalies in healthy adolescents in the NCANDA cohort: Relation to neuropsychological test performance, sex, and ethnicity

Edith V Sullivan 1,*, Barton Lane 2, Dongjin Kwon 1,3, M J Meloy 4, Susan F Tapert 4,5, Sandra A Brown 4, Ian M Colrain 3, Fiona C Baker 3, Michael D De Bellis 6, Duncan B Clark 7, Bonnie J Nagel 8, Kilian M Pohl 1,3, Adolf Pfefferbaum 1,3
PMCID: PMC5656437  NIHMSID: NIHMS913945  PMID: 27722828

Abstract

Structural MRI of volunteers deemed “normal” following clinical interview provides a window into normal brain developmental morphology but also reveals unexpected dysmorphology, commonly known as “incidental findings.” Although unanticipated, these anatomical findings raise questions regarding possible treatment that could even ultimately require neurosurgical intervention, which itself carries significant risk but may not be indicated if the anomaly is nonprogressive or of no functional consequence. Neuroradiological readings of 833 structural MRI from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) cohort found an 11.8% incidence of brain structural anomalies, represented proportionately across the five collection sites and ethnic groups. Anomalies included 26 mega cisterna magna, 15 subarachnoid cysts, 12 pineal cysts, 12 white matter dysmorphologies, 5 tonsillar ectopias, 5 prominent perivascular spaces, 5 gray matter heterotopias, 4 pituitary masses, 4 excessively large or asymmetrical ventricles, 4 cavum septum pellucidum, 3 developmental venous anomalies, 1 exceptionally large midsagittal vein, and single cases requiring clinical followup: cranio-cervical junction stenosis, parietal cortical mass, and Chiari I malformation. A case of possible demyelinating disorder (e.g., neuromyelitis optica or multiple sclerosis) newly emerged at the 1-year NCANDA followup, requiring clinical referral. Comparing test performance of the 98 anomalous cases with 619 anomaly-free no-to-low alcohol consuming adolescents revealed significantly lower scores on speed measures of attention and motor functions; these differences were not attributed to any one anomaly subgroup. Further, we devised an automated approach for quantifying posterior fossa CSF volumes for detection of mega cisterna magna, which represented 26.5% of clinically identified anomalies. Automated quantification fit a Gaussian distribution with a rightward skew. Using a 3SD cut-off, quantification identified 22 of the 26 clinically-identified cases, indicating that cases with percent of CSF in the posterior-inferior-middle aspect of the posterior fossa ≥3SD merit further review, and support complementing clinical readings with objective quantitative analysis. Discovery of asymptomatic brain structural anomalies, even when no clinical action is indicated, can be disconcerting to the individual and responsible family members, raising a disclosure dilemma: refrain from relating the incidental findings to avoid unnecessary alarm or anxiety; or alternatively, relate the neuroradiological findings as “normal variants” to the study volunteers and family, thereby equipping them with knowledge for the future should they have the occasion for a brain scan following an illness or accident that the incidental findings predated the later event.

Keywords: brain anomaly, dysmorphology, development, adolescence, incidental findings

Introduction

Morphometric heterogeneity of brain structure is evident from large-scale neuroimaging studies of healthy individuals and is salient during the adolescent years of development. The range of normal variation includes structural anomalies that are traditionally considered as clinically, neurologically, and neuropsychologically asymptomatic. The incidence of these anomalies ranges widely, from 4% to 80%, when including samples drawn retrospectively from clinical cases with MRI whose diagnoses were ultimately deemed non-serious (Gupta and Belay 2008; Bredlau et al. 2012; Famini et al. 2011; S. Gupta et al. 2010; Potchen et al. 2013; Roth et al. 2012) and, not surprisingly, was substantially higher in the elderly (Morris et al. 2009). When restricted to prospective MRI studies of research participants selected by rigorous exclusionary medical, neuropsychological, psychiatric, and other behavioral factors, the incidence of anomalies detected on clinical readings has a more restricted range, 4% and 19% (Gur et al. 2013; Morris et al. 2009; Reneman et al. 2012; Cramer et al. 2011; Hartwigsen et al. 2010; Kaiser et al. 2015; Li et al. 2015; Nagy and Jonsson 2009; Weber and Knopf 2006), with greater sensitivity of detection with higher image resolution and MR field strength (Morris et al. 2009).

Of anomalies detected, few cases are referred for further clinical investigation and typically indicate treatable disorders, such as a focal mass or tumor, multiple sclerosis, and Chiari I malformation. Rarefied samples derived from systematic screening procedures do not exclude brain structural anomalies. Unreported to date, however, are data on neuropsychological test performance of individuals with MRI anomalies, such as posterior fossa findings, subarachnoid and pineal cysts, ventriculomegaly, and gray matter heterotopias. Despite the growing number of prospective studies of brain development and the multifactorial data collected in large samples (Raznahan et al. 2011; Sowell et al. 2004; Sullivan et al. 2011; Storsve et al. 2014; Shaw et al. 2008; Wierenga et al. 2014; Raznahan et al. 2010; Bava et al. 2010) (for review, Stiles and Jernigan 2010; Giedd et al. 2014; Toga et al. 2006), it remains unknown to what extent brain structural anomalies considered normal variants have functional ramifications. Providing data to fill this lacuna was one goal of this study.

Structural anomalies reported often involve the posterior fossa. Chiari I malformations and Dandy-Walker cysts have functional correlates that are likely screened behaviorally (Barkovich et al. 1989). By contrast, mega cisterna magna, which are prevalent in studies of normal participants (Gur et al. 2013), are considered functionally silent (Adam and Greenberg 1978). This assertion, however, has not been examined objectively with cognitive and motor testing. Further, although attempts have been made to quantify mega cisterna magna using landmarks and area measurements (Adam and Greenberg 1978; Barkovich et al. 1989), quantitative volumetric approaches have not been reported. A second goal of this study was to devise an objective, quantitation of posterior fossa CSF volume and to test its relation to neuropsychological performance.

Use of high-resolution, 3T images has revealed anomalies in brain structure not visible with lower power imaging and has identified anomalies in nearly 3 times as many healthy subjects compared with lower field-strength data (Morris et al. 2009). Thus, use of high field, high-resolution protocols in ongoing and future MRI studies of healthy brain development will undoubtedly uncover more instances of normal morphology and abnormal anatomy, i.e., dysmorphology (Kaiser et al. 2015). Given the burden that knowledge of brain structural anomalies imposes on parents and participants, having quantitative data about the functional correlates of these anomalies should contribute to objectivity and direction in relating diagnostic information and to ethical considerations regarding whether and how to report findings (Wolf et al. 2008; Illes 2008; Kumra et al. 2006; Di Pietro and Illes 2013).

The findings presented herein are based on data from our previous publication (Pfefferbaum et al. 2015), which reported regional volume differences in cortical gray matter and white matter across the adolescent age range using high-resolution 3T MRI, and initially noted an 11.4% incidence of clinically-identified, neuroradiological anomalies in the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) cohort of 833 youth, all of whom were deemed healthy and eligible for study entry before radiological readings (Brown et al. 2015). The current report provides an extensive analysis of the clinical findings by comparing cognitive and motor performance of adolescents with brain structural anomalies against performance by their counterparts without anomalies using test data from our earlier publication (Sullivan et al. 2016); examining the distribution of demographic descriptors (age, sex, ethnicity, and body mass index [BMI]) associated with each anomaly; and quantifying the infratentorial volume in all participants with the goal of using a quantitative approach to identify and measure mega cisterna magna, which occurred in one quarter of the sample with brain structural anomalies. These analyses addressed two critical questions: 1) Are incidental finding of little to no consequence cognitively or motorically, or alternatively, do these clinical readings have functional correlates with quantitative neuropsychological testing? 2) Can detection of dysmorphology be enhanced by objective, quantitative measurement? The second question targeted mega cisterna magna.

Methods

Participants

Neuroradiological review of research-quality structural brain MRI collected on 3T scanners was conducted on the entire group of 833 adolescents who were recruited for the longitudinal NCANDA study: 808 with MRI of adequate quality and structural integrity for automated cortical quantification (Pfefferbaum et al. 2015) (674 adolescents who met alcohol and drug use criteria for no/low consumption and 134 adolescents who exceeded those criteria; for details, see Brown et al. 2015); 23 adolescents with structural anomalies precluding automated cortical quantification; and 2 adolescents who were excluded from the NCANDA cohort because of brain structural abnormalities requiring clinical followup. One additional adolescent with a normal reading at baseline developed a lesion detected at the 1-year followup examination requiring clinical assessment; his baseline, but not followup, neuropsychological data were included for norm construction. Anomalies were detected in 77 of the no/low alcohol and drug exposure group and 21 of the exceeds-criteria group; only data from the no/low group were used as the normal standard against which to test scores of the anomalies group (Fig 1).

Fig 1.

Fig 1

Flow chart of counts of NCANDA MRIs with and without brain structural anomalies identified on neuroradiological readings.

Participants were divided into two groups based on presence or absence of clinically detected, MRI structural anomalies: 98 cases at baseline plus 1 identified at followup and 619 cases in the no/low drinking group without MRI anomalies. These two groups were characterized by age, sex, pubertal stage using the self-assessment Pubertal Development Scale (PDS) (Petersen et al. 1988), body mass index (BMI) adjusted for age and sex, socioeconomic status (SES) determined as the highest education achieved by either parent (Akshoomoff et al. 2014), and ethnicity by primary heritage (Caucasian, African-American, Asian). Relative to the no anomalies group, the anomalies group was older by about half a year and had proportionately more boys than girls, but no other reviewed characteristics distinguished in the two groups (Table 1).

Table 1.

Demographics by group

Characteristic Anomalies Group No anomalies No/low Group χ2 or t-value p-value
Sex (M, F) 59, 39 296, 323 4.708 0.03
Age (mean±SD) 16.5 (2.42) 15.7 (2.33) 3.298 0.001
PDS (mean±SD) 3.2 (0.67) 3.1 (0.71) 1.410 n.s.
BMI (mean±SD) 22.0 (3.93) 22.1 (4.48) 0.155 n.s.
SES (mean±SD) 17.0 (2.51) 16.8 (2.44) 0.909 n.s.
Ethnicity 4.411 n.s.
 Caucasian 79 451
 African American 7 90
 Asian 11 67
 Other 1 11
Data Collection Site 6.133 n.s.
 University of Pittsburgh 10 86
 SRI International 28 116
 Duke University 19 134
 Oregon Health & Science University 15 124
 University of California, San Diego 26 159

PDS=Pubertal Development Scale; range: 1=prepubescent, 5=adult

SES=socioeconomic scale=highest educational level of any parent

All youth participated in an informed consent process with a research associate trained in human subject research protocols. Adult participants or the parents of minor participants provided written informed consent before entering in the study. Minor youth provided assent before participation. The Institutional Review Boards of each site approved this study, and each site followed this procedure to obtain voluntary informed consent or assent, depending on the age of the participant.

MRI Acquisition for Clinical Readings

T1-weighted, 3D MRI data sets were collected in the sagittal plane on systems from two manufacturers: 3T General Electric (GE) Discovery MR750 at three sites (216 from UCSD; 166 from SRI; 176 from Duke) and 3T Siemens TIM TRIO scanners at two sites (125 from University of Pittsburgh; 150 from Oregon Health & Sciences University). The GE sites used an Array Spatial Sensitivity Encoding Technique (ASSET) for parallel and accelerated imaging with an 8-channel head coil and acquired a Inversion Recovery-SPoiled Gradient Recalled (IR-SPGR) echo sequence (TR=5.904ms, TI=400ms, TE=1.932ms, flip angle=11°, NEX=1, matrix=256×256, FOV=24cm, slice dimensions=1.2 × 0.9375 × 0.9375mm, 146 slices). The Siemens sites used a 12-channel head coil and parallel imaging and temporal acceleration with iPAT and acquired an MPRAGE sequence (TR=1900ms, TI=900ms, TE=2.92 ms, flip angle=9°, NEX=1, matrix=256×256, FOV=24cm, slice dimensions=1.2 × 0.9375 × 0.9375mm, 160 slices).

Clinical Readings

Readings of all studies from all five collection sites were conducted on T1-weighted MRI by one board-certified neuroradiologist (B.L.) with ~40 years of experience in clinical and research investigations. Images were displayed with Osirix v.5.6 on an iMac with a 27-inch screen. Although the age range was known, MRIs were read prospectively by the neuroradiologist, who was blind to specific age, sex, ethnicity, and collection site. Neuroradiological readings were performed for the purpose of detecting clinically significant anomalies or abnormalities, and such were reported to the site-specific principal investigators for followup with the participant and family, depending on the age of the participant.

Mega cisterna magna were defined on sagittal T1-weighted images as bounded by the torcular superiorly, the bony posterior fossa posteriorly, the medulla and cerebellum anteriorly, and a line drawn at the superior margin of C-1 inferiorly. This inferior margin was chosen rather than the foramen magnum itself due to many cases with mega cisterna magna clearly extending below foramen magnum.

Automated Quantification of Mega Cisterna Magna CSF Volumes

In addition to visually-based clinical readings, 828 of the initial 833 scans were adequate for detection of cisterna magna by volumetric quantification of the posterior cistern, which is located in the cerebellomedullary cistern and positioned posterior to the medulla oblongata, and inferior and posterior to the cerebellum and exclusive of the 4th ventricle. Accordingly, a cisterna magna region of interest (ROI) was defined as that portion of the posterior fossa below an axial plane at the level of the posterior medullary velum of the 4th ventricle and extending laterally 20mm on either side of the midline. To avoid inclusion of the 4th ventricle, CSF and tissue anterior to a coronal plane drawn at the medullary velum extending 12mm inferiorly was excluded. For each subject, this ROI was registered to his or her T1-weighted image and the contents segmented into CSF and tissue. The final metric for the volume of the posterior cistern was the percent of CSF in the defined ROI. The volume of the entire posterior fossa was also defined by registration to a laboratory standard (Pfefferbaum et al. 2015), and the radiologist-measured area was expressed as a percent of the posterior fossa volume.

Neuropsychological Tests

Adolescents were administered a test battery comprising performance measures from the University of Pennsylvania Web-based Computerized Neurocognitive Battery (WebCNP) (webcnp.med.upenn.edu/) (Gur et al. 2012; Gur et al. 2010) and traditional neuropsychological tests. Composite performance accuracy scores were expressed as standardized Z-scores, based on performance by the 619 adolescents in the no/low drinking group without anomalies, for 7 functional domains (Abstraction, Attention, Emotion, Episodic Memory, Working Memory, Balance, General Ability), and then applied to the scores of adolescents in the MRI anomalies group. Scores were also adjusted for age, sex, ethnicity, and site. Full descriptions of the tests appear elsewhere (Sullivan et al. 2016).

Statistical Analysis

Group differences in demographic variables were tested with χ2 or t-tests. Comparison of mega cisterna magna measurements was done with Pearson correlations. Other analysis tools were the General Additive Model (GAM) (Wood 2006, 2011; Hastie and Tibshirani 1990, 1986) and analysis of variance (ANOVA) from the “mgcv” package in R Version 3.1.0 [http://www.r-project.org/], testing for the value of the effect of group (no MRI anomaly vs. MRI anomalies) with nonlinear age (thin plane spline with 3 knots) and 3 covariates—site, ethnicity, and sex—to predict neuropsychological test scores.

GAM:performancei~β0+S1(agei)+β2sitei+β3ethnicityi+β4sexi+β5groupi+εi

The GAM was used for two major comparisons: the group of 619 no/low drinking adolescents without anomalies versus the total group of 98 anomalies and versus the group of 26 mega cisterna magna cases.

Results

Incidental Findings on Clinical Neuroradiological Readings

Clinical neuroradiological readings of all 833 MRI studies at baseline identified noteworthy anomalies in 98 individuals (Table 2). On average, the group with the anomalies was older by about 1 year and had a significantly higher ratio of male-to-female participants than the no anomalies group, but the groups did not differ in PDS, BMI, SES. In addition, both groups had similar ethnicity and site distributions (Table 1). Notable was the large number of participants with mega cisterna magna and subarachnoid cysts (Table 2). Adolescents who had exceeded criteria for alcohol consumption had a higher than expected representation in three categories of anomalies: white matter and callosal cysts, cavum septum pellucidum, and ventricular enlargement (Table 2). A.P. and E.V.S. then reviewed the MRIs of all individuals to judge whether the structural anomalies would interfere with automated quantification of cortical, subcortical, or white matter tissue morphometry (reported elsewhere, Pfefferbaum et al. 2015) and identified 23 cases for exclusion: 13 cysts, 3 white matter anomalies, 2 developmental venous anomalies, 4 heterotopias, and 1 large lateral ventricles with cyst (Fig 2).

Table 2.

Frequency and type of anomalies identified on readings by a clinical neuroradiologist

Clinical Reading Count Age (SD) Age range Male, Female No-low, Exceeds
mega cisterna magna 26 16.7 (3.06) 12.8–21.9 22, 4 24,2
subarachnoid cysts (primarily temporal and frontal) 15 16.2 (1.34) 13.8–18.1 8, 7 12,3
pineal cysts 12 17.1 (1.60) 14.2–19.7 4, 8 9,3
white matter anomalies and callosal cysts 12 15.8 (2.68) 12.9–19.3 6, 6 7,5
tonsilar ectopias 5 16.5 (2.40) 12.5–17.5 2, 3 4,1
very prominent perivascular spaces 5 15.0 (1.95) 13.3–17.9 5, 0 5,0
gray matter heterotopias 5 15.0 (2.56) 13.1–19.4 1, 4 5,0
pituitary masses (primarily cysts) 4 19.6 (0.61) 19.0–20.4 1, 3 3,1
abnormally large or asymmetrical lateral ventricles 4 16.4 (1.48) 15.3–18.3 2, 2 2,2
cavum septum pellucidum 4 17.4 (3.67) 13.4–19.3 2, 2 1,3
developmental venous anomalies (DVA) 3 16.5 (0.90) 15.5–17.3 3, 0 2,1
severe cranio-cervical junction stenosis (10 mm) 1 13.8 1, 0 1,0
large midline vein 1 16.8 0,1 1,0
* right parietal cortical mass (3 cm) 1 16.7 1, 0 1,0
* bilateral tonsillar herniation with medullary distortion (Chiari 1 malformation) 1 16.9 1, 0 1,0
possible demyelinating disorder at 1 year followup 1 13.3 1, 0 1,0

N=98/833 individuals, yielding 11.8% incidence

*

After referral for clinical followup by collection site investigators, excluded from study

one girl in each of these two categories also had primary white matter anomalies and thus are included in both counts.

Fig 2.

Fig 2

Examples of space-occupying lesions.

Three adolescents were referred for clinical neurological or neurosurgical consultation for evidence of the following: severe cranio-cervical junction stenosis (10 mm), right parietal cortical mass (3 cm), and bilateral tonsillar herniation with medullary distortion (Chiari 1 malformation); the latter two were excluded from the NCANDA sample (Fig 3). At the 1-year followup study, a potentially demyelinating lesion consistent with neuromyelitis optica or multiple sclerosis emerged in an additional adolescent, whose MRI showed no evidence of abnormality at baseline (Fig 4).

Fig 3.

Fig 3

Abnormalities referred for clinical followup.

Fig 4.

Fig 4

A case of possible demyelinating disease, consistent with neuromyelitis optica or multiple sclerosis, which was not visible at the baseline MRI.

Clinical Readings and Quantification of Mega Cisterna Magna CSF Volumes

Initial clinical readings identified mega cisterna magna (Fig 5) in 21 male and 3 female youth across the age range studied, 12 to 21 years. Of these, most were Caucasian, none was African American, and 2 youth were in the exceeds-drinking criteria group.

Fig 5.

Fig 5

Top 3 images: An example of mega cisterna magna. Second row of 3 images: The same case with the cisterna magna region of interest outlined in red and CSF displayed in green. Third row of two histograms: Left=Percent CSF in the cisterna magna region of interest by frequency count in male and female youth. Right: Gaussian fit indicating that 3SD marked 21.3% and 4SD marked 24.4% of the CSF in the cisterna magna ROI. Fourth row: Left: Correlation between the manually drawn areas and automatically determined volumes of the CSF in the region of interest. Right: An example of manual delineation of the region (green outlining).

A frequency histogram, constructed for the automated volumes expressed as percent CSF of the posterior fossa ROI, of the total group of 828 cases was fit with a single Gaussian distribution with a mean of 13.7% (SD=2.69%) and a significant skew toward the higher values; full fit was best achieved with two Gaussian distributions (Fig 5). Although volumes were not related to ethnicity, CSF volume percentages were larger in boys than girls (t=5.978, p=0.0001) and larger in older adolescents (t=3.402, p=0.0007). A 4SD cut-off subtended a range from 24.4% to 47.3% of the cisterna magna ROI CSF and included 32 of the 828 adolescents, where 17 of these 32 were clinically identified mega cisterna magna. The remaining 9 of the total group of 26 clinically identified cases excluded from the 4SD cut-off ranged from 16.2% to 23.9% CSF on quantification and included 2 of the 4 female youth with mega cisterna magna readings. A 3SD cut-off identified 52 with large posterior fossa CSF volumes, subtending a range from 21.7% to 47.3%, and included 22 of the 26 clinically identified cases (see below). The remaining 4 cases identified by clinical but not automated assessment ranged from 16.2% to 21.3% CSF (Fig 5).

In addition to the initial clinical review, B.L. visually re-reviewed the T1-weighted images of 41 cases that included the 24 originally deemed mega cisterna magna plus 15 with an average CSF percentile ranking of 95%. This led to inclusion of 2 more, clinically-defined cases. B.L. also manually drew the outline of the mega cisterna magna region on the midsagittal slice on these cases to determine its area for comparison with the volumetric measurement (Fig 4). Correlation of the volumetric and manual area measures, corrected for the infratentorial volume, yielded modest relations for the total group of 41 cases (r=0.54, p=0.0002) and the clinically determined group of 26 mega cisterna magna (r=0.47, p=0.015).

Neuropsychological Test Performance in Groups and Single Cases

The total anomalies group achieved lower Attention and Motor speed scores than the no anomalies group, but the accuracy measures did not distinguish the groups (Supplemental Tables 1–2). These differences were not clearly attributed to any one anomaly subgroup, including the group of 26 mega cisterna magna, whose speeded performance did not differ significantly from the no anomalies group. Consideration of the four ataxia scores comprising the Balance composite score indicated normal performance by the mega cisterna magna group, with mean Z-scores ranging from −0.18 to 0.27.

To seek potential differences in performance by the no/low group and exceeds criteria for alcohol group with radiological anomalies, differences between pairs of groups were tested and revealed the following significant effects. Consistent with the differences observed in the total group of anomalies, the no/low only group with anomalies achieved lower scores than the no/low group without anomalies on the same two speed scores, although the difference was significant for Motor (t=−3.412, p=.00068) but not Attention (t=−1.822, p=.069) scores (Fig 6). By contrast, the adolescents with anomalies and higher alcohol consumption did not differ from the no/low anomaly-free group on any speed measure, possibly because of low statistical power.

Fig 6.

Fig 6

Scatterplots and regression line (solid black) ±1 and 2 standard error of the regression lines of Attention speed and Motor speed test Z-scores, adjusted for sex, site, and ethnicity, showing poorer performance by the anomalies group [cases in the no/low group with anomalies (green squares) plus cases in the exceeds alcohol criteria group with anomalies (red squares)] than the no/low anomaly-free group (gray open circles).

Consideration of performance by individuals revealed the following. Of the youth with mega cisterna magna, four participants, all from the no/low drinking group, had a Balance composite score of at least −1.0 SD below average. An additional 9 cases, also in the no/low group, achieved balance scores below −1.0 SD on at least one of the ataxia measures comprising the Balance composite score.

Other scores of note (at least −1.0 SD from average) were detected in individuals in the four diagnostic categories with single cases (Supplemental Tables 1–2); none exceeded the alcohol or drug use criteria. The youth with the large midline vein performed below −1.0 SD on the Episodic Memory accuracy score and the Working Memory speed score. The youth with the cranio-cervical junction stenosis performed below −1.0 SD on measures assessing Emotion accuracy and Attention, Motor, and Working Memory speeded responses (Supplemental Tables 1–2).

Discussion

Prospective MRI study aimed at tracking developmental trajectories of brain structure in ostensibly healthy participants has revealed novel findings both in terms of normal morphological ontogeny and unexpected, incidental findings reported to occur in about 4 to 19% of well-screened adolescents. Clinical MRI readings of the NCANDA cohort of 833 adolescents, age 12 to 21 years, identified an 11.8% incidence of anomalies (98 individuals), represented proportionately across the 5 sites and major ethnicities. Of all anomalies identified, only 4 radiological diagnoses were deemed to require neurological or neurosurgical followup: cranio-cervical junction stenosis, parietal cortical mass, Chiari I malformation, and possible demyelinating disease consistent with neuromyelitis optica or multiple sclerosis. A few sex differences were noted: more boys than girls had mega cisterna magna and prominent perivascular spaces, whereas more girls than boys had pineal cysts, pituitary masses, or gray matter heterotopias. Mega cisterna magna occurred mainly in Caucasian boys of the NCANDA cohort; none was detected in African Americans. This ethnicity difference was also noted in the University of Pennsylvania cohort with respect to its category of “cerebellar findings,” which included mega cisterna magna. The mainstay of incidental findings were not referred for clinical examination, a decision supported by other studies and ethical considerations that acknowledge the problem of introducing excessive concern to the affected individual and family for a “normal variant” of no clinical relevance (cf., Wolf et al. 2008). By contrast, that a serious abnormality of possible demyelinating disease emerged at the 1-year followup confirms the importance of continued neuroradiological monitoring of MRI in out years of longitudinal projects.

By definition, incidental findings are clinically silent. In challenge to this assumption, however, we examined performance on a neuropsychological test battery taken at the time of MRI acquisition. In general, the anomalous groups performed within the average range of performance by their counterparts free of structural brain anomalies, with few exceptions. Instances of low performance by the total group, although not selective to any single diagnosis, involved speed rather than accuracy in responding on tests of attention and psychomotor speed. This pattern is similar to performance by individuals with mild closed head injury, which often result in modestly damped attention and psychomotor speed (e.g., Levin et al. 2013) and raises the possibility that these brain structural-functional correlations have a causal component. A further consideration is the genesis of the anomalies, many of which are likely to be congenital. If so, affected youth have had a lifetime to accommodate to the lesion both functionally and structurally.

The 11.8% incidence of incidental findings in the NCANDA cohort compares well with other developmental MRI studies of a highly screened youth that report 4% to 19% incidences (Kaiser et al. 2015; Morris et al. 2009; Gur et al. 2013; Illes et al. 2004; Kim et al. 2002; Reneman et al. 2012). A close comparison is the University of Pennsylvania cohort of 1400 youth, age 8–21 years, randomly selected from a larger cohort of 9000 youth with a variety of pediatric disorders. As with the current study, those participants were scanned on a 3T system, and structural images were reviewed by radiologists who identified 10.6% anomalies (Gur et al. 2013). Nonetheless, fundamental differences distinguished these study design. Specifically, the University of Pennsylvania study was conducted at a single site, data collection was accomplished on a single 3T system, and recruitment was based in a hospital setting. By contrast, the NCANDA study was conducted at five, geographically distant sites, data were acquired on five different 3T systems made by two different manufacturers, and recruitment was community- and school-based (Brown et al. 2015). In contrast with our study, which had a referral rate of 4.1% of the 98 anomalous cases, the University of Pennsylvania study referred 12 of 148 (8.1%) cases for clinical followup and included younger participants (Gur et al. 2013).

Mega cisterna magna was the most frequently identified anomaly, comprising 26.5% of all anomalous cases, and was not associated with cognitive, motor, or postural stability deficits in the group. Their benign nature was described by Adam and Greenberg (Adam and Greenberg 1978), who noted that Gonsette and Andre-Balisaux (Gonsette and Andre-Balisaux 1968) coined the term “mega grande citerne” and made the point that cases described before their study presented with symptoms of posterior fossa disease requiring neurosurgery. By contrast, the 5 men and 6 women of 3000 cases in their series identified retrospectively with CT did not have such symptoms, albeit two had nystagmus and one had ataxia attributed to diphenylhydantoin or phenobarbital intoxication; two cases underwent surgery but with no change in symptoms, indicating lack of urgency or need for surgery. Later, Barkovich et al. (Barkovich et al. 1989) devised rules for quantitative measurement on MR images of posterior fossa CSF enlargement, including Dandy-Walker cysts, which are commonly accompanied by severe posterior fossa symptoms, and mega cisterna magna, which are typically asymptomatic. More recently, Yildiz and colleagues (Yildiz et al. 2006) used posterior fossa flow imaging to distinguish mega cisterna magna from posterior fossa cysts, which can obstruct flow, cause hydrocephalus, and compress adjacent tissue. Examples of a posterior fossa cyst and a mega cisterna magna from the NCANDA sample are presented in Figures 1 and 4.

In light of the high incidence of mega cisterna magna, we devised a volumetric approach for their identification and found that ≥3SD threshold identified 22 of the 26 instances of clinically-defined mega cisterna magna, indicating that cases with the percent of CSF in the posterior inferior middle aspect of the posterior fossa ≥3 SD merit clinical review. This approach may be particularly valuable for detection of mega cisterna magna in study participants who are well screened for medical and psychiatric conditions, because the size of these anomalies is comparatively small. For example, in the NCANDA cohort the CSF/tissue ratio was 48.52% of the maximum measured, whereas typically reported cases appear to be >50% CSF in posterior fossa (e.g., Barkovich et al. 1989).

Analysis of baseline MRI data from the NCANDA multisite, longitudinal study revealed significant moderators of age-related, brain tissue differences in gray matter and white matter volume, cortical thickness, and cortical surface area marking adolescent neurodevelopment (Pfefferbaum et al. 2015). Whether youth with incidental findings follow the developmental trajectories measured in the non-anomalous counterparts remains open to longitudinal study and a challenge for automated quantification of primary brain morphometrics.

In conclusion, even in a group of healthy, well-screened participants with normal brain structure at study entry, developmental anomalies will be found, and in some cases pathology will emerge in a sample of this size. The assertion that selective functionally silent, incidental anomalies detected through visual inspection by an experienced neuroradiologist are of no clinical relevance was largely supported by objective, quantitative cognitive and motor testing. The few exceptions involved speeded cognitive or motor responses, and these differences were not attributed to any one anomaly type. Use of a quantification scheme to detect mega cistern magna, the anomaly occurring with the highest incidence, identified nearly 85% of the clinically identified cases, and support complementing clinical readings with quantitative objective analysis. Of critical value is the continued radiological reading obtained through longitudinal study to enable followup of questionable anomalies and detection of emergent, clinically serious abnormalities. Discovery of asymptomatic brain structural anomalies, even when no clinical action is indicated, can be disconcerting to the individual and responsible family members, raising a disclosure dilemma (cf., Wolf et al. 2008; Illes 2008; Kumra et al. 2006; Di Pietro and Illes 2013): refrain from relating the incidental findings to avoid unnecessary alarm or anxiety; or alternatively, relate the neuroradiological findings as “normal variants” to the study volunteers and family, thereby equipping them with knowledge for the future should they have the occasion for a brain scan following an illness or accident that the incidental findings predated the later event. Finally, it is critical to recognize that 1) research-grade MRI protocols are not FDA-approved, clinical-grade protocols and, therefore, cannot be used for definitive diagnosis and 2) a negative reading does not necessarily confirm absence of pathology.

Supplementary Material

Sullivan2016 Supplemental

Table 3.

Demographics by group formega cisterna magna and no anomalies of no/low drinking group

Characteristic Mega Cisterna Magna Group No Anomalies No/low Group χ2 or t-value p-value
Sex (M, F) 22, 4 296, 323 11.882 0.0006
Age (mean±SD) 16.7 (3.06) 15.7 (2.33) 2.226 0.0263
PDS (mean±SD) 3.2 (0.75) 3.1 (0.71) 0.160 n.s.
BMI (mean±SD) 21.5 (3.37) 22.1 (4.48) 0.692 n.s.
SES (mean±SD) 17.4 (1.83) 16.8 (2.44) 1.223 n.s.
Ethnicity 7.665 0.0535
 Caucasian 19 451
 African American 0 90
 Asian 6 67
 Other 1 11
Data Collection Site 0.935 n.s.
 University of Pittsburgh 3 86
 SRI International 6 116
 Duke University 4 134
 Oregon Health & Science University 6 124
 University of California, San Diego 7 159

from Table 1

PDS=Pubertal Development Scale; range: 1=prepubescent, 5=adult

BMI=Body Mass Index

SES=socioeconomic scale=highest educational level of any parent

Acknowledgments

Funding. This work was supported by the U.S. National Institute on Alcohol Abuse and Alcoholism with co-funding from the National Institute on Drug Abuse, the National Institute of Mental Health, and the National Institute of Child Health and Human Development [NCANDA grant numbers: AA021697 (AP+KMP), AA021695 (SAB+SFT), AA021692 (SAB+SFT), AA021696 (IMC+FCB), AA021681 (MDDB), AA021690 (DBC), AA021691 (BN)]. Additional funding supported E.V.S. (AA017168).

Footnotes

Conflict of interest: The authors declare that they have no conflict of interest with the work reported herein.

Informed consent: Informed consent was obtained from all individual participants, parents, or legal guardians who were majority, and assent from minors included in the study.

Ethical approval: All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

References

  1. Adam R, Greenberg JO. The mega cisterna magna. J Neurosurg. 1978;48(2):190–192. doi: 10.3171/jns.1978.48.2.0190. [DOI] [PubMed] [Google Scholar]
  2. Akshoomoff N, Newman E, Thompson WK, McCabe C, Bloss CS, Chang L, et al. The NIH Toolbox Cognition Battery: results from a large normative developmental sample (PING) Neuropsychology. 2014;28(1):1–10. doi: 10.1037/neu0000001. doi:2013-38865-001 [pii]10.1037/neu0000001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Barkovich AJ, Kjos BO, Norman D, Edwards MS. Revised classification of posterior fossa cysts and cystlike malformations based on the results of multiplanar MR imaging. AJR Am J Roentgenol. 1989;153(6):1289–1300. doi: 10.2214/ajr.153.6.1289. [DOI] [PubMed] [Google Scholar]
  4. Bava S, Thayer R, Jacobus J, Ward M, Jernigan TL, Tapert SF. Longitudinal characterization of white matter maturation during adolescence. Brain Res. 2010;1327:38–46. doi: 10.1016/j.brainres.2010.02.066. doi:S0006-8993(10)00472-5 [pii]10.1016/j.brainres.2010.02.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Bredlau AL, Constine LS, Silberstein HJ, Milano MT, Korones DN. Incidental brain lesions in children: to treat or not to treat? J Neurooncol. 2012;106(3):589–594. doi: 10.1007/s11060-011-0695-1. [DOI] [PubMed] [Google Scholar]
  6. Brown SA, Brumback T, Tomlinson K, Cummins K, Thompson WK, Nagel BJ, et al. The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A multi-site study of adolescent development and substance use. Journal of Studies on Alcohol and Drugs. 2015;76(6):895–908. doi: 10.15288/jsad.2015.76.895. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Cramer SC, Wu J, Hanson JA, Nouri S, Karnani D, Chuang TM, et al. A system for addressing incidental findings in neuroimaging research. Neuroimage. 2011;55(3):1020–1023. doi: 10.1016/j.neuroimage.2010.11.091. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Di Pietro NC, Illes J. Disclosing incidental findings in brain research: the rights of minors in decision-making. J Magn Reson Imaging. 2013;38(5):1009–1013. doi: 10.1002/jmri.24230. [DOI] [PubMed] [Google Scholar]
  9. Famini P, Maya MM, Melmed S. Pituitary magnetic resonance imaging for sellar and parasellar masses: ten-year experience in 2598 patients. J Clin Endocrinol Metab. 2011;96(6):1633–1641. doi: 10.1210/jc.2011-0168. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Giedd JN, Raznahan A, Alexander-Bloch A, Schmitt E, Gogtay N, Rapoport JL. Child psychiatry branch of the National Institute of Mental Health longitudinal structural magnetic resonance imaging study of human brain development. Neuropsychopharmacology. 2014;40(1):43–49. doi: 10.1038/npp.2014.236. doi:npp2014236 [pii]10.1038/npp.2014.236. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Gonsette R, Andre-Balisaux G. A new technic of lumbosacral radiculography using a resorbable hydrosoluble medium without spinal anesthesia. Ann Radiol (Paris) 1968;11(3):141–145. [PubMed] [Google Scholar]
  12. Gupta S, Kanamalla U, Gupta V. Are incidental findings on brain magnetic resonance images in children merely incidental? J Child Neurol. 2010;25(12):1511–1516. doi: 10.1177/0883073810370622. [DOI] [PubMed] [Google Scholar]
  13. Gupta SN, Belay B. Intracranial incidental findings on brain MR images in a pediatric neurology practice: a retrospective study. J Neurol Sci. 2008;264(1–2):34–37. doi: 10.1016/j.jns.2007.06.055. doi:S0022-510X(07)00483-2 [pii]10.1016/j.jns.2007.06.055. [DOI] [PubMed] [Google Scholar]
  14. Gur RC, Richard J, Calkins ME, Chiavacci R, Hansen JA, Bilker WB, et al. Age group and sex differences in performance on a computerized neurocognitive battery in children age 8–21. Neuropsychology. 2012;26(2):251–265. doi: 10.1037/a0026712. doi:2012-00965-001 [pii]10.1037/a0026712. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Gur RC, Richard J, Hughett P, Calkins ME, Macy L, Bilker WB, et al. A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: standardization and initial construct validation. J Neurosci Methods. 2010;187(2):254–262. doi: 10.1016/j.jneumeth.2009.11.017. doi:S0165-0270(09)00615-3 [pii]10.1016/j.jneumeth.2009.11.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Gur RE, Kaltman D, Melhem ER, Ruparel K, Prabhakaran K, Riley M, et al. Incidental findings in youths volunteering for brain MRI research. AJNR Am J Neuroradiol. 2013;34(10):2021–2025. doi: 10.3174/ajnr.A3525. doi:ajnr.A3525 [pii]10.3174/ajnr.A3525. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Hartwigsen G, Siebner HR, Deuschl G, Jansen O, Ulmer S. Incidental findings are frequent in young healthy individuals undergoing magnetic resonance imaging in brain research imaging studies: a prospective single-center study. J Comput Assist Tomogr. 2010;34(4):596–600. doi: 10.1097/RCT.0b013e3181d9c2bb. [DOI] [PubMed] [Google Scholar]
  18. Hastie T, Tibshirani R. Generalized additive models (with DIscussion) Statistical Science. 1986;1:297–318. [Google Scholar]
  19. Hastie T, Tibshirani R. Exploring the nature of covariate effects in the proportional hazards model. Biometrics. 1990;46(4):1005–1016. [PubMed] [Google Scholar]
  20. Illes J. Brain screening and incidental findings: flocking to folly? Lancet Neurol. 2008;7(1):23–24. doi: 10.1016/S1474-4422(07)70308-3. [DOI] [PubMed] [Google Scholar]
  21. Illes J, Kirschen MP, Karetsky K, Kelly M, Saha A, Desmond JE, et al. Discovery and disclosure of incidental findings in neuroimaging research. J Magn Reson Imaging. 2004;20(5):743–747. doi: 10.1002/jmri.20180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Kaiser D, Leach J, Vannest J, Schapiro M, Holland S, Cincinnati, M. R. I. o. N. A. C Unanticipated findings in pediatric neuroimaging research: prevalence of abnormalities and process for reporting and clinical follow-up. Brain Imaging Behav. 2015;9(1):32–42. doi: 10.1007/s11682-014-9327-7. [DOI] [PubMed] [Google Scholar]
  23. Kim BS, Illes J, Kaplan RT, Reiss A, Atlas SW. Incidental findings on pediatric MR images of the brain. AJNR Am J Neuroradiol. 2002;23(10):1674–1677. [PMC free article] [PubMed] [Google Scholar]
  24. Kumra S, Ashtari M, Anderson B, Cervellione KL, Kan L. Ethical and practical considerations in the management of incidental findings in pediatric MRI studies. J Am Acad Child Adolesc Psychiatry. 2006;45(8):1000–1006. doi: 10.1097/01.chi.0000222786.49477.a8. [DOI] [PubMed] [Google Scholar]
  25. Levin HS, Li X, McCauley SR, Hanten G, Wilde EA, Swank P. Neuropsychological outcome of mTBI: a principal component analysis approach. J Neurotrauma. 2013;30(8):625–632. doi: 10.1089/neu.2012.2627. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Li WC, Tu CH, Chao HT, Yeh TC, Chen LF, Hsieh JC. High prevalence of incidental brain findings in primary dysmenorrhoea. Eur J Pain. 2015;19(8):1071–1074. doi: 10.1002/ejp.639. [DOI] [PubMed] [Google Scholar]
  27. Morris Z, Whiteley WN, Longstreth WT, Jr, Weber F, Lee YC, Tsushima Y, et al. Incidental findings on brain magnetic resonance imaging: systematic review and meta-analysis. BMJ. 2009;339:b3016. doi: 10.1136/bmj.b3016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Nagy Z, Jonsson B. Cerebral MRI findings in a cohort of ex-preterm and control adolescents. Acta Paediatr. 2009;98(6):996–1001. doi: 10.1111/j.1651-2227.2009.01278.x. [DOI] [PubMed] [Google Scholar]
  29. Petersen AC, Crockett L, Richards M, Boxer A. A self-report measure of pubertal status: Reliability, validity, and initial norms. J Youth Adolesc. 1988;17(2):117–133. doi: 10.1007/BF01537962. [DOI] [PubMed] [Google Scholar]
  30. Pfefferbaum A, Rohlfing T, Pohl KM, Lane B, Chu W, Kwon D, et al. Adolescent Development of Cortical and White Matter Structure in the NCANDA Sample: Role of Sex, Ethnicity, Puberty, and Alcohol Drinking. Cereb Cortex. 2015 doi: 10.1093/cercor/bhv205. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Potchen MJ, Kampondeni SD, Mallewa M, Taylor TE, Birbeck GL. Brain imaging in normal kids: a community-based MRI study in Malawian children. Trop Med Int Health. 2013;18(4):398–402. doi: 10.1111/tmi.12064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Raznahan A, Lee Y, Stidd R, Long R, Greenstein D, Clasen L, et al. Longitudinally mapping the influence of sex and androgen signaling on the dynamics of human cortical maturation in adolescence. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(39):16988–16993. doi: 10.1073/pnas.1006025107. doi:1006025107 [pii]10.1073/pnas.1006025107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Raznahan A, Lerch JP, Lee N, Greenstein D, Wallace GL, Stockman M, et al. Patterns of coordinated anatomical change in human cortical development: a longitudinal neuroimaging study of maturational coupling. Neuron. 2011;72(5):873–884. doi: 10.1016/j.neuron.2011.09.028. doi:S0896-6273(11)00882-8 [pii]10.1016/j.neuron.2011.09.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Reneman L, de Win MM, Booij J, van den Brink W, den Heeten GJ, Freling N, et al. Incidental head and neck findings on MRI in young healthy volunteers: prevalence and clinical implications. AJNR Am J Neuroradiol. 2012;33(10):1971–1974. doi: 10.3174/ajnr.A3217. doi:ajnr.A3217 [pii]10.3174/ajnr.A3217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Roth J, Keating RF, Myseros JS, Yaun AL, Magge SN, Constantini S. Pediatric incidental brain tumors: a growing treatment dilemma. J Neurosurg Pediatr. 2012;10(3):168–174. doi: 10.3171/2012.6.PEDS11451. [DOI] [PubMed] [Google Scholar]
  36. Shaw P, Kabani NJ, Lerch JP, Eckstrand K, Lenroot R, Gogtay N, et al. Neurodevelopmental trajectories of the human cerebral cortex. J Neurosci. 2008;28(14):3586–3594. doi: 10.1523/JNEUROSCI.5309-07.2008. doi:28/14/3586 [pii]10.1523/JNEUROSCI.5309-07.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Sowell ER, Thompson PM, Leonard CM, Welcome SE, Kan E, Toga AW. Longitudinal mapping of cortical thickness and brain growth in normal children. J Neurosci. 2004;24(38):8223–8231. doi: 10.1523/JNEUROSCI.1798-04.2004. doi:10.1523/JNEUROSCI.1798-04.200424/38/8223 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Stiles J, Jernigan TL. The basics of brain development. Neuropsychol Rev. 2010;20(4):327–348. doi: 10.1007/s11065-010-9148-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Storsve AB, Fjell AM, Tamnes CK, Westlye LT, Overbye K, Aasland HW, et al. Differential longitudinal changes in cortical thickness, surface area and volume across the adult life span: regions of accelerating and decelerating change. J Neurosci. 2014;34(25):8488–8498. doi: 10.1523/JNEUROSCI.0391-14.2014. doi:34/25/8488 [pii]10.1523/JNEUROSCI.0391-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Sullivan EV, Brumback T, Tapert SF, Fama R, Prouty D, Brown SA, et al. Cognitive, emotion control, and motor performance of adolescents in the NCANDA study: Contributions from alcohol consumption, age, sex, ethnicity, and family history of addiction. Neuropsychology. 2016;30(4):449–473. doi: 10.1037/neu0000259. http://dx.doi.org/10.1037/neu0000306. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Sullivan EV, Pfefferbaum A, Rohlfing T, Baker FC, Padilla ML, Colrain IM. Developmental change in regional brain structure over 7 months in early adolescence: Comparison of approaches for longitudinal atlas-based parcellation. NeuroImage. 2011;57:214–224. doi: 10.1016/j.neuroimage.2011.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Toga AW, Thompson PM, Sowell ER. Mapping brain maturation. Trends Neurosci. 2006;29(3):148–159. doi: 10.1016/j.tins.2006.01.007. doi:S0166-2236(06)00024-5 [pii]10.1016/j.tins.2006.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Weber F, Knopf H. Incidental findings in magnetic resonance imaging of the brains of healthy young men. J Neurol Sci. 2006;240(1–2):81–84. doi: 10.1016/j.jns.2005.09.008. [DOI] [PubMed] [Google Scholar]
  44. Wierenga LM, Langen M, Oranje B, Durston S. Unique developmental trajectories of cortical thickness and surface area. Neuroimage. 2014;87:120–126. doi: 10.1016/j.neuroimage.2013.11.010. doi:S1053-8119(13)01102-6 [pii]10.1016/j.neuroimage.2013.11.010. [DOI] [PubMed] [Google Scholar]
  45. Wolf SM, Lawrenz FP, Nelson CA, Kahn JP, Cho MK, Clayton EW, et al. Managing incidental findings in human subjects research: analysis and recommendations. J Law Med Ethics. 2008;36(2):219–248. 211. doi: 10.1111/j.1748-720X.2008.00266.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Wood SN. Low-rank scale-invariant tensor product smooths for generalized additive mixed models. Biometrics. 2006;62(4):1025–1036. doi: 10.1111/j.1541-0420.2006.00574.x. doi:BIOM574 [pii]10.1111/j.1541-0420.2006.00574.x. [DOI] [PubMed] [Google Scholar]
  47. Wood SN. Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear modelsFast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. Journal of the Royal Statistical Society (B) 2011;73(1):3–36. [Google Scholar]
  48. Yildiz H, Yazici Z, Hakyemez B, Erdogan C, Parlak M. Evaluation of CSF flow patterns of posterior fossa cystic malformations using CSF flow MR imaging. Neuroradiology. 2006;48(9):595–605. doi: 10.1007/s00234-006-0098-8. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Sullivan2016 Supplemental

RESOURCES