Abstract
The incomplete-hippocampal-inversion (IHI), also known as malrotation, is an atypical anatomical pattern of the hippocampus, which has been reported in healthy subjects in different studies. However, extensive characterization of IHI in a large sample has not yet been performed. Furthermore, it is unclear whether IHI are restricted to the medial-temporal lobe or are associated with more extensive anatomical changes. Here, we studied the characteristics of IHI in a community-based sample of 2008 subjects of the IMAGEN database and their association with extra-hippocampal anatomical variations. The presence of IHI was assessed on T1-weighted anatomical magnetic resonance imaging (MRI) using visual criteria. We assessed the association of IHI with other anatomical changes throughout the brain using automatic morphometry of cortical sulci. We found that IHI were much more frequent in the left hippocampus (left: 17%, right: 6%, χ2−test, p < 10−28). Compared to subjects without IHI, subjects with IHI displayed morphological changes in several sulci located mainly in the limbic lobe. Our results demonstrate that IHI are a common left-sided phenomenon in normal subjects and that they are associated with morphological changes outside the medial temporal lobe.
Keywords: human hippocampus, malrotation, anatomical variability, brain development, cortical sulci, IMAGEN database, MRI, Large database
Introduction
The incomplete hippocampal inversion (IHI) is an atypical anatomical pattern of the hippocampus which prominent features are a round, verticalized, and medially positioned hippocampus and a deep collateral sulcus (Baulac et al., 1998; Bernasconi et al., 2005). Different terms have been used to refer to this atypical pattern including “incomplete hippocampal inversion” (Bajic et al., 2008; Raininko and Bajic, 2010), “hippocampal malrotation” (Barsi et al., 2000; Peltier et al., 2005; Gamss et al., 2009), “abnormal hippocampal formation” (Bernasconi et al., 2005), “developmental changes of the hippocampal formation” (Baulac et al., 1998). IHI were mostly described in patients with epilepsy, in particular in patients with malformations of cortical development (MCD) but also in temporal lobe epilepsy (TLE; Lehéricy et al., 1995; Baulac et al., 1998; Bernasconi et al., 2005; Bajic et al., 2009), with a prevalence of 30–50%. IHI are not specific of epilepsy and have also been reported in healthy subjects, although with an apparently lower frequency (Bronen and Cheung, 1991; Bernasconi et al., 2005; Bajic et al., 2008). This has led to speculate that IHI may be the end of the phenotypic spectrum of normal hippocampal shape (Bernasconi et al., 2005). IHI are thought to be of developmental origin, as shown by studies in neonates (Righini et al., 2006; Raininko and Bajic, 2010). It is thus tempting to speculate that IHI may be a marker of atypical brain development.
The anatomical pattern of incomplete inversion may be factor of susceptibility to pathological processes. The high prevalence of IHI in patients with epilepsy and MCD has led to think that they may be a marker of abnormal development. Furthermore, IHI have been noted in association with different developmental defects, including agenesis of the corpus callosum (Atlas et al., 1986), and patients with genetic anomalies (Fitoz et al., 2003; Grosso et al., 2003; Andrade et al., 2013; Boronat et al., 2015) that present with increased risk of neuropsychiatric disorders including autism spectrum disorders (Campbell et al., 2006) and schizophrenia (Baker et al., 2011). However, in order to study IHI as a marker of abnormal development in neuropsychiatric diseases, it is important to first fully characterize them in the normal population.
IHI can also challenge the performance of automatic hippocampal segmentation methods, lower segmentation accuracy being found in the presence of IHI (Kim et al., 2012a). While multi-template approaches appear more robust to the presence of IHI than other types of approaches (Kim et al., 2012b), it remains important to adequately characterize IHI to ensure that volumetry or morphometry studies are not biased by their occurrence.
Until now, IHI in normal subjects remain insufficiently characterized. First, the prevalence of IHI in normal subjects is a matter of debate (Gamss et al., 2009; Raininko and Bajic, 2010). Some authors consider IHI a common finding in healthy subjects (Bajic et al., 2008; Raininko and Bajic, 2010) while other report that they are a rare pattern (Gamss et al., 2009). A possible reason for these discrepancies is that previous studies of IHI in subjects without epilepsy have included a small number of healthy subjects (Bernasconi et al., 2005; Bajic et al., 2008) or have included patients without epileptic seizures but referred for other neurological conditions (Bajic et al., 2008; Gamss et al., 2009), thus leading to an imprecise estimation of their prevalence. Moreover, a probable lateralization of IHI, predominantly in the left hemisphere, has been noted (Baulac et al., 1998; Bernasconi et al., 2005; Raininko and Bajic, 2010). Finally, it is unknown whether this unusual pattern is confined to the medial temporal lobe or is associated with more widespread morphological changes throughout the brain.
Our purpose was to study the prevalence and characteristics of IHI in a large population of normal subjects. We studied a community-based sample of 2008 young subjects of the European database IMAGEN (Schumann et al., 2010). The presence of IHI was assessed visually on 3D T1-weighted magnetic resonance imaging (MRI) data. To that aim, we designed a new visual scale of IHI that includes the most representative published criteria of IHI (Baulac et al., 1998; Bernasconi et al., 2005), includes a reasonable number of items and leads to a robust assessment. In order to explore the association of IHI with extra-hippocampal changes, we performed a morphometric analysis of 45 cortical sulci in each hemisphere, which were extracted using automatic image processing software.
Materials and methods
Participants and MRI data
We studied a community-based sample of young subjects from the multi-centric European database IMAGEN (Schumann et al., 2010; http://www.imagen-europe.com/). Local ethics committee1 approved the study. Participants' parents gave informed written consent, and the adolescents gave written assent. We studied 2089 subjects with high-resolution T1-weighted anatomical MRI. For all subjects, T1-weighted MRI were acquired on 3 Tesla scanners (Siemens Verio and TimTrio, Philips Achieva, General Electric Signa Excite, and Signa HDx) using a 3D Magnetization Prepared Rapid Acquisition Gradient Echo (MPRAGE) sequence (TR = 2300 ms; TE = 2.8 ms, flip angle = 9°; resolution: 1 × 1 × 1 mm3). We performed quality control of the MRI data, checking for general quality as well as specific visibility of the hippocampal formations. The MRI was judged of sufficient quality for assessment of IHI for 2008 subjects, which were entered into the study (characteristics of the subjects are given in Table 1). In order to perform IHI assessment with a standardized orientation, T1-weighted MRIs were then registered toward the MNI152 atlas using the FSL software using the fully automated affine transformation FLIRT (Jenkinson and Smith, 2001; Jenkinson et al., 2002).
Table 1.
Number of subjects | Gender | Age in years mean ± SD (range) | Handedness (Right/Left/Both) |
---|---|---|---|
2008 | 1029 F/978 M | 14.5 ± 0.4 (12.9–17.2) | 1740/218/14 |
F, Female; M, Male; SD, Standard-Deviation.
Criteria of incomplete hippocampal inversions
A round and verticalized hippocampus, a deep collateral sulcus, and a medial positioning globally characterize an IHI. For rating IHI, five individual criteria (named C1 to C5) and a global criterion named C0 were defined.
Criterion C1: verticality and roundness of the hippocampal body
Criterion C1 assesses both the roundness of the hippocampal body and its verticality. Some studies have considered roundness and verticality simultaneously (Lehéricy et al., 1995; Bernasconi et al., 2005), while others have considered them separately (Baulac et al., 1998) or have considered only the roundness (Barsi et al., 2000; Bajic et al., 2008; Gamss et al., 2009; Stiers et al., 2010). In our case, we considered roundness and verticality as a single criterion, in order to limit the number of criteria.
Criterion C1 was evaluated on the first half of the hippocampal body, on coronal slices. The principles used to evaluate this criterion are illustrated on Figure 1C1. Two segments C1a and C1b are determined. Segment C1a represents the width of the hippocampus in a coronal view. It is estimated parallel to the ventral part of the cornu Ammonis (CA)/subiculum and goes from the medial part of the dentate gyrus to the lateral part of CA. The segment C1b in a coronal view represents the height of the hippocampal body. C1b must be perpendicular to segment C1a and goes from the dorsal part of the hippocampus to the ventral part of CA. The roundness is evaluated on three levels: flat (width larger than height, i.e., C1a > C1b), round (C1a = C1b) or oval (C1a < C1b). For the verticality, three levels were used: horizontal if the segment C1a is horizontal (with a tolerance of around 10°), oblique if C1a is neither horizontal nor vertical (around 45°) and vertical if segment C1a is vertical with also a tolerance of around 10°.
Segments on Figure 1 are here to illustrate and help the new observer to understand the criterion. The evaluation of the MRI is made without tracing such segments.
When roundness and verticality have been determined, they are reported to determine the grade for the C1 criterion following the rules defined in Table 2. Examples are shown on Figure 2, basically, a flat horizontal hippocampus has a grade C1 = 0, a round hippocampus has a grade C1 = 1, and a vertical hippocampus has a grade C1 = 2.
Table 2.
Roundness/verticality | Horizontal | Oblique | Vertical |
---|---|---|---|
Flat | 0 | 0.5 | NA |
Round | 0.5 | 1 | 2 |
Oval | 1 | 1.5 | 2 |
NA, not applicable. Grades are between 0 and 2.
Criterion C2: collateral sulcus
This criterion assesses the verticality and depth of the collateral sulcus relatively to the size of the hippocampus. The collateral sulcus separates the fourth (T4) from the fifth convolution (T5) of the temporal lobe, and supports the collateral eminence. This criterion is evaluated at the level of the hippocampal body, where the collateral sulcus is easier to identify.
In Figure 1C2, the vertical orange line indicates the lateral limit of the hippocampus. The evaluation of this criterion has been defined as follows: if the collateral sulcus (CS) does not cross the lateral limit of the hippocampus, the grade for C2 will be from 0 to 1, i.e., 0, 0.5, or 1. If the CS crosses the lateral limit of the hippocampus, the grade will be from 1 to 2 (i.e., 1, 1.5, or 2). A sulcus can be horizontal, oblique or vertical, a more vertical sulcus will result in a higher grade, as presented in Table 3. Examples are given on Figure 2.
Table 3.
CS<H | CS = H | CS > H | |||||
---|---|---|---|---|---|---|---|
Verticality | hor | obl/ver | hor/obl | ver | hor | obl | ver |
Grade | 0 | 0.5 | 1 | 1.5 | 1 | 1.5 | 2 |
CS, collateral Sulcus; H, Hippocampus; hor, horizontal; obl, oblique; ver, vertical. The depth of the collateral sulcus (CS) is defined by its length compared to the width of the hippocampus (H). The verticality is evaluated on three levels: horizontal (hor) oblique (obl) and vertical (ver). Grades are between 0 and 2.
Criterion C3: medial positioning
This criterion assesses the medial positioning of the hippocampus. To evaluate this criterion, we consider the length of the part of the subiculum that is not covered by the dentate gyrus (segment C3a on Figure 1C3) relatively to the ventral part of CA/subiculum that is covered by the dentate gyrus (segment C3b on Figure 1C3). Even if the hippocampus is vertical or oblique, segments C3b and C3a are defined orthogonally to the brain midline. In addition, we considered whether the temporal horn (TH) of the lateral ventricle was empty or filled by CSF.
The evaluation is made on five levels: from 0 for a very lateral positioning to 2 for a very medial one. Evaluations are given in Table 4. The two extreme grades are without considering the TH: if the C3a segment is not visible because the hippocampus is too close to the ambient cistern, the grade is 2. Similarly, if the subiculum is very long compared to the C3b part, the grade is 0, regardless of the TH. In other situations, the grade is modulated by the configuration of the TH, as presented in Table 4. Examples are displayed on Figure 2.
Table 4.
C3a < < C3b | C3a < C3b | C3a = C3b | C3a > C3b | C3a >> C3b | |
---|---|---|---|---|---|
TH emptied | 2 | 1 | 0.5 | 0 | 0 |
TH filled | 2 | 1.5 | 1 | 0.5 | 0 |
C3a, Subiculum part not covered by the dentate gyrus; C3b, Cornus Ammonis part covered by the dentate gyrus; TH, Temporal Horn of the lateral ventricle. The medial positioning of the hippocampus is determined by comparing the length of the subiculum part (Sp) not covered by the dentate gyrus to the length of the CA part (CAp) covered by the dentate gyrus. Grades are between 0 and 2.
Criterion C4: subiculum
This criterion assesses the thickness of the subiculum, as in Bernasconi et al. (2005). The subiculum is considered as abnormal if it is bulging upward, therefore looking thickened, which corresponds to a grade equal to 2. Otherwise, the subiculum is considered normal and the grade is 0.
Criterion C5: sulci of the fusiform gyrus (T4)
This is a new criterion, which complements criterion C2. Indeed, we observed that IHI are not only associated with atypical patterns of the collateral sulcus (CS) but also of the occipito-temporal sulcus (OTS) which separates the fourth temporal (T4) and the third temporal (T3) convolutions. In that case, the OTS is deep and comes laterally to the hippocampus. Criterion C5 takes into account both the CS and the OTS. We evaluate if one of these sulci is deep enough to cross the level of the subiculum. In Figure 1C5, we can see that none of the two sulci, which superior parts are indicated by dotted lines, goes over the subiculum indicated by the red area.
The evaluation is made on three levels. If none of the sulci exceed the level of the subiculum, the grade is 0. If one of the sulci crosses sidewise the level of the subiculum, with an oblique orientation, the grade is 1; if a sulcus exceeds vertically the subiculum, the grade is 2. Examples are displayed on Figure 2.
Criterion C0: global aspect of the hippocampus
In addition to these five individual criteria, we also defined a global criterion indicating the presence of an IHI. This was done in order to provide a global assessment of the presence of an IHI. Criterion C0 is evaluated on three levels, a grade of 0 is given if the hippocampus has a common aspect, a grade of 2 is given if the hippocampus has a pronounced incomplete inversion which corresponds to the total IHI in the literature (Baulac et al., 1998; Bajic et al., 2008), and a 1 is given if the hippocampus does not have a common aspect (flat and horizontal) neither a clear incomplete inversion, which corresponds to a partial IHI (Bajic et al., 2008).
Assessment of incomplete hippocampal inversions
IHI were assessed by two trained observers (CC and FC). Forty-two subjects were randomly selected to evaluate the intra- and inter-observer reproducibility of the evaluations. Half of the remaining 1966 subjects were evaluated by CC; the other half was evaluated by FC. Additionally CC checked the evaluations given by FC, and FC checked the evaluations given by CC in order to homogenize evaluations.
Intra- and inter-observer reproducibility
To evaluate the reproducibility, each observer (CC and FC) evaluated twice the same series of 42 subjects. The first time was after the evaluation of 200 subjects, and the second time after assessment of 900 subjects, with at least 3 weeks in between. Intra- and inter-observer reproducibility were computed using kappa tests (Viera and Garrett, 2005) for the criteria C0, C4, and C5, and a weighted kappa tests for criteria C1, C2, and C3. Reproducibility of criterion C4 could not be evaluated because all subjects used for reproducibility assessment had a C4 grade equal to zero.
Sulcal morphometry
For each subject, cortical sulci were automatically extracted and identified from T1-weighted MRI using the Morphologist toolbox (Fischer et al., 2012) of the BrainVisa software (http://brainvisa.info). Briefly, this method involves the following steps: (1) brain extraction and separation of hemispheres; (2) classification of white matter (WM), gray matter (GM), and cerebro-spinal fluid (CSF); (3) reconstruction of the surfaces corresponding to the GM-WM and GM-CSF interface maps; (4) extraction of the sulcal folds by segmenting the skeletonized GM/CSF interface; (5) automatic labeling of individual cortical sulci using a machine learning approach. We analyzed 45 cortical sulci per hemisphere. These sulci are listed on Figure 3.
In all subjects, the output of the automatic procedure was quality controlled by a trained observer (CF) using a standardized procedure to identify possible labeling errors. Labeling quality was judged sufficient in 1705 cases that were retained for the sulcal morphometry analysis. For each identified sulcus, we computed the following morphological measures: surface of the sulcus medial sheet, maximal and mean depth along the sulcus, sulcal width, (defined as the mean distance between the two walls of the pial surface), and gray matter thickness in the neighborhood of the sulcus.
Statistical analysis
Based on the global criterion, we computed the proportions of IHI within the population along with confidence intervals at 95%. We compared the proportion of IHI between left and right hemispheres, between males and females and between left-handed and right-handed subjects using χ2 tests. For all individual criteria C1 to C5, we computed the frequencies of the different possible grades (from 0 to 2). Results between left and right hippocampi were compared using χ2 tests. Finally, we studied the relationship between the sum of individual criteria (called IHI score in the following) and the global criterion C0 and estimated an optimal threshold on the IHI score to classify IHI, using C0 as a reference. This allowed dividing the population into two groups for each side denoted as IHI (subjects with IHI) and non-IHI (subjects without IHI in any side).
To explore whether subjects with IHI exhibit atypical anatomical patterns outside of the hippocampus, we compared the sulcal characteristics between IHI and non-IHI groups using Student's t-test. Corresponding effect sizes were estimated using Cohen's d coefficient. We assessed both ipsilateral (i.e., left hippocampus with left sulci and right hippocampus with right sulci) and contralateral (i.e., left hippocampus with right sulci and right hippocampus with left sulci) associations. P-values were corrected for multiple comparisons using Bonferroni correction (45 sulci × 5 measures × 4 associations = 900 tests).
Results
Intra- and inter-observer reproducibility
Results of kappa tests for the intra- and inter- observer reproducibility are given in Table 5. A kappa value over 0.6 indicates a substantial agreement, and over 0.8 a very strong agreement (Viera and Garrett, 2005). In all cases, intra- and inter-observer agreements were beyond substantial (0.6). Very strong agreements (over 0.8) were observed in the vast majority of cases (14/20).
Table 5.
C0 | C1 | C2 | C3 | C5 | |
---|---|---|---|---|---|
CC1 vs. CC2 | 0.80 | 0.74 | 0.78 | 0.81 | 0.73 |
CI: [0.66; 0.95] | CI: [0.63; 0.86] | CI: [0.68; 0.89] | CI: [0.71; 0.90] | CI: [0.58; 0.88] | |
FC1 vs. FC2 | 0.89 | 0.71 | 0.82 | 0.87 | 0.87 |
CI: [0.78; 0.99] | CI: [0.59; 0.83] | CI: [0.70; 0.93] | CI: [0.76; 0.92] | CI: [0.76; 0.98] | |
CC1 vs. FC1 | 0.79 | 0.64 | 0.81 | 0.86 | 0.86 |
CI: [0.63; 0.94] | CI: [0.52;0.76] | CI: [0.72; 0.91] | CI: [0.78; 0.94] | CI: [0.75; 0.97] | |
CC2 vs. FC2 | 0.87 | 0.82 | 0.88 | 0.87 | 0.80 |
CI: [0.75; 0.99] | CI: [0.72; 0.92] | CI: [0.81; 0.96] | CI: [0.80; 0.95] | CI: [0.66; 0.94] |
CC1, first evaluation of observer CC; CC2, second evaluation of the observer CC; FC1, first evaluation of observer FC; FC2, second evaluation of the observer FC; CI, Confidence Interval at 95%. Kappa tests for C0 and C5. Weighted kappa tests for C1, C2, and C3. Confidence intervals (CI) are at 95%.
Results of visual evaluation of IHI
Table 6 presents the prevalence of IHI according to the global criterion C0. Total IHI was found in 17% of normal subjects for the left hippocampus and 6% for the right. IHI were significantly more frequent for the left hippocampus compared to the right (χ2 test, χ2 = 129.2, DF = 2, p < 10−28). Table 7 displays the co-occurrences of left and right IHI. One can note that the majority of right IHI are in fact bilateral IHI, unilateral right IHI having low frequency. On the other hand, unilateral left IHI are common.
Table 6.
C0 | No IHI | Partial IHI | IHI |
---|---|---|---|
Left | 70.9% | 11.9% | 17.1% |
CI: [68.9%; 72.9%] | CI: [10.5%; 13.3%] | CI: [15.5%; 18.7%] | |
Right | 84.6% | 9.0% | 6.5% |
CI: [83.0%; 86.2%] | CI: [7.7%; 10.3%] | CI: [5.4%; 7.6%] |
CI, Confidence Interval at 95%.
Table 7.
Left vs. Right | No IHI Right | Partial IHI Right | IHI Right |
---|---|---|---|
No IHI Left | 65.9% | 3.1% | 1.9% |
CI: [63.8%; 68.0%] | CI: [2.3%; 3.9%] | CI: [1.3%; 2.5%] | |
Partial IHI Left | 7.9% | 3.5% | 0.5% |
CI: [6.7%; 9.1%] | CI: [2.7%; 4.3%] | CI: [0.2%; 0.8%] | |
IHI Left | 10.8% | 2.3% | 4.0% |
CI: [9.4%; 12.2%] | CI: [1.6%; 3.0%] | CI: [3.1%; 4.9%] |
CI, Confidence Interval at 95%.
The frequencies did not differ between males and females for criterion C0 (χ2 = 4.41, DF = 2, p = 0.11 for left; χ2 = 1.29, DF = 2, p = 0.52 for right). The frequencies also did not depend on handedness (χ2 = 2.29, DF = 2, p = 0.89 for left; χ2 = 5.07, DF = 2, p = 0.54 for right).
For all individual criteria, the repartition was statistically different between left and right (Table 8). The sum of grades for all individual criteria (C1 to C5) provides an overall degree of IHI between 0 and 10, denoted as IHI score. Figure 4 shows the repartition of IHI score with respect to the grade of the global criterion C0. We can note that the populations with Total IHI and without IHI are well separated. On the other hand, the intermediate class of “Partial IHI” overlaps with the two others. This highlights the consistency between the global criterion C0 and the individual criteria C1 to C5.
Table 8.
Left | Right | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
0 | 0.5 | 1 | 0.5 | 2 | 0 | 0.5 | 1 | 1.5 | 2 | p-value | |
C1 | 23% | 44% | 23% | 8% | 1% | 20% | 28% | 18% | 3% | 0% | p < 10−26 |
C2 | 18% | 42% | 28% | 11% | 1% | 9% | 57% | 29% | 4% | 0% | p < 10−81 |
C3 | 27% | 40% | 21% | 10% | 2% | 38% | 39% | 17% | 5% | 1% | p < 10−20 |
C4 | 97% | NA | NA | NA | 3% | 98% | NA | NA | NA | 2% | p < 10−4 |
C5 | 59% | NA | 20% | NA | 20% | 85% | NA | 6% | NA | 9% | p < 10−73 |
NA, Not Applicable. We tested whether the repartition differs between left and right for each criterion (χ2 test).
Furthermore, we computed the optimal threshold grade on IHI score to classify a given hippocampus into IHI or not, using the global criterion C0 as a reference. To compute this threshold, we used only hippocampi with a C0 grade of 0 (absence of IHI) or 2 (Total IHI). We then computed the threshold on IHI score that maximizes the accuracy of the classification between cases with and without IHI. The optimal threshold is 3.75, i.e., hippocampi without IHI correspond to IHI score < 4, and hippocampi with IHI correspond to IHI score ≥4. Table 9 reports the frequencies of IHI using this threshold, it indicates both frequencies obtained without taking into account the hippocampi with C0 = 1 (which are thus very close to those reported in Table 6) and frequencies obtained when classifying all hippocampi.
Table 9.
Left hippocampi | Right hippocampi | |||
---|---|---|---|---|
Fixing the partial IHI | Classifying all hippocampi | Fixing the partial IHI | Classifying all hippocampi | |
IHI | 17% | 22% | 6% | 8% |
No IHI | 71% | 78% | 85% | 92% |
By fixing the partial IHI group (i.e., we ignore this group for the classification), or by classifying the whole population.
Sulcal morphometry
Sulci extraction was considered of sufficient quality for 1705 subjects. To ensure that restriction to this subpopulation did not bias the results, we computed IHI frequencies in these 1705 subjects. For left hippocampi, 383 were part of the IHI group and 1265 of the non-IHI group. For right hippocampi, 134 were part of the IHI group and 1265 of the non-IHI group. These proportions are similar to those of the whole population (presented in Table 9, second and fourth columns).
Sulcal characteristics that were significantly different between the two groups are reported in Table 10 and displayed on Figure 5. Differences in left side were ipsilateral to the IHI, and in both sides for the right side.
Table 10.
Sulci | Measure | Mean of IHI group | Mean of no-IHI group | Cohen's d | T | Corrected p-value | |
---|---|---|---|---|---|---|---|
Left Hippocampi | Calcarine fissure (F.Cal.) | GM thickness | 3.7875 | 3.8853 | −0.33 | −5.72 | 1.13e-05 |
vs. Left | Opening | 1.8468 | 1.5848 | 0.5 | 9.72 | 8.79e-19 | |
Hemisphere | Surface | 2127.1 | 2362.0 | −0.36 | −5.89 | 4.11e-06 | |
Collateral sulcus (F.Coll.) | Max depth | 26.560 | 21.384 | 0.36 | 7.19 | 8.52e-10 | |
Opening | 1.6391 | 1.5341 | 0.29 | 5.13 | 2.9e-04 | ||
Callosal sulcus (S.Call.) | Max depth | 11.263 | 12.520 | −0.38 | −6.41 | 1.63e-07 | |
Mean depth | 6.7289 | 7.2136 | −0.45 | −7.7 | 2.10e-11 | ||
Length | 100.59 | 111.48 | −0.31 | −5.5 | 4.02e-05 | ||
Opening | 4.1009 | 3.5540 | 0.38 | 6.9 | 6.32e-09 | ||
Surface | 932.01 | 1113.0 | −0.42 | −7.28 | 4.65e-10 | ||
Lingual sulcus (S.Li.) | Mean depth | 10.014 | 9.5270 | 0.24 | 4.37 | 1.17e-02 | |
Occipito-temporal sulcus (S.O.T.lat.ant) | Opening | 3.1394 | 2.8511 | 0.22 | 4.12 | 3.62e-02 | |
Right Hipp | Collateral sulcus (F.Coll.) | Max depth | 26.205 | 21.436 | 0.35 | 5.05 | 4.61e-04 |
vs. Right Hem | Central sulcus (S.C.) | GM thickness | 3.6417 | 3.7501 | −0.32 | −4.08 | 4.25e-02 |
Right Hipp vs. Left Hem | Calcarine fissure (F.Cal.) | Opening | 1.8009 | 1.5848 | 0.46 | 5.72 | 1.17e-05 |
GM, gray matter; Hipp, Hippocampi; Hem, Hemisphere; T, T Statistic of the t-test; d, effect size. The table lists the sulci for which a significant difference between the two groups was found (statistical threshold was p < 0.05 corrected for multiple comparisons using Bonferroni correction).
Discussion
In this paper, we characterized IHIs and studied their prevalence in a large population of young normal subjects. We demonstrated that IHI are a common anatomical pattern in normal subjects, that they are much more frequent in the left hemisphere and that they are associated to more widespread morphological changes outside the hippocampus.
The existence of IHI in normal subjects was already known (Bernasconi et al., 2005; Bajic et al., 2009; Gamss et al., 2009) but their prevalence was a matter of debate, some authors arguing that IHI are a rare finding in patients without epilepsy (Gamss et al., 2009) and others reporting that IHI are a common variant (Bajic et al., 2009; Raininko and Bajic, 2010). The discrepancies between previous studies can be due to: (1) relatively small number of subjects resulting in imprecise estimates of the frequency; (2) populations that mixed healthy controls and patients without epilepsy but with other neurological conditions; (3) different sets of criteria for assessing IHI. Our study relied on a large population of normal subjects, providing reliable estimates with narrow confidence intervals. Furthermore, we included only young normal subjects thus avoiding the occurrence of medical conditions that could bias the estimates or of age-related morphological changes that could make the visual evaluation difficult.
Incomplete inversions were clearly more frequent in the left than in the right hemisphere. Furthermore, unilateral right IHI were particularly rare. This finding is consistent with previous studies (Barsi et al., 2000; Bajic et al., 2009; Raininko and Bajic, 2010). It seems that an asymmetric development of the hippocampus is common, and that this asymmetry is lateralized, the right hippocampus developing at faster pace in a vast majority of cases (Bajic et al., 2012). This implies that the hippocampal inversion as well as the closing of the hippocampal sulcus may occur earlier in the right hemisphere. One can thus think that, if the hippocampal inversion process is stopped at a specific time, it may be incomplete only in the left hemisphere. Furthermore, in normal adults, various studies have shown asymmetry in hippocampal volumes, the right being larger (Pedraza et al., 2004; Lucarelli et al., 2013). Whether this volumetric asymmetry could be related to increased prevalence of IHI in the left hippocampus remains to be studied. Furthermore, there are also functional differences between the two hippocampi: the right is predominantly involved in memory for locations within an environment whereas the left hippocampus plays a central role in context-dependant episodic memory or in autobiographical memory (Bohbot et al., 1998; Maguire, 2001; Burgess, 2002). Asymmetry of gene expression levels has been demonstrated in the hippocampi of rats (Moskal et al., 2006) as well as the human cerebral cortex (Sun et al., 2005), which could in turn provide a basis of structural and functional asymmetries.
Compared to subjects without IHI, subjects with IHI had different morphological characteristics in several cortical sulci. This demonstrates that morphological changes associated with IHI are not confined to the hippocampus or to the medial temporal lobe. In left IHI, sulcal changes were located on the internal part of the cortex (Figure 5), and followed the limbic lobe which is involved in memories formation, long term memory and emotions, and includes the hippocampus (Duvernoy, 2005). In right IHI, differences were less extensive and confined to the collateral sulcus and the central sulcus of the right hemisphere. For the right IHI we also found differences in the left hemisphere, however right IHI are mainly bilateral; indeed in Table 10, the results for the calcarine fissure are very similar for left IHI vs. left hemisphere and right IHI vs. left hemisphere. Therefore, we cannot say that right IHI are related with morphological changes in the left hemisphere.
The hippocampal formation is the first cortical area to differentiate (Humphrey, 1967) and at 30 gestational weeks (GW), the hippocampus formation has acquired most of the features observed in the adult population. Primordial hippocampi seem to be observable from 7 GW (Baker and Barkovich, 1992). At 10 GW, the dentate gyrus and the cornu Ammonis are rudimentary structures situated in the postero-medial wall of the lateral ventricles (Humphrey, 1967). At 13 GW, the hippocampus goes from the frontal lobe to the temporal lobe on the postero-medial wall of the lateral ventricles, and surrounds a widely open hippocampal sulcus (Humphrey, 1967; Kier et al., 1997). At 16 GW the hippocampus reduces in size (relatively to the size of the brain which increases), pushed by the growth of the corpus callosum and therefore has to leave the frontal lobe to only occupy the temporal lobe. Furthermore, this growth of the corpus callosum coincides with the growth of the callosal sulcus which appears around the 16th GW (Chi et al., 1977; Larroche, 1981; Nishikuni and Ribas, 2012). The other significant sulci found in the study appear after, during the inversion phase of the hippocampus, which occurs between the 20th GW and the 30th GW (Bajic et al., 2010). The next to appear is the calcarine fissure, around the 20th GW (Chi et al., 1977; Dorovini-Zis and Dolman, 1977; Nishikuni and Ribas, 2012). The collateral sulcus appears around the 24th GW (Chi et al., 1977; Garel et al., 2001; Nishikuni and Ribas, 2012). In our study, morphological characteristics of these sulci were altered in subjects with IHI.
Different criteria have been used in the literature to assess IHI, making it difficult to compare results across studies (Gamss et al., 2009; Raininko and Bajic, 2010). Moreover, these visual scales differ in terms of number of features to assess; those with many features being not easily applicable to larger series of over 1000 subjects. In this work, we adapted existing criteria from the literature in order to propose a new visual scale of IHI that includes the most representative published criteria of IHI (Baulac et al., 1998; Bernasconi et al., 2005), includes a reasonable number of items and leads to a robust assessment. We demonstrated that our criteria are highly reproducible across observers and rating sessions. We also defined a global criterion assessing the overall presence of an IHI. Although this criterion could theoretically be more subjective, we showed that its reproducibility is as good as for the other criteria. Furthermore, the global criterion was highly consistent with the individual scores. The detailed criteria presented above could lead to more comparable results across studies. The distribution of the sum of individual criteria indicates that there is a continuum between a normal hippocampus and IHI, with various intermediate degrees of hippocampal inversions. The sum of individual criteria can be used to assess the degree of IHI of hippocampi and for subsequent correlation with other neuroanatomical or behavioral features. It is also possible to use the global criterion in order to propose a threshold on the sum of criteria to obtain a binary classification into IHI and typical hippocampi.
Compared to the other criteria, there were much less subjects with an abnormal score for criterion C4 (about 3% of subjects), corresponding to a thicker subiculum. Interestingly, in Bernasconi et al. (2005), none of the 50 healthy subjects had an abnormally thick subiculum against 17 of the 76 patients with MCD, and 4 of the 30 patients with TLE. This criterion might thus be overrepresented in patients with MCD or TLE. Nevertheless, this hypothesis would need to be further tested in a larger population of patients with epilepsy or MCD.
IHI are highly prevalent in patients with epilepsy (30–50%), in particular in patients with MCD but also in TLE (Lehéricy et al., 1995; Baulac et al., 1998; Bernasconi et al., 2005; Bajic et al., 2009). IHI have also been described in patients with agenesis of the corpus callosum (Atlas et al., 1986), and patients with genetic anomalies (Fitoz et al., 2003; Grosso et al., 2003; Andrade et al., 2013; Boronat et al., 2015) associated with neuropsychiatric disorders including autism spectrum disorders (Campbell et al., 2006) and schizophrenia (Baker et al., 2011). IHI are thus likely to be a marker of more extensive atypical development that may render the brain more vulnerable to pathological processes. Nevertheless, further studies are needed to fully describe IHI in different neurological and psychiatric disorders and to elucidate their putative role in pathogenesis. By providing an extensive characterization of IHI in the general population, our study shall provide a reference for future research on the role of IHI in different pathological conditions.
Our study has the following limitations. We applied a strict Bonferroni correction to the sulcal morphometry analysis. This procedure has the advantage to strictly control for false positives. Nevertheless, it may be overly conservative since sulcal measures are not statistically independent. Effect sizes were small to moderate but were within the typical range of morphometric studies of brain development, as for example these studies (Haar et al., 2014; Klein et al., 2014; Lefebvre et al., 2015) that found significant differences in brain structures volume with small to moderate effects. Furthermore, taking into account that the sulci are highly variable, we cannot expect observing bigger effects. Further studies using more comprehensive models of sulcal shapes are needed to clarify the nature of the relationships between IHI and sulcal changes.
In conclusion, IHIs are frequently found in normal subjects, predominantly in the left hemisphere. IHI are associated with extra-hippocampal morphological changes, in particular in sulci of the limbic lobe.
Author contributions
Guarantor of integrity of entire study, CC; study concepts and design or data acquisition or data analysis and interpretation, all authors; manuscript drafting or manuscript revision for important intellectual content, all authors; approval of final version of submitted manuscript, all authors; literature research, CC, FC, OC, DH; clinical studies, TB, AB, UB, CB, AC, PC, HF, JG, HG, PG, AH, BI, HL, J-LM, FN, MP, DO, TP, LP, MS, HW, RW, VF, GS; statistical analysis, CC, RT, FC, JS, CF, AM, J-FM, JAG, OC; and manuscript editing, all authors.
Source of funding
This work was supported by ANR (project HM-TC, grant number ANR-09-EMER-006), by the CATI project (Fondation Plan Alzheimer), and by the program “Investissements d'avenir” (grant number ANR-10-IAIHU-06). IMAGEN was supported by the European Union-funded FP6 (LSHM-CT-2007-037286), the FP7 projects IMAGEMEND (602450) and MATRICS (603016), and the Innovative Medicine Initiative Project EU-AIMS (115300-2), Medical Research Council Program Grant “Developmental pathways into adolescent substance abuse” (93558), the NIHR Biomedical Research Centre “Mental Health” as well as the Swedish funding agency FORMAS. Further support was provided by the Bundesministerium für Bildung und Forschung eMED SysAlc: 01ZX1311E (Berlin); AERIAL: 01EE1406A (Berlin).
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The sponsors of the study had no role in study design, data analysis or interpretation, writing or decision to submit the report for publication.
Footnotes
1London: Psychiatry, Nursing and Midwifery (PNM) Research Ethics Subcommittee (RESC), Waterloo Campus, King's College London. Nottingham: University of Nottingham Medical School Ethics Committee. Mannheim: Medizinische Fakultaet Mannheim, Ruprecht Karl Universitaet Heidelberg and Ethik-Kommission II an der Fakultaet fuer Kliniksche Medizin Mannheim. Dresden: Ethikkommission der Medizinischen Fakultaet Carl Gustav Carus, TU Dresden Medizinische Fakultaet. Hamburg: Ethics board, Hamburg Chamber of Phsyicians. Paris: CPP IDF VII (Comité de protection des personnes Ile de France), ID RCB: 2007-A00778-45 September 24th 2007. Dublin: TCD School of Psychology REC. Berlin: ethics committee of the Faculty of Psychology. And Mannheim's ethics committee approved the whole study.
References
- Andrade D. M., Krings T., Chow E. W. C., Kiehl T.-R., Bassett A. S. (2013). Hippocampal malrotation is associated with chromosome 22q11.2 microdeletion. Can. J. Neurol. Sci. 40, 652–656. 10.1017/S0317167100014876 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Atlas S. W., Zimmerman R. A., Bilaniuk L. T., Rorke L., Hackney D. B., Goldberg H. I., et al. (1986). Corpus callosum and limbic system: neuroanatomic MR evaluation of developmental anomalies. Radiology 160, 355–362. 10.1148/radiology.160.2.3726113 [DOI] [PubMed] [Google Scholar]
- Bajic D., Canto Moreira N., Wikström J., Raininko R. (2012). Asymmetric development of the hippocampal region is common: a fetal MR imaging study. AJNR Am. J. Neuroradiol. 33, 513–518. 10.3174/ajnr.A2814 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bajic D., Ewald U., Raininko R. (2010). Hippocampal development at gestation weeks 23 to 36. An ultrasound study on preterm neonates. Neuroradiology 52, 489–494. 10.1007/s00234-010-0673-x [DOI] [PubMed] [Google Scholar]
- Bajic D., Kumlien E., Mattsson P., Lundberg S., Wang C., Raininko R. (2009). Incomplete hippocampal inversion—is there a relation to epilepsy? Eur. Radiol. 19, 2544–2550. 10.1007/s00330-009-1438-y [DOI] [PubMed] [Google Scholar]
- Bajic D., Wang C., Kumlien E., Mattsson P., Lundberg S., Eeg-Olofsson O., et al. (2008). Incomplete inversion of the hippocampus–a common developmental anomaly. Eur. Radiol. 18, 138–142. 10.1007/s00330-007-0735-6 [DOI] [PubMed] [Google Scholar]
- Baker K, Chaddock, C. A., Baldeweg T., Skuse D. (2011). Neuroanatomy in adolescents and young adults with 22q11 deletion syndrome: comparison to an IQ-matched group. Neuroimage 55, 491–499. 10.1016/j.neuroimage.2010.12.041 [DOI] [PubMed] [Google Scholar]
- Baker L. L., Barkovich A. J. (1992). The large temporal horn: MR analysis in developmental brain anomalies versus hydrocephalus. Am. J. Neuroradiol. 13, 115–122. [PMC free article] [PubMed] [Google Scholar]
- Barsi P., Kenéz J., Solymosi D., Kulin A., Halász P., Rásonyi G., et al. (2000). Hippocampal malrotation with normal corpus callosum: a new entity? Neuroradiology 42, 339–345. 10.1007/s002340050895 [DOI] [PubMed] [Google Scholar]
- Baulac M., De Grissac N., Hasboun D., Oppenheim C., Adam C., Arzimanoglou A., et al. (1998). Hippocampal developmental changes in patients with partial epilepsy: magnetic resonance imaging and clinical aspects. Ann. Neurol. 44, 223–233. 10.1002/ana.410440213 [DOI] [PubMed] [Google Scholar]
- Bernasconi N., Kinay D., Andermann F., Antel S., Bernasconi A. (2005). Analysis of shape and positioning of the hippocampal formation: an MRI study in patients with partial epilepsy and healthy controls. Brain 128, 2442–2452. 10.1093/brain/awh599 [DOI] [PubMed] [Google Scholar]
- Bohbot V. D., Kalina M., Stepankova K., Spackova N., Petrides M., Nadel L. (1998). Spatial memory deficits in patients with lesions to the right hippocampus and to the right parahippocampal cortex. Neuropsychologia 36, 1217–1238. 10.1016/S0028-3932(97)00161-9 [DOI] [PubMed] [Google Scholar]
- Boronat S., Mehan W. A., Shaaya E. A., Thibert R. L., Caruso P. (2015). Hippocampal abnormalities in Magnetic Resonance Imaging (MRI) of 15q duplication syndromes. J. Child Neurol. 30, 333–338. 10.1177/0883073814538669 [DOI] [PubMed] [Google Scholar]
- Bronen R. A., Cheung G. (1991). MRI of the normal hippocampus. Magn. Reson. Imaging 9, 497–500. 10.1016/0730-725X(91)90035-K [DOI] [PubMed] [Google Scholar]
- Burgess N. (2002). The hippocampus, space, and viewpoints in episodic memory. Q. J. Exp. Psychol. 55, 1057–1080. 10.1080/02724980244000224 [DOI] [PubMed] [Google Scholar]
- Campbell L. E., Daly E., Toal F., Stevens A., Azuma R., Catani M., Ng V., et al. (2006). Brain and behaviour in children with 22q11.2 deletion syndrome: a volumetric and voxel-based morphometry mri study. Brain 129(Pt 5), 1218–1228. 10.1093/brain/awl066 [DOI] [PubMed] [Google Scholar]
- Chi J. G., Dooling E. C., Gilles F. H. (1977). Gyral development of the human brain. Ann. Neurol. 1, 86–93. 10.1002/ana.410010109 [DOI] [PubMed] [Google Scholar]
- Dorovini-Zis K., Dolman C. L. (1977). Gestational development of brain. Arch. Pathol. Lab. Med. 101, 192–195. [PubMed] [Google Scholar]
- Duvernoy H. (2005). The Human Hippocampus: Functional Anatomy, Vascularization and Serial Sections with MRI. Berlin: Springer Verlag. [Google Scholar]
- Fischer C., Operto G., Laguitton S., Perrot M., Denghien I., Rivière D., et al. (2012). Morphologist 2012: the new morphological pipeline of BrainVISA. Hum. Brain Mapp. [Google Scholar]
- Fitoz S., Atasoy C., Deda G., Erden I., Akyar S. (2003). Hippocampal malrotation with normal corpus callosum in a child with opitz syndrome. Clin. Imaging 27, 75–76. 10.1016/S0899-7071(02)00505-3 [DOI] [PubMed] [Google Scholar]
- Gamss R. P., Slasky S. E., Bello J. A., Miller T. S., Shinnar S. (2009). Prevalence of hippocampal malrotation in a population without seizures. AJNR Am. J. Neuroradiol. 30, 1571–1573. 10.3174/ajnr.A1657 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garel C., Chantrel E., Brisse H., Elmaleh M., Luton D., Oury J.-F., et al. (2001). Fetal cerebral cortex: normal gestational landmarks identified using prenatal MR imaging. Am. J. Neuroradiol. 22, 184–189. [PMC free article] [PubMed] [Google Scholar]
- Grosso S., Farnetani M. A., Berardi R., Bartalini G., Carpentieri M., Galluzzi P., et al. (2003). Medial temporal lobe dysgenesis in muenke syndrome and hypochondroplasia. Am. J. Med. Genet. A 120A, 88–91. 10.1002/ajmg.a.10171 [DOI] [PubMed] [Google Scholar]
- Haar S., Berman S., Behrmann M., Dinstein I. (2014). Anatomical abnormalities in autism? Cereb. Cortex 2014:bhu242. 10.1093/cercor/bhu242. [Epub ahead of print]. [DOI] [PubMed] [Google Scholar]
- Humphrey T. (1967). The development of the human hippocampal fissure. J. Anat. 101, 655–676. [PMC free article] [PubMed] [Google Scholar]
- Jenkinson M., Bannister P., Brady M., Smith S. (2002). Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17, 825–841. 10.1006/nimg.2002.1132 [DOI] [PubMed] [Google Scholar]
- Jenkinson M., Smith S. (2001). A global optimisation method for robust affine registration of brain images. Med. Image Anal. 5, 143–156. 10.1016/S1361-8415(01)00036-6 [DOI] [PubMed] [Google Scholar]
- Kier E L., Kim J. H., Fulbright R. K., Bronen R. A. (1997). Embryology of the human fetal hippocampus: MR imaging, anatomy, and histology. Am. J. Neuroradiol. 18, 525–532. [PMC free article] [PubMed] [Google Scholar]
- Kim H., Chupin M., Colliot O., Bernhardt B. C., Bernasconi N., Bernasconi A. (2012a). Automatic hippocampal segmentation in temporal lobe epilepsy: impact of developmental abnormalities. Neuroimage 59, 3178–3186. 10.1016/j.neuroimage.2011.11.040 [DOI] [PubMed] [Google Scholar]
- Kim H., Mansi T., Bernasconi N., Bernasconi A. (2012b). Surface-based multi-template automated hippocampal segmentation: application to temporal lobe epilepsy. Med. Image Anal. 16, 1445–1455. 10.1016/j.media.2012.04.008 [DOI] [PubMed] [Google Scholar]
- Klein D., Rotarska-Jagiela A., Genc E., Sritharan S., Mohr H., Roux F., et al. (2014). Adolescent brain maturation and cortical folding: evidence for reductions in gyrification. PLoS ONE 9:e84914. 10.1371/journal.pone.0084914 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larroche J. C. (1981). Morphological criteria of central nervous system development in the human foetus. J. Neuroradiol. 8, 93–108. [PubMed] [Google Scholar]
- Lefebvre A., Beggiato A., Bourgeron T., Toro R. (2015). Neuroanatomical diversity of Corpus callosum and brain volume in autism: meta-analysis, analysis of the autism brain imaging data exchange project, and simulation. Biol. Psychiatry 78, 126–134. 10.1016/j.biopsych.2015.02.010 [DOI] [PubMed] [Google Scholar]
- Lehéricy S., Dormont D., Sémah F., Clémenceau S., Granat O., Marsault C., et al. (1995). Developmental abnormalities of the medial temporal lobe in patients with temporal lobe epilepsy. AJNR Am. J. Neuroradiol. 16, 617–626. [PMC free article] [PubMed] [Google Scholar]
- Lucarelli R. T., Peshock R. M., McColl R., Hulsey K., Ayers C., Whittemore A. R., et al. (2013). MR imaging of hippocampal asymmetry at 3T in a multiethnic, population-based sample: results from the Dallas Heart Study. AJNR Am. J. Neuroradiol. 34, 752–757. 10.3174/ajnr.A3308 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maguire E. A. (2001). Neuroimaging, memory and the human hippocampus. Rev. Neurol. (Paris) 157, 791–794. 10.1016/S0896-6273(02)00830-9 [DOI] [PubMed] [Google Scholar]
- Moskal J. R., Kroes R. A., Otto N. J., Rahimi O., Claiborne B. J. (2006). Distinct patterns of gene expression in the left and right hippocampal formation of developing rats. Hippocampus 16, 629–634. 10.1002/hipo.20198 [DOI] [PubMed] [Google Scholar]
- Nishikuni K., Ribas G. C. (2012). Study of fetal and postnatal morphological development of the brain sulci. J. Neurosurg. Pediatr. 11, 1–11. 10.3171/2012.9.PEDS12122 [DOI] [PubMed] [Google Scholar]
- Pedraza O., Bowers D., Gilmore R. (2004). Asymmetry of the hippocampus and amygdala in MRI volumetric measurements of normal adults. J. Int. Neuropsychol. Soc. 10, 664–678. 10.1017/s1355617704105080 [DOI] [PubMed] [Google Scholar]
- Peltier B., Hurtevent P., Trehan G., Derambure P., Pruvo J.-P., Soto-Ares G. (2005). IRM des malformations de l'hippocampe dans l'épilepsie temporale réfractaire. Neuroradiologie 86, 69–75. 10.1016/s0221-0363(05)81324-1 [DOI] [PubMed] [Google Scholar]
- Raininko R., Bajic D. (2010). Hippocampal malrotation: no real malrotation and not rare. Am. J. Neuroradiol. 31:E39. 10.3174/ajnr.A2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Righini A., Zirpoli S., Parazzini C., Bianchini E., Scifo P., Sala C., et al. (2006). Hippocampal infolding angle changes during brain development assessed by prenatal MR imaging. Am. J. Neuroradiol. 27, 2093–2097. [PMC free article] [PubMed] [Google Scholar]
- Schumann G., Loth E., Banaschewski T., Barbot A., Barker G., Büchel C., et al. (2010). The IMAGEN study: reinforcement-related behaviour in normal brain function and psychopathology. Mol. Psychiatry 15, 1128–1139. 10.1038/mp.2010.4 [DOI] [PubMed] [Google Scholar]
- Stiers P., Fonteyne A., Wouters H., D'Agostino E., Sunaert S., Lagae L. (2010). Hippocampal malrotation in pediatric patients with epilepsy associated with complex prefrontal dysfunction. Epilepsia 51, 546–555. 10.1111/j.1528-1167.2009.02419.x [DOI] [PubMed] [Google Scholar]
- Sun T., Patoine C., Abu-Khalil A., Visvader J., Sum E., Cherry T., et al. (2005). Early asymmetry of gene transcription in embryonic human left and right cerebral cortex. Science 308, 1794–1798. 10.1126/science.1110324 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Viera A. J., Garrett J. M. (2005). Understanding interobserver agreement: the Kappa statistic. Fam. Med. 37, 360–363. [PubMed] [Google Scholar]