Abstract
The hub-and-spoke model of semantic cognition seeks to reconcile embodied views of a fully distributed semantic network with patient evidence, primarily from semantic dementia, who demonstrate modality-independent conceptual deficits associated with atrophy centred on the ventrolateral anterior temporal lobe. The proponents of this model have recently suggested that the temporal cortex is a graded representational space where concepts become less linked to a specific modality as they are processed farther away from primary and secondary sensory cortices and towards the ventral anterior temporal lobe.
To explore whether there is evidence that the connectivity patterns of the temporal lobe converge in its ventral anterior end the current study uses three dimensional Laplacian eigenmapping, a technique that allows visualisation of similarity in a low dimensional space. In this space similarity is encoded in terms of distances between data points.
We found that the ventral and anterior temporal lobe is in a unique position of being at the centre of mass of the data points within the connective similarity space. This can be interpreted as the area where the connectivity profiles of all other temporal cortex voxels converge.
This study is the first to explicitly investigate the pattern of connectivity and thus provides the missing link in the evidence that the ventral anterior temporal lobe can be considered a multi-modal graded hub.
Keywords: Semantics, Connectivity, Anterior temporal lobe, Spectral reordering, Laplacian eigenmapping
1. Introduction
Semantic memory is often described as ‘knowing what you know’. It is usually contrasted with episodic memory which can be thought of ‘knowing when you know’. For example, knowing that you ate a delicious croissant for breakfast yesterday is an example of episodic memory (when). In contrast, knowing that a croissant is a delicious French pastry rather than a venomous bog dwelling amphibian, is an example of semantic memory (what). The temporal lobe has been implicated in both of these cognitive processes, with episodic and semantic memory associated with different anatomical sub-regions. The medial temporal lobe and hippocampus have famously been associated with episodic memory (Scoville & Milner, 1957). There are two prominent brain-based models of the semantic system. The first ‘distributed-only’ model posits that semantics emerges as a feature of a widely distributed network of primary cortices and their association areas (Martin, 2007). Within this model, modality-specific information types (e.g., visual, auditory) are stored within their respective primary cortical regions (spokes), with interconnections between them producing a full semantic description of a concept. The second, ‘hub-and-spoke’ model extends this idea to propose the existence of a central cortical hub which receives and integrates this distributed modality-specific information from the spokes to derive transmodal, generalizable concepts (Lambon Ralph, 2014, Lambon Ralph et al., 2017, Patterson et al., 2007, Rogers et al., 2004).
Parts of the ventrolateral anterior temporal lobe have been shown to be crucial for the processing of semantic information (Lambon Ralph et al., 2017). Evidence for the importance of the ATL in general initially arose from semantic dementia, a neurodegenerative condition characterised by the progressive loss of conceptual information, with the centre of neural degeneration and hypometabolism occurring primarily around the anterior temporal lobes (ATL) in both hemispheres (Galton et al., 2001, Mion et al., 2010, Mummery et al., 2000, Nestor et al., 2006). The condition gave rise to a body of research that implicated the ATLs as an area critical to the processing of conceptual knowledge (Bozeat et al., 2000, Ding et al., 2016, Hodges et al., 1992). With the advent of advanced neuroimaging and neurostimulation methods, such as functional magnetic resonance imaging (fMRI), transcranial magnetic stimulation (TMS) and sub-dural electrode studies, a converging body of evidence has implicated the bilateral ventral ATLs as the key regions involved in multi-modal conceptual integration (Abel et al., 2015, Binney et al., 2010, Chen et al., 2017, Noonan et al., 2013, Pobric et al., 2007, Rice et al., 2015, Rice et al., 2015, Shimotake et al., 2015, Visser et al., 2010). Indeed, the original implementation of the hub-and-spoke model considered the bilateral ATLs as the core region where convergence and integration of modality-specific information took place (Rogers et al., 2004). However, recent accounts of this model have suggested that semantic specialisation is likely to be graded where, at one extreme, a region will process modality-specific semantics (e.g., visual, auditory etc.), with this information gradually converging onto ATL regions that activate independent of input modality (the fully multi-modal hub area) (Binney et al., 2012, Lambon Ralph et al., 2017, Plaut, 2002, Rice et al., 2015).
While evidence has accumulated for the role of the ventral ATLs in integrative multi-modal semantic processing, the underlying network of white matter connections via which this integration takes place has been less explored. It would seem likely that such an integrative system would require a neural architecture that connects primary and secondary sensory regions to the tertiary ‘hub’, either directly, with integration occurring only at the endpoint within the hub, or more gradually, with a graded convergence of connectivity and information. Evidence for this former system was found in a probabilistic tractography study conducted by (Binney et al., 2012). This study found that long range connectivity from primary sensory areas showed a pattern of gradual convergence within the ATLs, and that an area within the ventral ATL region exhibited a high degree of intralobar connectivity. The study, however, focused on the white matter connectivity of specific regions of interest and a map documenting the gradations in connectivity across the temporal cortex was not within the scope of that work. As such, the question regarding the pattern and extent of convergent connectivity within temporal lobe is still currently unclear. Furthermore, it is unclear as to whether or how the connectivity of the ATL is distinct, suggesting a specialised role, or in fact similar to other regions of the lobe, such as the medial temporal lobe and other parts of the lateral cortex.
A technique which has emerged in the neuroscience literature, aimed at probing the underlying shifts in cortical connectivity, is Laplacian eigenmapping or spectral embedding (Belkin and Niyogi, 2002, Belkin and Niyogi, 2003). This technique has its roots in graph theory (Barnard et al., 1993, Barnard Stephen et al., 1995, Fiedler, 1973) and has had a long history in the machine learning literature (Ng et al., 2002, Shi and Malik, 1997, Shi and Malik, 2000, Von Luxburg, 2007). In neuroscience, the technique has successfully been used to cluster neural regions (Craddock et al., 2012, Eickhoff et al., 2015, Johansen-Berg et al., 2004), as well as, more recently, to extract the primary gradients of structural and functional connectivity across several cortical regions, such as the insula, the motor cortex and temporal lobe (Cerliani et al., 2012, Haak et al., 2016, p. 1602; Jackson, Bajada, Rice, Cloutman, & Lambon Ralph, 2017) and of the cerebellum (Guell, Schmahmann, Gabrieli, & Ghosh, 2018). The technique involves extracting a region of interest and computing similarities between the connectivity profiles of each voxel in the region. These similarities are then reduced to a lower dimensional space whereby each point represents a cortical voxel, and its closeness to other points in space represents its similarity in connectivity. Consequently, a map can be generated which delineates the patterns of connective similarity across regions, and the gradual and graded transitions in connective patterns (Margulies et al., 2016).
In the current work, this data driven approach was used to map the patterns of connective architecture across the temporal lobe. An organisational structure was revealed which is consistent with a pattern of convergence from primary sensory areas to the ventral ATL. The maps obtained are strikingly similar to the graded convergence of structure and function toward the ventral ATL proposed by (Binney et al., 2012) and (Rice, Hoffman, et al., 2015). The results provide evidence that the ventral ATL is a graded hub in the centre of the connectivity space.
2. Methods
2.1. Participants
Twenty-four healthy participants (11 females) were recruited, they explicitly had no history of neurological or psychological disorders. The mean age was 25.9 years with a range between 19 and 47 years. Handedness was measured on the Edinburgh Handedness Inventory (Oldfield, 1971) and only right handed participants were included in the study. All participants gave their informed consent and the research was approved by the local ethics committee (The University of Manchester). This study uses the same population sample and pre-processing steps as a previously published study (Bajada et al., 2017). We opted to use local data as opposed to switching to the publicly available, high quality Human Connectome Project data in order to provide continuity and results that are comparable to our previous work. We present a short summary of the pipeline below where we report all measures and manipulations.
Sample size was determined by the total amount of participants with DWI available in the local database. The exclusion criteria (no history of neurological or psychological disorders) were established prior to data collection. No data was excluded from the available cohort.
2.2. Image acquisition and pre-processing
All images were acquired on a 3 T Philips Achieva scanner (Philips Healthcare, Best, The Netherlands) using an 8 element SENSE head coil. Pulsed gradient spin echo echo-planar sequence diffusion-weighted images (DWI) were acquired with TE = 59 ms, TR ≈ 11,884 ms [cardiac gated was performed either by using a peripheral pulse monitor on each participant's index finger (n = 21), or by using electrocardiography (n = 3)], Gmax = 62 mT/m, half scan factor = .679, 112 × 112 image matrix reconstructed to 128 × 128 using zero padding, reconstructed in-plane voxel resolution 1.875 × 1.875 mm2, slice thickness 2.1 mm, 60 contiguous slices, 61 non-collinear diffusion sensitization directions at b = 1200 sec/mm2 (Δ = 29.8 ms, δ = 13.1 ms), 1 at b = 0 sec/mm2, SENSE acceleration factor = 2.5. Correction for susceptibility-related image distortions was performed using the approach outlined in (Embleton, Haroon, Morris, Ralph, & Parker, 2010), which involved the acquisition of two volumes with inversed phase encode directions (left-right) for each diffusion gradient direction. A T2-weighted turbo spin echo scan (in-plane voxel resolution of .94 × .94 mm2, slice thickness 2.1 mm) was obtained for a qualitative indication of distortion correction accuracy. Finally, a high resolution T1-weighted image was acquired for each participant using a 3D Turbo Field Echo inversion recovery scan (TR ≈ 2000 ms, TE = 3.9 ms, TI = 1150 ms, flip angle 8°, 256 × 205 image matrix reconstructed to 256 × 256, reconstructed in-plane voxel resolution .938 mm × .938 mm, slice thickness .9 mm, 160 slices, SENSE factor = 2.5).
The T1w image was co-registered to the diffusion images for visualisation and mask generation. A white matter mask (for tractography seed mask generation) and a cerebrospinal fluid mask (for a termination mask) were also generated from the co-registered T1w image using FSL's FAST algorithm.
2.3. Tractography
Tractography was performed using the probabilistic index of connectivity (PICo) algorithm (Parker and Alexander, 2005, Parker et al., 2003). The algorithm samples voxel-wise diffusion probability distribution functions (PDFs), generated via the constrained spherical deconvolution (Tournier, Calamante, & Connelly, 2007) and model-based residual bootstrapping method (Haroon et al., 2009, Haroon et al., 2009, Jeurissen et al., 2011).
To generate the temporal lobe region of interest (ROI) for tracking, a temporal mask was first defined in MNI space for both hemispheres using the MNI structural atlas within the FSL software package (Mazziotta et al., 2001). The mask was then co-registered to each participant's native diffusion space. To ensure that only voxels within the temporal lobe were included, the masks were manually reviewed in native space, and any voxels outside the temporal region removed. The final temporal ROI for tracking consisted of only those seed voxels at the interface between the grey matter and white matter. To generate this, a white matter mask was used to delineate those voxels at the grey–white interface (GWI), which were then extracted via an in-house MATLAB script (Bajada et al., 2017, The MathWorks, 2012).
For each voxel within a participant's ROI, unconstrained probabilistic tracking was performed by propagating 10,000 streamlines from the GWI to the rest of the brain. The parameters for the tracking included a step size of .5 mm and a curvature threshold of 180° over a voxel. Streamlines were terminated if they exceeded a path length of 500 mm or hit a cerebrospinal fluid (CSF) termination mask. A count of streamlines reaching every brain voxel was recorded, generating a connectivity profile for each temporal ROI seed voxel.
The connectivity profiles for each individual participant were transformed to a common template space using SPM's DARTEL (Ashburner, 2007). A GWI for the template space was also extracted using the script mentioned above. Every individual's connectivity profile was mapped onto a voxel on the group GWI template that was the nearest neighbour of that profiles seed voxel. This provided a correspondence of seed voxels and connectivity profiles across participants. The participants' connectivity profiles were then thresholded at .05% of the maximum value to remove very low level noise, and subsequently binarized (Devlin et al., 2006). The resulting images were down-sampled to half their size per dimension in order to reduce memory consumption, and the resulting profiles were averaged across participants to generate a group connectivity profile for each seed voxel.
2.4. Spectral embedding, laplacian eigenmapping and their visualisation
The group connectivity profile for each seed voxel consisted of a map of every cortical voxel within the whole brain connected with that seed. To examine the similarity between the connectivity profiles of the temporal seed voxels, the connectivity profiles were first transformed into a 1 × m row vector, where the columns (m) represented every point in the brain. A pairwise similarity of every seed voxel's connectivity profile was computed by calculating the cosine of the angle between each connectivity profile vector.
This generated an n x n symmetric similarity matrix where n = number of seed voxels in the temporal lobe's group GWI template. The similarity matrix was treated as a weighted graph adjacency matrix (A). The Laplacian of the adjacency matrix was computed by subtracting the adjacency matrix from the degree matrix (D):
(1) |
The eigenvectors associated with the three smallest nonzero generalised eigenvalues of L and D were computed by solving the generalised eigenvalue problem:
(2) |
where L is the Laplacian, D is the degree matrix, X is the matrix of generalised eigenvectors and Λ is a diagonal matrix of generalised eigenvalues. This was done in accordance with the (Shi & Malik, 2000) algorithm (see also (Von Luxburg, 2007) for a tutorial explanation).
The smallest eigenvalue of the Laplacian is always zero. If the zero eigenvalue has a multiplicity of greater than one, this means that the graph has more than one connected component. Clear clusters are denoted by small initial eigenvalues (very close to zero) followed by a large gap in the spectrum of eigenvalues between the initial eigenvalues and the rest of the eigenvalues.
The eigenvectors associated with the three smallest non-zero eigenvalues (the embedding eigenvectors) were plotted in a three-dimensional similarity space. This warps each temporal seed voxel into a three-dimensional space where every voxel is positioned according to their connective similarity to each other (see supplementary animation). Only three dimensions were selected for the following reasons. The largest gap within the eigenvalue spectrum is between the first and the second, this implies that the greatest dissimilarity lies within the first eigenvector (eigenmap) due to this, adding more than three eigenvectors would only add nuanced information to the visualisation. Estimation of dimension number is a difficult and often heuristic procedure. While this study opted for a heuristic approach, statistical approaches are being developed and may become standard as these techniques develop (Karolis, Corbetta, & Thiebaut de Schotten, 2018).
In order to produce a graded mapping from the similarity space to brain space, each voxel's coordinates in the similarity space were rescaled between 0 and 1 and used as an assigned to red, green and blue colour channels represented by the matrix RGB:
(3) |
where the three columns of the matrix X contain the embedding eigenvectors so that each row of X contains the coordinates of (or corresponding to) each seed voxel in the 3-dimensional similarity space; and denote respectively the minimum and maximum value in the matrix X and matrix 1 is a matrix of ones of the same size as . The RGB colouring acts as a visualisation tool to aid the mapping of each voxel from one space (similarity space) to another (anatomic space) to allow a voxel to move in space but retain knowledge of how a voxel maps from one space to the other (see supplementary material for an animation of the mapping between similarity and anatomic spaces). The raw eigenvectors are susceptible to outlier voxels and these heavily restrict the RGB space that can be used. As such, the ‘raw’ eigenvectors were also modified by employing the rank order of the three smallest non-zero eigenvectors and represented in RGB as above to enhance the visualisation of the gradients (transition between ‘raw’ and ‘ranked’ RGB can be visualised in the supplementary material).
The distances between the data points in the ‘raw’ connectivity space are proportional to the similarity between the connectivity of the voxels. Hence, points that are close together in the similarity space have similar connectivity profiles. In order to highlight regions of the cortex that are maximally similar to all other areas, the centre of mass of the data in the similarity space was calculated. The Euclidean distance between all coordinates in the similarity space and the centre of mass was computed and the values that were within the closest 10th percentile were retained and projected back on both the connectivity space and on the cortex (see Fig. 2, Fig. 3A).
2.5. Data and code sharing
The ethics application for this study was such that did not cater for the public archiving of MRI data. Hence, participants did not provide sufficient informed consent for such public archiving. However, researchers who would like to access the raw data should contact the corresponding author who will liase with the ethics committee that approved the study. Where compatible with the General Data Protection Regulation (GDPR) and in line with ethics decisions made by the committee, as much data that is necessary to reproduce the results will be released to the individual researcher.
Code used for this project, with some modifications for readability and removal of any system links, has been made available for review on the Open Science Framework (OSF). Furthermore, pre-processed data along with accompanying code has been provided to replicate the results found in this paper (https://osf.io/gsve9/). No part of the study procedures or analyses was pre-registered in a time-stamped, institutional registry prior to the research being conducted.
Parts of the methods (specifically the PICo tractography code) are covered by patents held by Bioxydyn and therefore source code has not been released and any commercial use is forbidden unless express permission is given by the company. The code used to perform the CSD contains commercially sensitive information belonging to Dr Hamied Haroon which cannot be publicly released.
3. Results
The generalised eigendecomposition of the Laplacian of the similarity matrix produced only one zero eigenvalue in both hemispheres, hence the similarity ‘graphs’ were fully connected. The second (the algebraic connectivity), third and fourth eigenvalues were .63, .77 and .88 respectively on the left and .64, .80 and .88 respectively on the right. The largest eigenvalue was 1 bilaterally. This suggests that the structural connectivity of the temporal lobe does not separate into clearly defined clusters but that there are graded differences in connectivity. The connectivity showed qualitatively similar patterns in both hemispheres.
The rows of the first three non-zero eigenvectors were taken to be coordinates of points in a three dimensional ‘connective similarity’ space (ℝ3) and their equivalent feature scaled values taken to be coordinate values on the RGB colour space (as described above). Fig. 1 shows the results of the analysis plotted on the brain and in the connective similarity space. The voxels within the similarity space are plotted according to how similar the temporal seed voxels' connectivity profiles were to each other, with voxels demonstrating greater similarity positioned closer together. One can consider the temporal lobe being warped from a space where voxels are plotted according to their ‘anatomic’ similarity to a space where they are plotted according to their ‘connective’ similarity and vice-versa. An animation depicting the morphing between the anatomic space to the similarity space can be found in the supplementary materials.
As can be seen from Fig. 1, the hippocampus (coloured white to yellow) is the most distinctly connected region within the temporal lobe, while the lateral areas demonstrate a graded transition of connectivity. Indeed, while the hippocampus forms the distant white ‘tail’ in the similarity space, the lateral temporal lobe forms the quasi-triangular green, red and purple ‘head’. While the more primary visual and auditory cortices lie on the edges of the triangular head (red-purple), the anterior temporal lobe map to the centre of the space, indicating that it has gradedly similar connectivity with all of the primary temporal areas. Since the colours of the centre of the space are hard to visually distinguish, voxels within the 10th percentile of Euclidian distance from the centre of mass were identified (see red region in Fig. 2). This identified a ventral anterior temporal region along the more lateral surface. These correspond to the temporal seed voxels with the least ‘distinct’ connectivity profiles, demonstrating a connectivity profile similar to other temporal regions, and representing an area of ‘convergent’ similarity.
4. Discussion
The current study used a data driven approach to examine the connective organisation of the temporal lobe, particularly in relation to variations across the lateral surface involving the ventral ATL. The first main finding is that there is a clear distinction between the patterns of connectivity between medial temporal regions (specifically the hippocampal region), and the lateral regions. While the medial temporal lobe demonstrated a very distinctive connectivity profile compared to the rest of the temporal cortex, the lateral temporal lobe was associated with more graded similarity and transitions between regions. This is not surprising given the functional and cytoarchitectonic differences (allocortex vs. neocortex) of the medial temporal lobe (Posimo, Titler, Choi, Unnithan, & Leak, 2013). Indeed, Nestor et al. (2006) describe dissociations between the impairments in semantic dementia (semantic impairment without amnesia following ventrolateral centred atrophy) versus early Alzheimer's disease (amnesia without semantic impairment following ventromedial pathology). These findings align with the major connectivity distinction found within this study. As such follow-up work using similar methods using patient groups would be welcome.
The second key finding of the current study was that along the graded lateral region, a zone of convergence of connectivity could be delineated, specifically involving the ventral ATL. The connectivity patterns within this zone of convergence demonstrated similarity with both the primary and secondary visual and auditory cortices, highlighting a region where these different modalities of information may become integrated. Finally, we note that there were little qualitative interhemispheric differences in connectivity. This seemingly contradicts previous work that has observed interhemispheric differences in strength of the temporal lobe's connectivity to other structures (Papinutto et al., 2016). These facts do not necessarily conflict due to the nature of the different approaches. First, the current work does not focus on connectivity strength but on the similarity between the structural connectivity patterns of temporal lobe voxels to the rest of the brain; hence while connectivity strength may change, the spatial pattern of the network may remain the same. Second, while there aren't great differences between the two hemispheres in our study there are some minor difference in the connectivity space in both hemispheres
Rogers et al. (Rogers et al., 2004) and Patterson et al. (Patterson et al., 2007) were the first to suggest that the ATL acts as a multi-modal hub involved in integrating modality-specific semantic information from their respective distributed cortical regions (or ‘spoke’ nodes). The hub-and-spoke model enables modality-specific nodes within the network to ‘communicate’ with one another via the hub node. As such, the hub acts as an integrator of the different features of an object that are processed at the spokes and allows hub-and-spokes to compute the variable and arbitrary mappings of features into coherent generalizable concepts (cf. Lambon Ralph, Sage, Jones, & Mayberry, 2010). This is in contrast with a ‘distributed-only’ model of semantics where integration occurs as an emergent property across the whole network (Martin, 2007); or with a putative ‘hub-only’ idea of semantics where, in a neo-phrenological fashion, the ATL is ‘the region’ for semantic cognition (Lambon Ralph, 2014). Indeed, there is an ever increasing body of evidence supporting the conception that the ATL plays a crucial role in multi-modal semantics, including neurological conditions such as semantic dementia (Hodges et al., 1992), patients who have undergone ATL resection for medically intractable epilepsy (Lambon Ralph et al., 2012, Rice et al., 2018), sub-dural cortical electrode investigations (Shimotake et al., 2015), fMRI in healthy participants (Jackson et al., 2016, Jefferies, 2013) and transient ‘lesioning’ methods such as transcranial magnetic stimulation (Lambon Ralph et al., 2009, Pobric et al., 2007).
In response to the growing body of research on semantic cognition, the hub-and-spoke model has become more nuanced. The single hub has been adapted into a graded hub along the ventral anterior temporal lobe (Binney et al., 2012, Rice et al., 2015, Visser et al., 2010). Within this framework, as information travels from the primary cortices, through association cortices and towards the ATL, the concepts become less modality specific in a graded fashion (see Fig. 3) (Binney et al., 2012, Lambon Ralph, 2014, Rice et al., 2015). The idea of a graded convergence of representations was first proposed by (Plaut, 2002) in his computational model of semantics (see Fig. 3A). This model was developed to reconcile theories that proposed the existence of extreme ends of functional specialisation within the semantic system (Lambon Ralph et al., 2017).
Previous studies examining the structural connectivity of the temporal region have also suggested an underlying convergence and gradation of multi-modal information within the temporal lobe in support of the (Plaut, 2002) model, although not formally investigated [(Binney et al., 2012) Fig. 3B]. The current data driven examination of the connectivity gradients within the temporal cortex provide further support for this graded convergence model of semantics (Fig. 3C).
The current results identified the ventral portion of the ATL as the zone with the highest connective convergence making it, together with evidence from patient data (Hoffman, Evans, & Lambon Ralph, 2014), a prime candidate brain region for the most multi-modal computations. Indeed, when one highlights the zone of convergence (red region in Fig. 2) and compares it to previous work (Binder et al., 2009, Visser et al., 2012), the zone overlaps with the anterior portion of the temporal semantic network. Furthermore, this area has been shown to activate in response to more than one modality (Fig. 3B), reflecting the finding of (Visser et al., 2012) that both the middle temporal gyrus and the ventral anterior temporal lobe are crucial for multi-modal semantics. As such, the current evidence aligns with recent conceptualisations of the hub-and-spoke model which posit that multi-modal integration does not occur in an all-or-none fashion solely within the putative ‘hub’ region, but involves the gradual convergence of modality-specific information along the course of the semantic network to become completely multi-modal (or indeed, amodal) within the ventral ATL hub (Lambon Ralph et al., 2017).
The current study employed a data-driven approach to examine the convergence of connectivity within the temporal lobe, utilising white matter tractography and Laplacian eigenmapping. These methods have several key strengths, as well as important limitations which need to be taken into consideration in interpreting the current results.
Tractography infers the structure and course of white matter connectivity indirectly via the diffusion of water within the brain. As such, it is subject to the generation of a degree of ‘false-positive’ and ‘false-negative’ fibres. These connective inaccuracies are principally a problem if one is particularly interested in the precise delineation of corticocortical connectivity. However, the current study was not focused on the delineation of such connections, but rather on the patterns of connective similarity and difference across cortical voxels, which is more robust to small inaccuracies in the connective data (Johansen-Berg et al., 2004). As such, while false negative and positive streamlines may affect the absolute precision of our similarity metrics, the overall impact of these inaccuracies is reduced in comparison to traditional white matter tractography mapping.
Eigenmapping, in the context used for this investigation, is a technique that allows the spectral transformation of voxels in a ‘connectivity’ space to be mapped onto anatomy. The three primary advantages accorded by this approach are first, the ability to visualise the closeness of voxels in the connective similarity space. One can examine this space and visually identify whether hard clustering of the data makes sense. Indeed, the spectral transformation represents the initial data transformation that is used prior to the clustering portion of spectral clustering algorithms (Von Luxburg, 2007). In the case of these data, one can clearly see that hard clustering the connectivity space may create a false sense of ‘distinctness’ of brain areas within the temporal lobe rather than the gradations what are currently clear.
Secondly, the current approach does not cluster voxels into distinct groups, instead focusing on the pattern of change in voxels connectivity profiles. Indeed, avoiding clustering also allows the investigation of the area that is maximally similar to all other areas; a location that by its very nature would not cluster well.
Finally, in contrast to spectral reordering, or an eigenmapping based only on the first non-zero eigenvector, our approach uses the RGB space in order to increase the dimensionality of the visualisation in order to gain added information to those approaches that only use a single dimension (Johansen-Berg et al., 2004, Margulies et al., 2016).
In summary, previous research has indicated that the ventral ATL is an essential area in processing multi-modal semantic information. It is thought to be a graded hub that integrates modality specific information from its spokes (Patterson et al., 2007, Rice et al., 2015). It has also been shown that the ventral ATL receives long range connections from distant primary sensory regions and there is also a zone that has particularly strong local connectivity (Binney et al., 2012). This work has shown that the connectivity profiles within the temporal cortex do indeed converge onto the ventral ATL and consistent with the proposition that the ventral ATL is a zone of convergence in the brain; a graded semantic hub.
Author contributions
CJB, LLC and MALR conceived the study. CJB and NJTB ran the analysis. GJMP and NJTB advised on technical matters. All authors were involved in reviewing the manuscript.
Competing interests
GJMP is a shareholder and director of Bioxydyn, a company with an interest in imaging services and products.
Acknowledgements
This research was supported by an MRC programme grant to MALR (MR/J004146/1), an EPSRC Research Grant EP/M005909/1 to GJMP, an EPSRC Fellowship EP/N006771/1 to NJTB and a BBSRC DTP studentship to CJB (BB/J014478/1).
Action editor Stefano Cappa
Reviewed Mar 4, 2019
Footnotes
Supplementary data to this article can be found online at https://doi.org/10.1016/j.cortex.2019.06.014.
Contributor Information
Claude J. Bajada, Email: claude.bajada@um.edu.mt.
Matthew A. Lambon Ralph, Email: matt.lambon-ralph@mrc-cbu.cam.ac.uk.
Appendix A. Supplementary data
The following is the Supplementary data to this article:
References
- Abel T.J., Rhone A.E., Nourski K.V., Kawasaki H., Oya H., Griffiths T.D. Direct physiologic evidence of a heteromodal convergence region for proper naming in human left anterior temporal lobe. The Journal of Neuroscience. 2015;35(4):1513–1520. doi: 10.1523/JNEUROSCI.3387-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ashburner J. A fast diffeomorphic image registration algorithm. Neuroimage. 2007;38(1):95–113. doi: 10.1016/j.neuroimage.2007.07.007. [DOI] [PubMed] [Google Scholar]
- Bajada C.J., Jackson R.L., Haroon H.A., Azadbakht H., Parker G.J.M., Lambon Ralph M.A. A graded tractographic parcellation of the temporal lobe. Neuroimage. 2017 doi: 10.1016/j.neuroimage.2017.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barnard Stephen T., Pothen A., Simon H. A spectral algorithm for envelope reduction of sparse matrices. Numerical Linear Algebra with Applications. 1995;2(4):317–334. [Google Scholar]
- Barnard S.T., Pothen A., Simon H.D. A spectral algorithm for envelope reduction of sparse matrices. Supercomputing. 1993;93:493–502. Proceedings. [Google Scholar]
- Belkin M., Niyogi P. Laplacian eigenmaps and spectral techniques for embedding and clustering. Advances in Neural Information Processing Systems. 2002;1 and 2(14):585–591. 14. [Google Scholar]
- Belkin M., Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation. 2003;15(6):1373–1396. [Google Scholar]
- Binder J.R., Desai R.H., Graves W.W., Conant L.L. Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex. 2009;19(12):2767–2796. doi: 10.1093/cercor/bhp055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Binney R.J., Embleton K.V., Jefferies E., Parker G.J.M., Ralph M.A.L. The ventral and inferolateral aspects of the anterior temporal lobe are crucial in semantic memory: Evidence from a novel direct comparison of distortion-corrected fMRI, rTMS, and semantic dementia. Cerebral Cortex. 2010;20(11):2728–2738. doi: 10.1093/cercor/bhq019. [DOI] [PubMed] [Google Scholar]
- Binney R.J., Parker G.J.M., Lambon Ralph M.A. Convergent connectivity and graded specialization in the rostral human temporal lobe as revealed by diffusion-weighted imaging probabilistic tractography. Journal of Cognitive Neuroscience. 2012;24(10):1998–2014. doi: 10.1162/jocn_a_00263. [DOI] [PubMed] [Google Scholar]
- Bozeat S., Lambon Ralph M.A., Patterson K., Garrard P., Hodges J.R. Non-verbal semantic impairment in semantic dementia. Neuropsychologia. 2000;38(9):1207–1215. doi: 10.1016/s0028-3932(00)00034-8. [DOI] [PubMed] [Google Scholar]
- Cerliani L., Thomas R.M., Jbabdi S., Siero J.C.W., Nanetti L., Crippa A. Probabilistic tractography recovers a rostrocaudal trajectory of connectivity variability in the human insular cortex. Human Brain Mapping. 2012;33(9):2005–2034. doi: 10.1002/hbm.21338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chen L., Lambon Ralph M.A., Rogers T.T. A unified model of human semantic knowledge and its disorders. Nature Human Behaviour. 2017;1(3):0039. doi: 10.1038/s41562-016-0039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Craddock R.C., James G.A., Holtzheimer P.E., Hu X.P., Mayberg H.S. A whole brain fMRI atlas generated via spatially constrained spectral clustering. Human Brain Mapping. 2012;33(8):1914–1928. doi: 10.1002/hbm.21333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Devlin J.T., Sillery E.L., Hall D.A., Hobden P., Behrens T.E.J., Nunes R.G. Reliable identification of the auditory thalamus using multi-modal structural analyses. Neuroimage. 2006;30(4):1112–1120. doi: 10.1016/j.neuroimage.2005.11.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ding J., Chen K., Chen Y., Fang Y., Yang Q., Lv Y. The left fusiform gyrus is a critical region contributing to the core behavioral profile of semantic dementia. Frontiers in Human Neuroscience. 2016;10:215. doi: 10.3389/fnhum.2016.00215. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eickhoff S.B., Thirion B., Varoquaux G., Bzdok D. Connectivity-based parcellation: Critique and implications. Human Brain Mapping. 2015;36(12):4771–4792. doi: 10.1002/hbm.22933. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Embleton K.V., Haroon H.A., Morris D.M., Ralph M.A.L., Parker G.J.M. Distortion correction for diffusion-weighted MRI tractography and fMRI in the temporal lobes. Human Brain Mapping. 2010;31(10):1570–1587. doi: 10.1002/hbm.20959. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fiedler M. Algebraic connectivity of graphs. Czechoslovak Mathematical Journal. 1973;23(2):298–305. [Google Scholar]
- Galton C.J., Patterson K., Graham K., Lambon-Ralph M.A., Williams G., Antoun N. Differing patterns of temporal atrophy in Alzheimer's disease and semantic dementia. Neurology. 2001;57(2):216–225. doi: 10.1212/wnl.57.2.216. [DOI] [PubMed] [Google Scholar]
- Guell X., Schmahmann J.D., Gabrieli J.D., Ghosh S.S. Functional gradients of the cerebellum. eLife. 2018;7 doi: 10.7554/eLife.36652. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haak K.V., Marquand A.F., Beckmann C.F. 2016. Connectopic mapping with resting-state fMRI. [DOI] [PubMed] [Google Scholar]
- Haroon H.A., Morris D.M., Embleton K.V., Alexander D.C., Parker G.J.M. Using the model-based residual bootstrap to quantify uncertainty in fiber orientations from Q-ball analysis. IEEE Transactions on Medical Imaging. 2009;28(4):535–550. doi: 10.1109/TMI.2008.2006528. [DOI] [PubMed] [Google Scholar]
- Haroon H.A., Morris D.M., Embleton K.V., Parker G.J. Presented at the proceedings of the 17th scientific meeting and exhibition of the international society for magnetic resonance in medicine. 2009. Model based residual bootstrap of constrained spherical deconvolution for probabilistic segmentation and tractography; p. 363. [Google Scholar]
- Hodges J.R., Patterson K., Oxbury S., Funnell E. Semantic dementia. Brain. 1992;115(6):1783–1806. doi: 10.1093/brain/115.6.1783. [DOI] [PubMed] [Google Scholar]
- Hoffman P., Evans G.A.L., Lambon Ralph M.A. The anterior temporal lobes are critically involved in acquiring new conceptual knowledge: Evidence for impaired feature integration in semantic dementia. Cortex. 2014;50:19–31. doi: 10.1016/j.cortex.2013.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jackson R.L., Bajada C.J., Rice G.E., Cloutman L.L., Lambon Ralph M.A. An emergent functional parcellation of the temporal cortex. Neuroimage. 2017 doi: 10.1016/j.neuroimage.2017.04.024. [DOI] [PubMed] [Google Scholar]
- Jackson R.L., Hoffman P., Pobric G., Lambon Ralph M.A. The semantic network at work and rest: Differential connectivity of anterior temporal lobe subregions. The Journal of Neuroscience. 2016;36(5):1490–1501. doi: 10.1523/JNEUROSCI.2999-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jefferies E. The neural basis of semantic cognition: Converging evidence from neuropsychology, neuroimaging and TMS. Cortex. 2013;49(3):611–625. doi: 10.1016/j.cortex.2012.10.008. [DOI] [PubMed] [Google Scholar]
- Jeurissen B., Leemans A., Jones D.K., Tournier J.-D., Sijbers J. Probabilistic fiber tracking using the residual bootstrap with constrained spherical deconvolution. Human Brain Mapping. 2011;32(3):461–479. doi: 10.1002/hbm.21032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Johansen-Berg H., Behrens T.E.J., Robson M.D., Drobnjak I., Rushworth M.F.S., Brady J.M. Changes in connectivity profiles define functionally distinct regions in human medial frontal cortex. Proceedings of the National Academy of Sciences of the United States of America. 2004;101(36):13335–13340. doi: 10.1073/pnas.0403743101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Karolis V., Corbetta M., Thiebaut de Schotten M. Architecture of functional lateralisation in the human brain. BioRxiv. 2018 doi: 10.1038/s41467-019-09344-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lambon Ralph M.A. Neurocognitive insights on conceptual knowledge and its breakdown. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2014;369(1634):20120392. doi: 10.1098/rstb.2012.0392. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lambon Ralph M.A., Ehsan S., Baker G.A., Rogers T.T. Semantic memory is impaired in patients with unilateral anterior temporal lobe resection for temporal lobe epilepsy. Brain: a Journal of Neurology. 2012;135(Pt 1):242–258. doi: 10.1093/brain/awr325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lambon Ralph M.A., Jefferies E., Patterson K., Rogers T.T. The neural and computational bases of semantic cognition. Nature Reviews. Neuroscience. 2017;18(1):42–55. doi: 10.1038/nrn.2016.150. [DOI] [PubMed] [Google Scholar]
- Lambon Ralph M.A., Pobric G., Jefferies E. Conceptual knowledge is underpinned by the temporal pole bilaterally: Convergent evidence from rTMS. Cerebral Cortex. 2009;19(4):832–838. doi: 10.1093/cercor/bhn131. [DOI] [PubMed] [Google Scholar]
- Lambon Ralph M.A., Sage K., Jones R.W., Mayberry E.J. Coherent concepts are computed in the anterior temporal lobes. Proceedings of the National Academy of Sciences. 2010;107(6):2717–2722. doi: 10.1073/pnas.0907307107. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Margulies D.S., Ghosh S.S., Goulas A., Falkiewicz M., Huntenburg J.M., Langs G. Situating the default-mode network along a principal gradient of macroscale cortical organization. Proceedings of the National Academy of Sciences of the United States of America. 2016;113(44):12574–12579. doi: 10.1073/pnas.1608282113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin A. The representation of object concepts in the brain. Annual Review of Psychology. 2007;58:25–45. doi: 10.1146/annurev.psych.57.102904.190143. [DOI] [PubMed] [Google Scholar]
- Mazziotta J., Toga A., Evans A., Fox P., Lancaster J., Zilles K. A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM) Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2001;356(1412):1293–1322. doi: 10.1098/rstb.2001.0915. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mion M., Patterson K., Acosta-Cabronero J., Pengas G., Izquierdo-Garcia D., Hong Y.T. What the left and right anterior fusiform gyri tell us about semantic memory. Brain: a Journal of Neurology. 2010;133(11):3256–3268. doi: 10.1093/brain/awq272. [DOI] [PubMed] [Google Scholar]
- Mummery C.J., Patterson K., Price C.J., Ashburner J., Frackowiak R.S., Hodges J.R. A voxel-based morphometry study of semantic dementia: Relationship between temporal lobe atrophy and semantic memory. Annals of Neurology. 2000;47(1):36–45. [PubMed] [Google Scholar]
- Nestor P.J., Fryer T.D., Hodges J.R. Declarative memory impairments in Alzheimer's disease and semantic dementia. Neuroimage. 2006;30(3):1010–1020. doi: 10.1016/j.neuroimage.2005.10.008. [DOI] [PubMed] [Google Scholar]
- Ng A.Y., Jordan M.I., Weiss Y. On spectral clustering: Analysis and an algorithm. Advances in Neural Information Processing Systems. 2002;1 and 2(14):849–856. 14. [Google Scholar]
- Noonan K.A., Jefferies E., Visser M., Lambon Ralph M.A. Going beyond inferior prefrontal involvement in semantic control: Evidence for the additional contribution of dorsal angular gyrus and posterior middle temporal cortex. Journal of Cognitive Neuroscience. 2013;25(11):1824–1850. doi: 10.1162/jocn_a_00442. [DOI] [PubMed] [Google Scholar]
- Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia. 1971;9(1):97–113. doi: 10.1016/0028-3932(71)90067-4. [DOI] [PubMed] [Google Scholar]
- Papinutto N., Galantucci S., Mandelli M.L., Gesierich B., Jovicich J., Caverzasi E. Structural connectivity of the human anterior temporal lobe: A diffusion magnetic resonance imaging study. Human Brain Mapping. 2016;37(6):2210–2222. doi: 10.1002/hbm.23167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parker G.J.M., Alexander D.C. Probabilistic anatomical connectivity derived from the microscopic persistent angular structure of cerebral tissue. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 2005;360(1457):893–902. doi: 10.1098/rstb.2005.1639. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Parker G.J.M., Haroon H.A., Wheeler-Kingshott C.A.M. A framework for a streamline-based probabilistic index of connectivity (PICo) using a structural interpretation of MRI diffusion measurements. Journal of Magnetic Resonance Imaging: JMRI. 2003;18(2):242–254. doi: 10.1002/jmri.10350. [DOI] [PubMed] [Google Scholar]
- Patterson K., Nestor P.J., Rogers T.T. Where do you know what you know? The representation of semantic knowledge in the human brain. Nature Reviews. Neuroscience. 2007;8(12):976–987. doi: 10.1038/nrn2277. [DOI] [PubMed] [Google Scholar]
- Plaut D.C. Graded modality-specific specialisation in semantics: A computational account of optic aphasia. Cognitive Neuropsychology. 2002;19(7):603–639. doi: 10.1080/02643290244000112. [DOI] [PubMed] [Google Scholar]
- Pobric G., Jefferies E., Ralph M.A.L. Anterior temporal lobes mediate semantic representation: Mimicking semantic dementia by using rTMS in normal participants. Proceedings of the National Academy of Sciences of the United States of America. 2007;104(50):20137–20141. doi: 10.1073/pnas.0707383104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Posimo J.M., Titler A.M., Choi H.J.H., Unnithan A.S., Leak R.K. Neocortex and allocortex respond differentially to cellular stress in vitro and aging in vivo. Plos One. 2013;8(3) doi: 10.1371/journal.pone.0058596. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rice G.E., Caswell H., Moore P., Hoffman P., Lambon Ralph M.A. The roles of left versus right anterior temporal lobes in semantic memory: A neuropsychological comparison of postsurgical temporal lobe epilepsy patients. Cerebral Cortex. 2018;28(4):1487–1501. doi: 10.1093/cercor/bhx362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rice G.E., Hoffman P., Lambon Ralph M.A. Graded specialization within and between the anterior temporal lobes. Annals of the New York Academy of Sciences. 2015;1359(1):84–97. doi: 10.1111/nyas.12951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rice G.E., Lambon Ralph M.A., Hoffman P. The roles of left versus right anterior temporal lobes in conceptual knowledge: An ALE meta-analysis of 97 functional neuroimaging studies. Cerebral Cortex. 2015;25(11):4374–4391. doi: 10.1093/cercor/bhv024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rogers T.T., Lambon Ralph M.A., Garrard P., Bozeat S., McClelland J.L., Hodges J.R. Structure and deterioration of semantic memory: A neuropsychological and computational investigation. Psychological Review. 2004;111(1):205–235. doi: 10.1037/0033-295X.111.1.205. [DOI] [PubMed] [Google Scholar]
- Scoville W.B., Milner B. Loss of recent memory after bilateral hippocampal lesions. Journal of Neurology, Neurosurgery, and Psychiatry. 1957;20(1):11–21. doi: 10.1136/jnnp.20.1.11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shi J., Malik J. Proceedings of IEEE computer society conference on computer vision and pattern recognition. IEEE Comput. Soc; 1997. Normalized cuts and image segmentation; pp. 731–737. [Google Scholar]
- Shi J., Malik J. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000;22(8):888–905. [Google Scholar]
- Shimotake A., Matsumoto R., Ueno T., Kunieda T., Saito S., Hoffman P. Direct exploration of the role of the ventral anterior temporal lobe in semantic memory: Cortical stimulation and local field potential evidence from subdural grid electrodes. Cerebral Cortex. 2015;25(10):3802–3817. doi: 10.1093/cercor/bhu262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- The MathWorks I. Computer software; Natick, Massachusetts: 2012. MATLAB and statistics toolbox [7.14.0.739 (R2012a)] [Google Scholar]
- Tournier J.-D., Calamante F., Connelly A. Robust determination of the fibre orientation distribution in diffusion MRI: Non-negativity constrained super-resolved spherical deconvolution. Neuroimage. 2007;35(4):1459–1472. doi: 10.1016/j.neuroimage.2007.02.016. [DOI] [PubMed] [Google Scholar]
- Visser M., Jefferies E., Embleton K.V., Lambon Ralph M.A. Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: Distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobes. Journal of Cognitive Neuroscience. 2012;24(8):1766–1778. doi: 10.1162/jocn_a_00244. [DOI] [PubMed] [Google Scholar]
- Visser M., Jefferies E., Lambon Ralph M.A. Semantic processing in the anterior temporal lobes: A meta-analysis of the functional neuroimaging literature. Journal of Cognitive Neuroscience. 2010;22(6):1083–1094. doi: 10.1162/jocn.2009.21309. [DOI] [PubMed] [Google Scholar]
- Von Luxburg U. A tutorial on spectral clustering. Statistics and Computing. 2007;17(4):395–416. [Google Scholar]