Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2022 Feb 1.
Published in final edited form as: Trends Cogn Sci. 2020 Dec 14;25(2):100–110. doi: 10.1016/j.tics.2020.11.006

Evidence for a third visual pathway specialized for social perception

David Pitcher 1,*, Leslie G Ungerleider 2
PMCID: PMC7811363  NIHMSID: NIHMS1658995  PMID: 33334693

Abstract

Existing models propose that primate visual cortex is divided into two functionally distinct pathways. The ventral pathway computes the identity of an object; the dorsal pathway computes the location of an object, and the actions related to that object. Despite remaining influential, the two visual pathways model requires revision. Both human and non-human primate studies reveal the existence of a third visual pathway on the lateral brain surface. This third pathway projects from early visual cortex, via motion-selective areas, into the superior temporal sulcus (STS). Studies demonstrating that the STS computes the actions of moving faces and bodies (e.g., expressions, eye-gaze, audio-visual integration, intention, mood) show that the third visual pathway is specialized for the dynamic aspects of social perception.

Keywords: Superior temporal sulcus (STS), V5/MT, Neuroanatomy, Face perception, Body perception, Social Perception

The two visual pathway model requires revision

Almost forty years ago Ungerleider and Mishkin described a model of primate cortex that proposed two visual pathways [1]. Each pathway was defined anatomically and functionally based on lesion studies in non-human primates. The ventral pathway projects along the ventral brain surface; it computes the identity of visual objects (e.g., faces, animals, cars, tools). The dorsal pathway, also called the vision for action pathway [2], projects along the dorsal brain surface; it computes the location of visual objects and the actions related to those objects (e.g., reaching, grasping, throwing, utilizing). Mapping behavioural functions to visual pathways in this way enabled researchers to build common cognitive frameworks that incorporated findings from different species (human and macaque) and different experimental methods (e.g., neuroanatomy, physiology, neuropsychology, neuroimaging). While recent revisions have incorporated a wealth of subsequent research [3,4], the two pathways model is still principally concerned with the ‘what’, ‘where’ and ‘how’ of visual object recognition. However, current thinking has not kept pace with empirical advances, and it is now clear that the model requires revision.

In the current paper we present evidence for the existence of a third visual pathway on the lateral brain surface (Figure 1, Key Figure). This is consistent with the neuroanatomical and functional inputs that project from early visual cortex, via the motion-selective middle temporal (MT) area, into the STS in both human and non-human primates [511]. Regarding the issue of cross-species homologies, the current evidence suggests that only the dorsal bank and fundus of the macaque STS correspond to the human STS. We also review studies demonstrating that motion, and specifically biological motion (e.g., facial and body movement), drives the neural response to visual stimuli in the STS [1219]. In addition to these responses to visual stimuli, the STS also responds to the human voice [20], language [21] and the audio-visual integration of speech [22]. Based on this evidence it is clear that the third visual pathway is anatomically and functionally distinct from the ventral and dorsal visual pathways. While the ventral and dorsal pathways are concerned with the ‘what’, ‘where’ and ‘how’ of visual object recognition, the third pathway is principally engaged in the dynamic aspects of social perception [2325].

Figure 1, Key Figure. Cortical connectivity of the third pathway (in red).

Figure 1,

The third pathway begins in primary visual cortex (V1) and projects into the posterior banks of the superior temporal sulcus (STS) via the motion-selective area V5/MT. The cortico-cortical connections of the third pathway are independent of the ventral pathway (shown in green) and the dorsal pathway (shown in blue).

Anatomical and functional connectivity of the third pathway

The most compelling evidence for a cortical pathway into the STS that bypasses the ventral pathway comes from non-human primate neuroanatomy. Tracer studies in macaques reveal the existence of a cortico-cortical connection that projects from primary visual cortex (V1) directly into the motion-selective area MT. MT has direct anatomical connections with anterior visual motion areas in the medial superior temporal (MST) and fundus of the superior temporal (FST) cortices [6,7]. FST then feeds into the more anterior regions of the dorsal bank and fundus of the STS (Figure 2). Importantly, this pathway is anatomically segregated from cortico-cortical connections between V1, V2 and V4 that project directly into the inferior temporal cortex of the ventral pathway [26]. Such direct neuroanatomical data are not available in humans, but tractography studies have identified a white matter pathway projecting into the human STS that is anatomically segregated from white matter pathways on the ventral surface [8,27,28]. This convergence of human and non-human evidence demonstrates the existence of a direct pathway into the STS (the dorsal bank and fundus of the STS in macaques) from early visual cortex that is independent of the ventral pathway. The presence of MT demonstrates the fundamental role of motion in the third pathway. Defining the functional properties of the third pathway is therefore dependent on the use of moving visual stimuli.

Figure 2. Cortico-cortical connections of the macaque occipitotemporal cortex.

Figure 2.

A direct cortical pathway from primary visual cortex (V1) to the middle temporal (MT) motion processing area is highlighted in red. The third pathway in macaques projects from V1 to MT. MT then has direct anatomical connections with the medial superior temporal (MST) and fundus of the superior temporal (FST) cortices. FST then feeds into the more anterior (rostral) regions of the dorsal bank (d) and fundus (f) of the STS [4].

In non-human primates, moving points of light and basic 3D shapes have been used to map the differences in visual field responses across motion-selective visual areas (MT, MST and FST). Visual field mapping studies (in which visual stimuli are presented in the contralateral and ipsilateral visual fields) establish the functional connectivity of anatomically connected brain areas. For example, in macaques, the parts of visual areas V1, V2 and V4 with dense anatomical interconnections also represent the same parts of the contralateral visual field [29]. Visual field mapping in macaque motion-selective cortex has shown that visual areas that respond to motion in the contralateral visual field progressively represent a greater proportion of the ipsilateral visual field when moving anteriorly along the STS (MT, MST and FST) [5]. These results are also consistent with a study of neurons located in the dorsal bank and fundus of the macaque STS [30]. Results showed the majority of sampled neurons responded to moving more than stationary stimuli and that receptive field sizes encompassed almost the entirety of the visual field. Subsequent neuroimaging studies in humans have shown a similar pattern. The anterior areas of motion processing cortex (hMT+) represent a greater proportion of the ipsilateral visual field than more posterior motion areas [31]. This converging evidence from macaques and humans suggests that lateral brain areas with anatomical inputs into the STS do not exhibit the same contralateral visual field biases observed in ventral visual areas [29,32,33].

To further investigate this putative difference in visual field representations between the ventral and third pathways, we performed a visual mapping neuroimaging study using stimuli designed to maximise the functional response in the STS in human participants [10]. Face videos (with actors posing different facial expressions) were shown in different parts of the visual field. Consistent with prior studies [32,33] we observed a contralateral visual field bias in V5/MT, as well as in two face-selective areas, the fusiform face area (FFA) and occipital face area (OFA) (Figure 3A and 3B). By contrast, we observed no visual field bias in the face-selective area in the posterior STS (pSTS). This difference in visual field bias between the pSTS and OFA was replicated in a subsequent transcranial magnetic stimulation (TMS) experiment. TMS delivered over the right pSTS impaired facial expression discrimination in both visual fields, while TMS delivered over the right OFA impaired facial expression discrimination in the contralateral visual field only. More recently, this same differential pattern between the OFA/FFA and pSTS has been reported in an fMRI mapping study using cartoon faces [28].

Figure 3. The third pathway exhibits no visual field bias.

Figure 3.

A. Face-selective areas in the human occipitotemporal cortex. The posterior superior temporal sulcus is in the third pathway. The occipital face area and fusiform face area are both in the ventral pathway. B. There is a contralateral visual field bias in face-selective areas in the ventral pathway (10,11,32,33), while the pSTS had no visual field bias [10]. This same lack of a visual field bias is also seen in the dorsal bank and fundus of the macaque STS [5,30]. C. Group social interactions necessitate directing and redirecting attention to different individuals across the visual field. The lack of visual field bias in the pSTS is consistent with the functional role of the lateral pathway in social cognition.

These results reveal a functional dissociation between face-selective areas in the ventral pathway (FFA and OFA) and the third pathway (pSTS) in human cortex. Specifically, the contralateral visual field bias observed in the ventral pathway is absent in the pSTS. Because the ipsilateral response in the pSTS can only have come from the contralateral hemisphere, there must be a greater degree of interhemispheric connectivity in the third pathway than the ventral pathway. The lack of visual field bias in the STS is also consistent with the type of information decoded from moving faces that supports social cognition. Computing the locations and movements of multiple biological organisms across the entire visual field is essential. Social interaction is commonly conducted with a group of other individuals. When interacting with a group, processing demands will alternate between individuals across hemifields. For example, when someone on your far left raises a hand you redirect your attention from the wider group to the individual. Or, when interacting with only one individual in a group, it can also be necessary to monitor the behaviour of those in the surrounding group (Figure 3C). We argue that the third visual pathway has evolved to compute face information across the entire visual field to support social interaction, which, by its very definition is a dynamic and continually changing process.

The third pathway processes moving faces

The cognitive functions performed in a particular brain area can be deduced (at least partially) by the anatomical connectivity of that area. In the third pathway, the connections between V5/MT and the STS demonstrate the crucial role of motion. Neuroimaging studies show that the face-selective area in the human pSTS [12,24,34] exhibits a greater response to moving faces than static faces [13,14,35]. By contrast, ventral face-selective regions, like the FFA and OFA, show little (or no) preference for dynamic over static faces. An additional face-selective area in the anterior STS (aSTS) [35] also exhibits a greater response to moving than static faces [14,37]. A causal connection between the two STS areas selective for moving faces was demonstrated in our study that combined TMS and functional magnetic resonance imaging (fMRI) [38]. Participants were scanned while viewing face videos after TMS was delivered over the right pSTS. TMS reduced the response to moving faces in the pSTS, aSTS and in face-selective voxels in the amygdala. This result, together with the tractography studies showing an anatomical pathway along the STS [8,27,28], demonstrate the existence of a functional pathway projecting along the STS specialized for moving face perception.

Neuropsychological studies of patients with cortical lesions offer a unique way to causally demonstrate the independent anatomical and functional connectivity of the third pathway in the human brain. The existence of a direct pathway into the STS was proposed as early as 1984 based on the report of prosopagnosic patient GKT, but the lack of structural brain imaging made the theory speculative [39]. Today, functional brain imaging studies have identified multiple prosopagnosic patients who exhibit face-selective responses in the STS, despite having lesions encompassing the brain area in which the FFA and OFA are typically located [4043]. This causal demonstration that disrupting the ventral pathway has no effect on the response to faces in the STS is consistent with the third pathway being specialized for moving face perception. We tested this hypothesis in an fMRI study of Herschel, a prosopagnosic patient with a right ventral occipitotemporal lesion [11]. The neural response to moving and static faces was measured in face-selective areas and in V5/MT. Results showed the response to moving and static faces in Herschel’s right pSTS and right V5/MT was not significantly different from control participants. There was an impaired response to all faces in Herschel’s right FFA and OFA, which was consistent with his lesion. This differential pattern of activation demonstrates that a neural response to face stimuli in the STS can occur even when face-selective areas in the ventral pathway have been damaged or destroyed. In addition, both Herschel and control participants exhibited no visual field bias for moving faces in the rpSTS. This normal visual field response in Herschel’s rpSTS (despite a reduced contralateral response in his right OFA) further suggests an anatomical segregation between the third and ventral pathways.

This conclusion is seemingly inconsistent with established face processing models. Both cognitive and brain models of face processing [44,45] stipulate that all face information (e.g., the structural form that facilitates identity recognition and the changeable aspects such as eye and mouth movement) is processed via an initial single-entry point. This early structural encoding stage is located in the inferior occipital gyrus, also called the OFA when defined using fMRI [46]. An influential alternative model has also been proposed that suggests moving faces are processed via a pathway that runs from early visual cortex into the STS via V5/MT [47]. This pathway is anatomically and functionally independent of the ventral face processing pathway (for structural face information) that begins in the OFA, before progressing via the FFA into the anterior temporal lobe. To further dissociate the role of motion across face-selective areas, we combined TMS with fMRI to disrupt the two pathways that support face perception in healthy participants [9]. TMS was delivered over the right OFA, or right pSTS while participants were scanned with fMRI viewing moving or static faces. Disruption of the right OFA reduced the neural response to both static and moving faces in the right FFA. By contrast, the response to dynamic and static faces was doubly dissociated in the right pSTS. Namely, disruption of the right OFA reduced the response to static but not moving faces, while disruption of the rpSTS itself reduced the response to moving but not static faces. The dissociation in the response to moving and static faces in the STS, together with the neuropsychological data [11], shows that the STS has cortical inputs that are independent of the OFA. The convergence of causal evidence, the tractography, the selective response for moving faces, and the visual field mapping data show that, in humans, the third pathway has anatomical and functional properties that are distinct from the ventral pathway.

The third pathway in non-human primates

The functional properties of the third pathway have also been defined in non-human primates. These studies, mostly in macaque monkeys, enable researchers to employ invasive experimental methods that are difficult (if not impossible) in human subjects. For example, tracer studies in macaques report a cortical pathway that projects along the STS into the lateral nucleus of the dorsal amygdala [48,49]. Physiology studies have examined neurons in the STS that selectively respond to visual images of faces for over fifty years [5054]. fMRI studies subsequently identified at least six face-selective patches along the length of the STS [55] and the functions of these areas have been extensively investigated [5661].

One recent fMRI study has characterised the macaque face patches in a manner consistent with the two-face pathway model [18]. Results demonstrated that face patches located on the dorsal bank of the STS showed a selective response to faces in natural motion, while face patches on the ventral bank responded selectively to the structure of faces (Figure 4A). The face patch MF (located in the mid-fundus of the STS) exhibited a dual response to moving and static faces consistent with this pattern. This functional dissociation of a face-processing pathway that processes structural form, and another that processes changeable facial aspects is consistent with the third vs. ventral face-processing pathway model proposed in humans [9,47,62]. We have also shown that the AF (anterior fundus) face patch preferentially responds to moving faces relative to static faces [37]. More recently we further demonstrated that patches AF (anterior fundus) and MF were most sensitive to changes in facial expression, while patches AL (anterior lateral) and ML (middle lateral) were most sensitive to changes in head orientation [63]. Taken together, these studies begin to demonstrate a functional dissociation between face patches in the macaque STS that is consistent with the anatomical and functional dissociation between moving and static faces in human third and ventral pathways. Namely, face patches in the dorsal bank and fundus of the macaque STS (AF, MD and MF) may correspond with the STS in humans, while those on the ventral bank of the macaque STS (AL and ML) and anteroventral and posteroventral to the STS (AM and PL, respectively) may correspond with face-selective areas in the ventral pathway in humans. This hypothesis is further supported by recent structural data comparing white matter tracts across species [64]. However, this conclusion also raises the question of how we should compare STS face studies across species.

Figure 4. Biological motion processing in the macaque STS.

Figure 4.

A. Macaque face patches are organised in a manner consistent with two functionally distinct pathways. Dorsal Patches (purple) AF and MD respond selectively to faces in natural motion. Ventral patches (red) PL, ML and AL respond selectively to static face images. Face patch MF exhibits a split response to moving and static faces consistent with the dorsal / ventral distinction [18]. B. Results from an fMRI study of macaques viewing natural videos that contained animals (left) or no animals (right) [19]. Surface maps show the percent variance explained by biological motion. The brain on the bottom left shows how biological motion drives the neural response from early visual cortex and into the STS.

There is an obvious discrepancy between the human and macaque studies. Face areas in humans are located on both the ventral brain surface (e.g., the FFA) and on the lateral brain surface in the STS. In macaques, by contrast, the face patches studied with fMRI are predominantly located on the brain’s lateral surface. It is not fully clear what accounts for this discrepancy. Recording studies have identified face cells on the ventral brain surface [65,66], but mouth and jaw muscles cause signal drop out that substantially impairs the fMRI data recorded from the ventral brain surface. One study overcame this issue by using an optimised fMRI protocol that was able to identify multiple face-selective areas in the ventral temporal cortex and medial temporal lobe [67]. Despite this finding the majority of macaque fMRI face processing studies have continued to focus on the face patches in the STS. It is clear that future research is required to resolve how face-selective patches identified in macaques should be compared with those identified in humans.

The third pathway processes moving bodies

Faces are not the only moving biological stimulus that are selectively processed in the third pathway. The human STS also responds to visual images of the body [24]. Body-selective responses in STS have been identified in response to point-light walkers [15,68], moving bodies [16] and videos of actors performing observable physical actions [17]. Physiology studies in macaques have also identified cells in the STS that selectively respond to images of bodies and body parts (e.g., hands) [6973]. Given these findings it is likely that the STS is functionally connected to parietal and frontal areas that compute actions and intentions. For example, visual analysis of goal-directed hand actions in the STS [74] may influence parietal and frontal systems that compute actions, intentions and body movements [7578].

Despite these findings, the most heavily studied body-selective area in humans is not located in the STS. The extrastriate body area (EBA) [79] is slightly inferior and posterior to the STS, located on the lateral brain surface in Brodmann area 18. This places it in the same brain location as V5/MT, with which it can overlap [80]. Given this overlap between the EBA and V5/MT it is likely that the EBA is located in the third pathway. We recently provided evidence consistent with this hypothesis by demonstrating that the EBA exhibited a greater neural response to moving bodies than to static bodies [81]. A neuropsychological study that reported a normal EBA response to moving bodies in a patient with a lesion to the right ventral occipitotemporal cortex further suggests the EBA is in the third pathway [82]. This hypothesis is seemingly inconsistent with prior neuropsychological patients who were able to perceive biological motion despite reporting visual motion processing impairments [83,84]. However, in the early study there was no functional brain imaging, so the presence of V5/MT was not established [83]. In the later study, while the patient could identify the actions accurately, adding a small number of “noise” dots impaired her performance, suggesting that segregating actions by motion is (at least in part) reliant on V5/MT [84].

fMRI studies have also identified multiple body-selective patches in the macaque [36,52,8587]. More recently, one study comprehensively demonstrated the extent to which biological motion drives the neural response along the STS [19]. Macaques were scanned using fMRI while viewing videos that showed monkeys interacting in natural environments. Biological motion was the predominant driver of the neural response in clusters that began in early visual cortex and projected along the length of the entire STS (Figure 4B). This result was even more striking in the face-selective patches in the STS, which showed a greater response to biological motion than to faces. This study shows that computing the visual actions of other biological organisms is a fundamental role of the STS. This is consistent with an influential paper that surveyed the face and body responses in the STS and proposed that a full visual representation of the body is necessary to compute the range of socially relevant visual cues [23]. In addition to computing body information relevant for social interaction, the third pathway is also likely to be important for non-social encounters, for example, in encounters with predators and prey.

The third pathway and higher socio-cognitive functions

In this paper we have focused on studies that demonstrate the anatomical and functional connectivity between early visual cortex and the STS via V5/MT. Our goal has been to demonstrate why it is necessary to add the third pathway to the well-established model of dorsal and ventral visual pathways. In this final section we briefly describe evidence demonstrating the higher cognitive functions that are computed in the third pathway. These are primarily engaged in social cognition, namely, understanding and interpreting the actions and behaviors of other biological organisms. The role of the STS, and by extension the third pathway, in social cognition is well established [2325]. The best evidence comes from the extensive literature demonstrating how the STS responds to a wide variety of social cues. The information used by primates to calculate the meanings and intentions of others is generated by their actions. These actions are generated by faces, bodies, speech and by sound.

Studies of the human STS have shown that it contains regions that selectively respond to exactly these types of visual and auditory stimuli. These include facial expressions and eye gaze [8893] bodies [16,17], point-light walkers [15,68], the human voice [20], language [21] and the audio-visual integration of speech [22]. In addition, the temporoparietal junction (TPJ) (an adjacent brain area posterior and superior to the STS) responds to theory of mind tasks [94] in which participants are required to interpret the actions of characters in brief stories. One study that simultaneously mapped the responses to multiple types of social input in the STS identified regions that selectively responded to specific stimuli (e.g., faces or voices) as well as regions that responded to multiple contrasts (e.g., language and theory of mind tasks) [95]. This proximity of brain areas computing multi-sensory information relevant to social interactions further dissociates the third pathway from the established roles of the ventral and dorsal pathways.

Concluding remarks

There are many different experimental methods for studying the cognitive functions of primate visual cortex. Tracer studies map the anatomical connectivity between visual areas [57]. The neural response to visual stimuli can be identified at different scales using neuroimaging (cortical patches) or physiology (neurons) [12,16,23,24]. Neuropsychological and TMS studies demonstrate which brain areas are necessary for specific tasks and causally define the behavioural functions associated with damaged areas [1,2,11,39,9698]. We argue that characterizing the primate visual system as visual pathways enables us to describe the cognitive functions of the brain at a level that encompasses all these methods. This creates a common framework that facilitates understanding between those who study the brain at the behavioural, cognitive and neural levels. We have identified some of the unresolved issues and suggestions for future research that will increase this understanding in the Outstanding Questions Box.

Our principle aim in the current paper has been to expand the original two pathways model to include a third pathway. It is clear that while ‘what’, ‘where’ and ‘how’ can describe the many facets of visual object recognition, these terms are wholly inadequate when it comes to describing the complexity and nuances of even basic social interactions. There is no simple one-word description that can encompass the functions of the third visual pathway. Rather, it seems that the visual input into the STS is integrated with other sensory inputs to enable primates to understand and interpret the actions of others.

Outstanding Questions Box.

  • Why are macaque face patches mostly identified on the lateral brain surface, while human face patches are found on the lateral and ventral brain surface?

  • Do face patches on the ventral bank of the macaque STS show a greater contralateral visual field bias than face patches on the dorsal bank of the STS?

  • To what extent is the third pathway reliant on form and structural information computed in the ventral pathway for visual face and body recognition?

  • Is the third pathway lateralized to the right hemisphere in humans? If so, what are the visual functions of the left STS and what is the role played by speech?

  • What are the anatomical projections from the third pathway to the frontal lobe? What cognitive functions do these projections serve?

  • Why does the third visual pathway show no visual field bias while the ventral pathway shows a contralateral visual field bias?

  • Is the extrastriate body area (EBA) part of ventral pathway or part or the third pathway?

  • Do the low-level motion processing deficits exhibited by autistic individuals impact the typical processing of moving biological stimuli in the third pathway?

Highlights.

  • The two visual pathway model of primate visual cortex needs to be updated. We propose the existence of a third visual pathway on the lateral brain surface that is anatomically segregated from the dorsal and ventral pathways.

  • The third pathway exists in human and non-human primates. In humans the third pathway projects from early visual cortex into the superior temporal sulcus (STS). In macaques the third pathway projects from early visual cortex into the dorsal bank and fundus of the STS.

  • The third pathway has distinct functional properties. It selectively responds to moving faces and bodies. Visual field mapping studies show the third pathway responds to faces across the visual field to a greater extent than the ventral pathway.

  • The third pathway computes a range of higher socio-cognitive functions based on dynamic social cues. These include facial expression recognition, eye gaze discrimination, the audiovisual integration of speech and interpreting the actions and behaviors of other biological organisms.

Acknowledgements

David Pitcher is supported by a Biotechnology and Biological Sciences Research Council grant (BB/P006981/1). Leslie G. Ungerleider is supported by the Intramural Research Program of the National Institute of Mental Health (NCT01617408, ZIAMH002918). Thanks to Dwight Kravitz, Winrich Freiwald, Brian Russ for providing figures and Mike Burton, Emel Kucuk for useful comments.

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  • 1.Ungerleider LG & Mishkin M 1982. Two cortical visual systems In Ingle DJ, Goodale MA & Mansfield RJW (Eds.) Analysis of Visual Behavior (pp. 549–586). Cambridge, MA: MIT Press. [Google Scholar]
  • 2.Milner AD & Goodale MA (1995). The Visual Brain in Action. Oxford: Oxford University Press. [Google Scholar]
  • 3.Kravitz DJ, Saleem KS, Baker CI, Mishkin M (2011) A new neural framework for visuospatial processing. Nat Rev Neuroscience. 12:217–230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Kravitz DJ, Saleem KS, Baker CI, Ungerleider LG, Mishkin M (2013) The ventral visual pathway: an expanded neural framework for the processing of object quality. Trends Cogn Sci 17:26–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Desimone R, Ungerleider LG. 1986. Multiple visual areas in the caudal superior temporal sulcus of the macaque. Journal of Comp Neurol 248:164–189. [DOI] [PubMed] [Google Scholar]
  • 6.Ungerleider LG, Desimone R. 1986. Cortical connections of visual area MT in the macaque. J Comp Neurol 248:190–222. [DOI] [PubMed] [Google Scholar]
  • 7.Boussaoud D, Ungerleider LG, Desimone R. 1990. Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. Journal of Comp Neurol 296:462–95. [DOI] [PubMed] [Google Scholar]
  • 8.Gschwind M, Pourtois G, Schwartz S, Van De Ville D, Vuilleumier P. 2012. White-Matter Connectivity between Face-Responsive Regions in the Human Brain. Cereb Cortex 22:1564–1576. [DOI] [PubMed] [Google Scholar]
  • 9.Pitcher D, Duchaine B, Walsh V. 2014. Combined TMS and fMRI reveals dissociable cortical pathways for dynamic and static face perception. Current Biology. 24:2066–2070. [DOI] [PubMed] [Google Scholar]
  • 10.Pitcher D, Pilkington A, Rauth L, Baker C, Kravitz D, Ungerleider L. 2020. The human posterior superior temporal sulcus (pSTS) samples visual space differently from other face-selective regions. Cerebral Cortex. 30:778–785. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Sliwinska M, Bearpark C, Corkhill J, McPhillips A, Pitcher D. (2020). Dissociable pathways for moving and static face perception begin in early visual cortex: evidence from an acquired prosopagnosic. Cortex. [DOI] [PubMed]
  • 12.Puce A, Allison T, Bentin S, Gore JC, & McCarthy G 1998. Temporal cortex activation in humans viewing eye and mouth movements. J Neurosci, 18:2188–2199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Fox CJ, Iaria G, Barton J. 2009. Defining the face-processing network: optimization of the functional localizer in fMRI. Human Brain Mapping. 30:1637–1651. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Pitcher D, Dilks DD, Saxe RR, Triantafyllou C, Kanwisher N. 2011. Differential selectivity for dynamic versus static information in face selective cortical regions. NeuroImage. 56:2356–2363. [DOI] [PubMed] [Google Scholar]
  • 15.Grossman ED, Blake R (2002) Brain Areas Active during Visual Perception of Biological Motion. Neuron 35:1167–1175. [DOI] [PubMed] [Google Scholar]
  • 16.Beauchamp M, Lee KE, Haxby JV, Martin A. (2002). Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34 (1), 149–159. [DOI] [PubMed] [Google Scholar]
  • 17.Saxe R, Xiao D, Kovacs G, Perrett D, Kanwisher N. 2004. A region of right posterior superior temporal sulcus responds to observed intentional actions. Neuropsychologia, 1435–1446 [DOI] [PubMed]
  • 18.Fisher C, Freiwald WA (2015) Contrasting specializations for facial motion within the macaque face-processing system. Curr Biol 25:261–266. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Russ B, Leopold D. 2015. Functional MRI mapping of dynamic visual features during natural viewing in the macaque. Neuroimage. 109:84–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Belin P et al. (2004) Thinking the voice: neural correlates of voice perception. Trends Cogn. Sci 8, [DOI] [PubMed] [Google Scholar]
  • 21.Binder JR, Frost JA, Hammeke TA, Cox RW, Rao SM, Prieto T. 1997. Human brain language areas identified by functional magnetic resonance imaging. J Neurosci 17:353–362. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Young AW, Fruholz S, Schweinberger S. 2020. Face and Voice Perception: Understanding Commonalities and Differences. Trends Cogn. Sci 24(5), 398–410. [DOI] [PubMed] [Google Scholar]
  • 23.Perrett D, Hietanen J, Oram M, Benson P. 1992. Organization and functions of cells responsive to faces in the temporal cortex. Philos Trans R Soc Lond B Biol Sci 335:23–30. [DOI] [PubMed] [Google Scholar]
  • 24.Allison T, Puce A, McCarthy G. 2000. Social perception from visual cues: role of the STS region. Trends Cogn. Sci 4:267–278. [DOI] [PubMed] [Google Scholar]
  • 25.Hein G, Knight RT. Superior temporal sulcus—it’s my area: or is it? Journal of cognitive neuroscience 20 (12), 2125–2136. [DOI] [PubMed] [Google Scholar]
  • 26.Boussaoud D, Desimone R, Ungerleider LG. Visual topography of area TEO in the macaque. Journal of comparative neurology 306 (4), 554–575. [DOI] [PubMed] [Google Scholar]
  • 27.Babo-Rebelo M, Puce A, Bullock D, Hugueville L, Pestilli F, Adam C, Lehongre K, Lambrecq V, Dinkelacker V, George N. 2020. Visual information routes in the posterior dorsal and ventral face network studied with intracranial neurophysiology, and white matter tract endpoints. bioRxiv 2020.05.22.102046 [DOI] [PMC free article] [PubMed]
  • 28.Finzi D, Gomez J, Nordt M, Rezai A, Poltoratski S, Grill-Spector K. 2020. Differential spatial processing in ventral and lateral face-selective regions is scaffolded by structural connections. bioRxiv 2020.07.06.190371 [DOI] [PMC free article] [PubMed]
  • 29.Gattass R, Sousa APB, Mishkin M. Ungerleider LG. 1997. Cortical projections of area V2 in the macaque. Cereb Cortex. 7:110–129. [DOI] [PubMed] [Google Scholar]
  • 30.Bruce C, Desimone R, Gross CG. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol, 46, 369–84. [DOI] [PubMed] [Google Scholar]
  • 31.Huk AC, Dougherty RF, Heeger DJ. Retinotopy and functional subdivision of human areas MT and MST. Journal of Neuroscience 22 (16), 7195–7205 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hemond C, Kanwisher N, Op de Beeck H. 2007. A Preference for Contralateral Stimuli in Human Object- and Face-Selective Cortex. PLoSONE. 2: e574. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Kay KN, Weiner KS, Grill-Spector K. 2015. Attention reduces spatial uncertainty in human ventral temporal cortex ventral temporal cortex. Current Biology. 25:1–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.LaBar KS, Crupain MJ, Voyvodic JB, McCarthy G. 2003. Dynamic perception of facial affect and identity in the human brain. Cereb Cortex. 13:1023–1033. [DOI] [PubMed] [Google Scholar]
  • 35.Schultz J, Pilz KS. (2009). Natural facial motion enhances cortical responses to faces. Experimental Brain Research 194 (3), 465–475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Pinsk MA, Arcaro M, Weiner KS, Kalkus JF, Inati SJ, Gross CG, Kastner S (2009). Neural representations of faces and body parts in macaque and human cortex: a comparative FMRI study. Journal of neurophysiology 101 (5), 2581–2600 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Zhang H, Japee S, Stacy A, Flessert M, Ungerleider LG. (2020). Anterior superior temporal sulcus is specialized for non-rigid facial motion in both monkeys and humans. NeuroImage, 218, [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Pitcher D, Japee S, Rauth L, Ungerleider LG. 2017. The superior temporal sulcus is causally connected to the amygdala: A combined TBS-fMRI study. Journal of Neuroscience. 37:1156–1161. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bauer R (1984). Autonomic recognition of names and faces in prosopagnosia: A neuropsychological application of the guilty knowledge test. Neuropsychologia, 22, 457–469. [DOI] [PubMed] [Google Scholar]
  • 40.Steeves J, Culham J, Duchaine B, Cavina Pratesi C, Valyear K, Schindler I, Humphrey G, Milner A, Goodale M. 2006. The fusiform face area is not sufficient for face recognition: Evidence from a patient with dense prosopagnosia and no occipital face area. Neuropsychologia, 44, 594–609. [DOI] [PubMed] [Google Scholar]
  • 41.Dalrymple K, Oruç I, Duchaine B, Pancaroglu R, Fox C, Iaria G, Handy T, Barton J. 2011. The neuroanatomic basis of the right face-selective N170 in acquired prosopagnosia: A combined ERP/fMRI study. Neuropsychologia, 49, 2553–2563. [DOI] [PubMed] [Google Scholar]
  • 42.Rezlescu C, Pitcher D, Duchaine B. 2012. Acquired prosopagnosia with spared within-class object recognition but impaired recognition of basic-level objects. Cognitive Neuropsychology. 29:325–347. [DOI] [PubMed] [Google Scholar]
  • 43.Gao X, Vuong QC, Rossion B (2019). The cortical face network of the prosopagnosic patient PS with fast periodic stimulation in fMRI. Cortex, 119:528–542. [DOI] [PubMed] [Google Scholar]
  • 44.Bruce V Young A 1986. Understanding face recognition. Br J Psychol. 77:305–27. [DOI] [PubMed] [Google Scholar]
  • 45.Haxby JV, Hoffman EA, Gobbini MI. 2000. The distributed human neural system for face perception. Trends Cogn Sci. 4:223–233. [DOI] [PubMed] [Google Scholar]
  • 46.Gauthier I, Tarr MJ, Moylan J, Skudlarski P, Gore JC, Anderson AW (2000). The fusiform “face area” is part of a network that processes faces at the individual level. J Cogn Neurosci, 12, 495–504. [DOI] [PubMed] [Google Scholar]
  • 47.O’Toole AJ Roark D Abdi H 2002. Recognition of moving faces: A psychological and neural framework. Trends in Cognitive Sciences. 6:261–266. [DOI] [PubMed] [Google Scholar]
  • 48.Aggleton JP, Burton MJ Passingham RE. 1980. Cortical and subcortical afferents to the amygdala of the rhesus monkey (Macaca mulatta). Brain Res 190: 347–368. [DOI] [PubMed] [Google Scholar]
  • 49.Stefanacci L, Amaral DG. 2000. Topographic Organization of Cortical Inputs to the Lateral Nucleus of the Macaque Monkey Amygdala: A Retrograde Tracing Study. Journal of Comparative Neurology. 421:52–79. [DOI] [PubMed] [Google Scholar]
  • 50.Perrett D, Rolls E, Caan W. 1982. Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research. 47:329–342. [DOI] [PubMed] [Google Scholar]
  • 51.Gross C, Rocha-Miranda C, Bender D. 1972. Visual properties of neurons in inferotemporal cortex of the macaque. Journal of Neurophysiology, 35:96–111. [DOI] [PubMed] [Google Scholar]
  • 52.Tsao D, Freiwald W, Knutsen B, Mandeville J, Tootell R. 2003. Faces and objects in macaque cerebral cortex. Nature Neuroscience 6 (9), 989–995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Afraz S, Kiani R, Esteky H. 2006. Microstimulation of inferotemporal cortex influences face categorization. Nature 442 (7103), 692–695. [DOI] [PubMed] [Google Scholar]
  • 54.Baylis G, Rolls ET, Leonard CM. 1987. Functional subdivisions of the temporal lobe neocortex. Journal of Neuroscience, 7 (2) 330–342. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Tsao DY, Freiwald WA, Tootell RB, Livingstone MS. 2006. A cortical region consisting entirely of face-selective cells. Science 311:670–674. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Moeller S, Freiwald W, Tsao D. 2008. Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320 (5881), 1355–1359. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Freiwald W, Tsao D. 2010. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 330 (6005), 845–851. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Bell A, Malecek N, Morin E, Hadj-Bouziane F, Tootell R, Ungerleider L. 2011. Relationship between functional magnetic resonance imaging-identified regions and neuronal category selectivity. Journal of Neuroscience 31 (34), 12229–12240 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Furl N, Hadj-Bouziane F, Liu N, Averbeck B, Ungerleider L. 2012. Dynamic and Static Facial Expressions Decoded from Motion-Sensitive Areas in the Macaque Monkey. The Journal of Neuroscience 32 (45), 15952–15962 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Hadj-Bouziane F, Liu N, Bell A, Gothard K, Luh W, Tootell R, Murray E, Ungerleider L. 2012. Amygdala lesions disrupt modulation of functional MRI activity evoked by facial expression in the monkey inferior temporal cortex. Proceedings of the National Academy of Sciences 109 (52), E3640–E3648 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Afraz A, Boyden E, DiCarlo J. 2015. Optogenetic and pharmacological suppression of spatial clusters of face neurons reveal their causal role in face gender discrimination. Proceedings of the National Academy of Sciences 112 (21), 6730–6735. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Duchaine B, Yovel G. A Revised Neural Framework for Face Processing. 2015. Annual Rev Vis Sci, 1, 393–416. [DOI] [PubMed] [Google Scholar]
  • 63.Taubert J, Japee S, Murphy AP, Tardiff CT, Koele EA, Kumar S, Leopold DA, Ungerleider LG. (2020). Parallel processing of facial expression and head orientation in the macaque brain. Journal of Neuroscience. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Roumazeilles L, Eichert N, Bryant KL, Folloni D, Sallet J, et al. (2020) Longitudinal connections and the organization of the temporal cortex in macaques, great apes, and humans. PLOS Biology 18(7): e3000810. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Desimone R, Gross C. Visual areas in the temporal cortex of the macaque. 1979. Brain research 178 (2–3), 363–380. [DOI] [PubMed] [Google Scholar]
  • 66.Nakamura K, Kubota K 1996. The primate temporal pole: its putative role in object recognition and memory. Behavioural Brain Research, 77, 53–77. [DOI] [PubMed] [Google Scholar]
  • 67.Ku S, Tolias A, Logothetis N, Goense J. 2011. fMRI of the face-processing network in the ventral temporal lobe of awake and anesthetized macaques. Neuron 70 (2), 352–362. [DOI] [PubMed] [Google Scholar]
  • 68.Grossman E, Donnelly M, Price R, Pickens D, Morgan V, Neighbor G, Blake R. 2000. Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience 12 (5), 711–720. [DOI] [PubMed] [Google Scholar]
  • 69.Gross C, Rocha-Miranda C, Bender D. 1972. Visual properties of neurons in inferotemporal cortex of the macaque. Journal of neurophysiology 35 (1), 96–111 [DOI] [PubMed] [Google Scholar]
  • 70.Desimone R, Albright TD, Gross CG & Bruce C 1984. Stimulus-selective properties of inferior temporal neurons in the macaque. Journal of Neuroscience 4:2051–2062 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Wachsmuth E, Oram M, Perrett D. 1994. Recognition of objects and their component parts: Responses of single units in the temporal cortex of the macaque. Cerebral Cortex, 4(5), 509–522. [DOI] [PubMed] [Google Scholar]
  • 72.Barraclough NE, Xiao D, Oram MW & Perrett DI The sensitivity of primate STS neurons to walking sequences and to the degree of articulation in static images. Prog. Brain Res 154, 135–148 (2006) [DOI] [PubMed] [Google Scholar]
  • 73.Vangeneugden J, Pollick F, Vogels R. Functional differentiation of macaque visual temporal cortical neurons using a parametric action space. Cereb Cortex. 2009. March;19(3):593–611. [DOI] [PubMed] [Google Scholar]
  • 74.Perrett DI, Harries MH, Bevan R, Thomas S, Benson PJ, Mistlin AJ, Chitty AK, Hietanen JK, Ortega JE. (1989). Frameworks of analysis for the neural representation of animate objects and actions. Journal of Experimental Biology 146, 87–113. [DOI] [PubMed] [Google Scholar]
  • 75.Fogassi L, Ferrari PF, Gesierich B, Rozzi S, Chersi F, Rizzolatti G. (2005). Parietal lobe: from action organization to intention understanding. Science 308, 662–667. [DOI] [PubMed] [Google Scholar]
  • 76.Kohler E, Keysers C, Umiltà MA, Fogassi L, Gallese V, Rizzolatti G. (2002). Hearing sounds, understanding actions: action representation in mirror neurons. Science 297, 846–848. [DOI] [PubMed] [Google Scholar]
  • 77.Umilta MA, Kohler E, Gallese V, Fogassi L, Fadiga L, Keysers C & Rizzolatti G. (2001). I know what you are doing: A neurophysiological study. Neuron, 31(1), 155–165. [DOI] [PubMed] [Google Scholar]
  • 78.Calvo-Merino B, Glaser DE, Grèzes J, Passingham RE, Haggard P. (2005). Action observation and acquired motor skills: an FMRI study with expert dancers. Cerebral Cortex, 15(8), 1243–1249. [DOI] [PubMed] [Google Scholar]
  • 79.Downing P, Jiang Y, Shuman M, Kanwisher N. 2001. A cortical area selective for visual processing of the human body. Science, 293, 2470–2473. [DOI] [PubMed] [Google Scholar]
  • 80.Downing P, Wiggett A, Peelen M. 2007. Functional magnetic resonance imaging investigation of overlapping lateral occipitotemporal activations using multi-voxel pattern analysis. Journal of Neuroscience 27 (1), 226–233. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Pitcher D, Ianni G, Ungerleider LG. (2019). A functional dissociation of face-, body- and scene-selective brain areas based on their response to moving and static stimuli. Scientific Reports. [DOI] [PMC free article] [PubMed]
  • 82.Susilo T, Yang H, Potter Z, Robbins R, Duchaine B. 2015. Normal body perception despite the loss of right fusiform gyrus. Journal of Cognitive Neuroscience 27 (3), 614–622 [DOI] [PubMed] [Google Scholar]
  • 83.Vaina L, Lemay M, Bienfang D, Choi A, & Nakayama K (1990). Intact “biological motion” and “structure from motion” perception in a patient with impaired motion mechanisms: A case study. Visual Neuroscience, 5, 353–369. [DOI] [PubMed] [Google Scholar]
  • 84.McLeod P, Dittrich W, Driver J, Perrett D, Zihl J. 1996. Preserved and impaired detection of structure from motion by a “motion-blind” patient. Visual Cognition, 3, 363–391. [Google Scholar]
  • 85.Pinsk M, DeSimone K, Moore T, Gross C, Kastner S. 2005. Representations of faces and body parts in macaque temporal cortex: a functional MRI study. Proceedings of the National Academy of Sciences 102 (19), 6996–7001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Popivanov I, Jastorff J, Vanduffel W, Vogels R. 2012. Stimulus representations in body-selective regions of the macaque cortex assessed with event-related fMRI. Neuroimage. 63:723–41. [DOI] [PubMed] [Google Scholar]
  • 87.Popivanov I, Jastorff J, Vanduffel W, Vogels R. 2014. Heterogeneous Single-Unit Selectivity in an fMRI-Defined Body-Selective Patch. Journal of Neuroscience. 34:95–111. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Phillips M, Young A, Senior C, Brammer M, Andrews C, Calder A, Bullmore E, Perrett D, Rowland D, Williams S, Gray J, David A. 1997. A specific neural substrate for perceiving facial expressions of disgust. Nature, 389, 495–498. [DOI] [PubMed] [Google Scholar]
  • 89.Calder A, Beaver J, Winston J, Dolan R, Jenkins R, Eger E, Henson R. 2007. Separate coding of different gaze directions in the superior temporal sulcus and inferior parietal lobule. Current Biology 17 (1), 20–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Pitcher D 2014. Discriminating facial expressions takes longer in the posterior superior temporal sulcus than in the occipital face area. Journal of Neuroscience. 34:9173–9177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 91.Sliwinska M, Elson R, Pitcher D. 2020. TMS demonstrates causal functional connectivity between the left and right posterior temporal sulci during facial expression recognition. Brain Stimulation, 13, 1008–1013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Winston J, Henson R, Fine-Goulden M, Dolan R. 2004. fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. Journal of Neurophysiology 92 (3), 1830–1839 [DOI] [PubMed] [Google Scholar]
  • 93.Hoffman EA, Haxby JV. 2000. Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nat Neurosci 3:80–4. [DOI] [PubMed] [Google Scholar]
  • 94.Saxe R, Kanwisher N. 2003. People thinking about thinking people: the role of the temporoparietal junction in “theory of mind”. Neuroimage 19 (4), 1835–1842. [DOI] [PubMed] [Google Scholar]
  • 95.Deen B, Koldewyn K, Kanwisher N, Saxe R. 2015. Functional organization of social perception and cognition in the superior temporal sulcus. Cerebral cortex 25 (11), 4596–4609. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Handwerker D, Ianni G, Gutierrez B, Roopchansingh V, Gonzalez-Castillo J, Chen G, Bandettini P, Ungerleider L, Pitcher D. (2020). Thetaburst TMS to the human posterior superior temporal sulcus disrupts resting-state fMRI connectivity across the face processing network. Network Neuroscience, 4(3),746–760. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 97.Pourtois G, Sander D, Andres M, Grandjean D, Revert L, Oliver E, Vuilleumier P. 2004. Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals. Eur J Neurosci, 20, 3507–15. [DOI] [PubMed] [Google Scholar]
  • 98.Newcombe F, Ratcliff G, Damasio H. 1987. Dissociable visual and spatial impairments following right posterior cerebral lesions: Clinical, neuropsychological and anatomical evidence. Neuropsychologia 25 (1), 149–161. [DOI] [PubMed] [Google Scholar]

RESOURCES