Abstract
In this review, we describe the current models of dorsal and ventral streams in vision, audition and touch. Available theories take their first steps from the model of Milner and Goodale, which was developed to explain how human actions can be efficiently carried out using visual information. Since then, similar concepts have also been applied to other sensory modalities. We propose that advances in the knowledge of brain functioning can be achieved through models explaining action and perception patterns independently from sensory modalities.
Keywords: sensorimotor integration, action control, perception, dorsal stream, ventral stream, cross-modal
References
- [1].Goodale M.A., Milner A.D. Separate visual pathways for perception and action. Trends Neurosci. 1992;15(1):20–25. doi: 10.1016/0166-2236(92)90344-8. [DOI] [PubMed] [Google Scholar]
- [2].Milner A.D., Goodale M.A. The Visual Brain in Action. Oxford: Oxford University Press; 1995. [Google Scholar]
- [3].Goodale M.A. Transforming vision into action. Vision Res. 2011;51(13):1567–1587. doi: 10.1016/j.visres.2010.07.027. [DOI] [PubMed] [Google Scholar]
- [4].Ingle D. Two visual systems in the frog. Science. 1973;181(104):1053–1055. doi: 10.1126/science.181.4104.1053. [DOI] [PubMed] [Google Scholar]
- [5].Schneider G.E. Two visual systems. Science. 1969;163(870):895–902. doi: 10.1126/science.163.3870.895. [DOI] [PubMed] [Google Scholar]
- [6].Mishkin M., Ungerleider L.G. Contribution of striate inputs to the visuospatial functions of parieto-preoccipital cortex in monkeys. Behav Brain Res. 1982;6(1):57–77. doi: 10.1016/0166-4328(82)90081-X. [DOI] [PubMed] [Google Scholar]
- [7].Goodale M.A., Milner A.D., Jakobson L.S., Carey D.P. A neurological dissociation between perceiving objects and grasping them. Nature. 1991;349(6305):154–156. doi: 10.1038/349154a0. [DOI] [PubMed] [Google Scholar]
- [8].McIntosh R.D., McClements K.I., Dijkerman H.C., Birchall D., Milner A.D. Preserved obstacle avoidance during reaching in patients with left visual neglect. Neuropsychologia. 2004;42:1107–1117. doi: 10.1016/j.neuropsychologia.2003.11.023. [DOI] [PubMed] [Google Scholar]
- [9].Thaler L., Goodale M.A. Reaction times for allocentric movements are 35 ms slower than reaction times for target-directed movements. Exp Brain Res. 2011;211(2):313–328. doi: 10.1007/s00221-011-2691-2. [DOI] [PubMed] [Google Scholar]
- [10].Chapman C.S., Goodale M.A. Obstacle avoidance during online corrections. J Vis. 2010;10(11):17. doi: 10.1167/10.11.17. [DOI] [PubMed] [Google Scholar]
- [11].Striemer C.L., Yukovsky J., Goodale M.A. Can intention override the “automatic pilot”? Exp Brain Res. 2010;202(3):623–632. doi: 10.1007/s00221-010-2169-7. [DOI] [PubMed] [Google Scholar]
- [12].Cohen N.R., Cross E.S., Tunik E., Grafton S.T., Culham J.C. Ventral and dorsal stream contributions to the online control of immediate and delayed grasping: a TMS approach. Neuropsychologia. 2009;47(6):1553–1562. doi: 10.1016/j.neuropsychologia.2008.12.034. [DOI] [PubMed] [Google Scholar]
- [13].Valyear K.F., Culham J.C., Sharif N., Westwood D., Goodale M.A. A double dissociation between sensitivity to changes in object identity and object orientation in the ventral and dorsal visual streams: A human fMRI study. Neuropsychologia. 2006;44:218–228. doi: 10.1016/j.neuropsychologia.2005.05.004. [DOI] [PubMed] [Google Scholar]
- [14].Cavina-Pratesi C., Goodale M.A., Culham J.C. FMRI reveals a dissociation between grasping and perceiving the size of real 3D objects. PLoS One. 2007;2(5):e424. doi: 10.1371/journal.pone.0000424. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [15].Goodale M.A., Meenan J.P., Bülthoff H.H., Nicolle D.A., Murphy K.J., Racicot C.I. Separate neural pathways for the visual analysis of object shape in perception and prehension. Curr Biol. 1994;4(7):604–610. doi: 10.1016/S0960-9822(00)00132-9. [DOI] [PubMed] [Google Scholar]
- [16].Milner A.D., Perrett D.I., Johnston R.S., Benson P.J., Jordan T.R., Heeley D.W., et al. Perception and action in ‘visual form agnosia’. Brain. 1991;114(1):405–428. doi: 10.1093/brain/114.1.405. [DOI] [PubMed] [Google Scholar]
- [17].James T.W., Culham J., Humphrey G.K., Milner A.D., Goodale M.A. Ventral occipital lesions impair object recognition but not objectdirected grasping: an fMRI study. Brain. 2003;126(11):2463–2475. doi: 10.1093/brain/awg248. [DOI] [PubMed] [Google Scholar]
- [18].Perenin M.T., Vighetto A. Optic ataxia: a specific disruption in visuomotor mechanisms. I. Different aspects of the deficit in reaching for objects. Brain. 1988;111(3):643–674. doi: 10.1093/brain/111.3.643. [DOI] [PubMed] [Google Scholar]
- [19].Weiskrantz L. The Ferrier lecture, 1989. Outlooks for blindsight: explicit methodologies for implicit processes. Proc R Soc Lond B Biol Sci. 1990;239(1296):247–278. doi: 10.1098/rspb.1990.0016. [DOI] [PubMed] [Google Scholar]
- [20].Perenin M.T., Jeannerod M. Residual vision in cortically blind hemifields. Neuropsychologia. 1975;13(1):1–7. doi: 10.1016/0028-3932(75)90041-X. [DOI] [PubMed] [Google Scholar]
- [21].Danckert J., Rossetti Y. Blindsight in action: what can the different sub-types of blind-sight tell us about the control of visually guided actions? Neurosci Biobehav Rev. 2005;29(7):1035–1046. doi: 10.1016/j.neubiorev.2005.02.001. [DOI] [PubMed] [Google Scholar]
- [22].Verhagen L., Dijkerman H.C., Grol M.J., Toni I. Perceptuo-motor interactions during prehension movements. J Neurosci. 2008;28(18):4726–4735. doi: 10.1523/JNEUROSCI.0057-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [23].Cavina-Pratesi C., Monaco S., Fattori P., Galletti C., McAdam T.D., Quinlan D.J., et al. Functional magnetic resonance imaging reveals the neural substrates of arm transport and grip formation in reachto-grasp actions in humans. J Neurosci. 2010;30(31):10306–10323. doi: 10.1523/JNEUROSCI.2023-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].Pisella L., Binkofski F., Lasek K., Toni I., Rossetti Y. No doubledissociation between optic ataxia and visual agnosia: multiple substreams for multiple visuo-manual integrations. Neuropsychologia. 2006;44(13):2734–2748. doi: 10.1016/j.neuropsychologia.2006.03.027. [DOI] [PubMed] [Google Scholar]
- [25].Jeannerod M. The timing of natural prehension movements. J Mot Behav. 1984;16(3):235–254. doi: 10.1080/00222895.1984.10735319. [DOI] [PubMed] [Google Scholar]
- [26].Yost W.A. Fundamentals of Hearing: An introduction. 3rd ed. San Diego: Academic Press; 1994. [Google Scholar]
- [27].Rauschecker J.P. Parallel processing in the auditory cortex of primates. Audiol Neurotol. 1998;3:86–103. doi: 10.1159/000013784. [DOI] [PubMed] [Google Scholar]
- [28].Rauschecker J.P., Tian B. Mechanisms and streams for processing of “what” and “where” in auditory cortex. Proc Natl Acad Sci U S A. 2000;97(22):11800–11806. doi: 10.1073/pnas.97.22.11800. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [29].Romanski L.M., Tian B., Fritz J., Mishkin M., Goldman-Rakic P.S., Rauschecker J.P. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci. 1999;2(12):1131–1136. doi: 10.1038/16056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [30].Alain C., Arnott S.R., Hevenor S., Graham S., Grady C.L. “What” and “where” in the human auditory system. Proc Natl Acad Sci U S A. 2001;98(21):12301–12306. doi: 10.1073/pnas.211209098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [31].Rauschecker J.P., Tian B., Hauser M. Processing of complex sounds in the macaque nonprimary auditory cortex. Science. 1995;268:111–114. doi: 10.1126/science.7701330. [DOI] [PubMed] [Google Scholar]
- [32].Tian B., Reser D., Durham A., Kustov A., Rauschecker J.P. Functional specialization in rhesus monkey auditory cortex. Science. 2001;292(5515):290–293. doi: 10.1126/science.1058911. [DOI] [PubMed] [Google Scholar]
- [33].Hafke H.Z. Nonconscious control of fundamental voice frequency. J Acoust Soc Am. 2008;123:273–278. doi: 10.1121/1.2817357. [DOI] [PubMed] [Google Scholar]
- [34].Loui P., Guenther F.H., Mathys C., Schlaug G. Action-perception mismatch in tone-deafness. Curr Biol. 2008;18(8):R331–332. doi: 10.1016/j.cub.2008.02.045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [35].Griffiths T.D. Sensory systems: auditory action streams? Curr Biol. 2008;18(9):R387–388. doi: 10.1016/j.cub.2008.03.007. [DOI] [PubMed] [Google Scholar]
- [36].Arnott S.R., Binns M.A., Grady C.L., Alain C. Assessing the auditory dual-pathway model in humans. Neuroimage. 2004;22(1):401–408. doi: 10.1016/j.neuroimage.2004.01.014. [DOI] [PubMed] [Google Scholar]
- [37].Lakatos S., McAdams S., Causse R. The representation of auditory source characteristics: simple geometric form. Percept Psychophys. 1997;59(8):1180–1190. doi: 10.3758/BF03214206. [DOI] [PubMed] [Google Scholar]
- [38].Carello C., Anderson K.L., Kunkler-Peck A.J. Perception of object length by sound. Psychol Sci. 1998;9(3):211–214. doi: 10.1111/1467-9280.00040. [DOI] [Google Scholar]
- [39].Kunkler-Peck A.J., Turvey M.T. Hearing shape. J Exp Psychol Hum Percept Perform. 2000;26(1):279–294. doi: 10.1037/0096-1523.26.1.279. [DOI] [PubMed] [Google Scholar]
- [40].Grassi M. Do we hear size or sound? Balls dropped on plates. Percept Psychophys. 2005;67(2):274–284. doi: 10.3758/BF03206491. [DOI] [PubMed] [Google Scholar]
- [41].Klatzky R.L., Pai D.K., Krotkov E.P. Perception of material from contact sounds. Presence — Teleoper & Virtual Env. 2000;9(4):399–410. doi: 10.1162/105474600566907. [DOI] [Google Scholar]
- [42].Sedda A., Monaco S., Bottini G., Goodale M.A. Integration of visual and auditory information for hand actions: preliminary evidence for the contribution of natural sounds to grasping. Exp Brain Res. 2011;209(3):365–374. doi: 10.1007/s00221-011-2559-5. [DOI] [PubMed] [Google Scholar]
- [43].Dijkerman H.C., de Haan H.F. Somatosensory processes subserving perception and action. Behav Brain Sci. 2007;30:189–239. doi: 10.1017/S0140525X07001392. [DOI] [PubMed] [Google Scholar]
- [44].Reed C.L., Klatzky R.L., Halgren E. What vs. where in touch: an fMRI study. Neuroimage. 2005;25(3):718–726. doi: 10.1016/j.neuroimage.2004.11.044. [DOI] [PubMed] [Google Scholar]
- [45].Reed C.L., Caselli R.J., Farah M.J. Tactile agnosia: underlying impairment and implications for normal tactile object recognition. Brain. 1996;119:875–888. doi: 10.1093/brain/119.3.875. [DOI] [PubMed] [Google Scholar]
- [46].Head H., Holmes H.G. Sensory disturbances from cerebral lesions. Brain. 1911;34:102–254. doi: 10.1093/brain/34.2-3.102. [DOI] [Google Scholar]
- [47].Paillard J. Le corps situé et le corps identifié. Une approche psychophysiologique de la notion de schéma corporel. Rev Med Suisse Romande. 1980;100:129–141. [PubMed] [Google Scholar]
- [48].Gallagher S. How the body shapes the mind. Oxford: Oxford University Press; 2005. [Google Scholar]
- [49].Dijkerman H.C., de Haan H.F. Authors’ response. Somatosensory processes subserving perception and action. Behav Brain Sci. 2007;30:224–230. doi: 10.1017/S0140525X07001641. [DOI] [PubMed] [Google Scholar]
- [50].Baumann M.A., Fluet M.C., Scherberger H. Context-specific grasp movement representation in the macaque anterior intraparietal area. J Neurosci. 2009;29(20):6436–6448. doi: 10.1523/JNEUROSCI.5479-08.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [51].Murata A., Gallese V., Luppino G., Kaseda M., Sakata H. Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. J Neurophysiol. 2000;83(5):2580–2601. doi: 10.1152/jn.2000.83.5.2580. [DOI] [PubMed] [Google Scholar]
- [52].Taira M., Mine S., Georgopoulos A.P., Murata A., Sakata H. Parietal cortex neurons of the monkey related to the visual guidance of hand movement. Exp Brain Res. 1990;83(1):29–36. doi: 10.1007/BF00232190. [DOI] [PubMed] [Google Scholar]
- [53].Borra E., Belmalih A., Calzavara R., Gerbella M., Murata A., Rozzi S., et al. Cortical connections of the macaque anterior intraparietal (AIP) area. Cereb Cortex. 2008;18(5):1094–1111. doi: 10.1093/cercor/bhm146. [DOI] [PubMed] [Google Scholar]
- [54].Goodale M.A., Cant J.S. Coming to grips with vision and touch. Behav Brain Sci. 2007;30:209–210. doi: 10.1017/S0140525X07001483. [DOI] [Google Scholar]
- [55].Mishkin M. Analogous neural models for tactual and visual learning. Neuropsychologia. 1979;17:139–151. doi: 10.1016/0028-3932(79)90005-8. [DOI] [PubMed] [Google Scholar]
- [56].Paillard J. Body schema and body image: A double dissociation in deafferented patients. In: Gantchev G.N., Mori S., Massion J., editors. Motor Control, Today and Tomorrow. Sofia: Academic Publishing House; 1999. [Google Scholar]
- [57].Wernicke C. Das Urwindungssystem des menschlichen Gehirns. Arch Psychiat Nervenkr. 1876;6:298–326. doi: 10.1007/BF02230815. [DOI] [Google Scholar]
- [58].Delay J.P.L. Les Astéréognosies: Pathologie du Toucher. Paris: Massion; 1935. [Google Scholar]
- [59].Klein R. Zur Symptomatologie des Parietallappens. Z Gesamte Neurol Psy. 1931;135(1):589–608. doi: 10.1007/BF02864081. [DOI] [Google Scholar]
- [60].Botvinick M., Cohen J. Rubber hands ‘feel’ touch that eyes see. Nature. 1998;391(6669):756. doi: 10.1038/35784. [DOI] [PubMed] [Google Scholar]
- [61].Kammers M.P.M., de Vignemont F., Verhagenaand L., Dijkerman H.C. The rubber hand illusion in action. Neuropsychologia. 2009;47:204–211. doi: 10.1016/j.neuropsychologia.2008.07.028. [DOI] [PubMed] [Google Scholar]
- [62].Kammers M.P.M., Verhagen L., Dijkerman H.C., Hogendoorn H., de Vignemont F., Schutter D.J.L.G. Is this hand for real? Attenuation of the rubber hand illusion by transcranial magnetic stimulation over the inferior parietal lobule. J Cog Neurosci. 2009;21(7):1311–1320. doi: 10.1162/jocn.2009.21095. [DOI] [PubMed] [Google Scholar]
- [63].De Vignemont F. Body schema and body image — Pros and cons. Neuropsychologia. 2010;48:669–680. doi: 10.1016/j.neuropsychologia.2009.09.022. [DOI] [PubMed] [Google Scholar]
- [64].Kammers M.P.M., Longo M.R., Tsakiris M., Dijkerman H.C., Haggard P. Specificity and coherence of body representations. Perception. 2009;38:1804–1820. doi: 10.1068/p6389. [DOI] [PubMed] [Google Scholar]
- [65].Hach S., Ishihara M., Keller P.E., Schütz-Bosbach S. Hard and fast rules about the body: contributions of the action stream to judging body space. Exp Brain Res. 2011;212:563–574. doi: 10.1007/s00221-011-2765-1. [DOI] [PubMed] [Google Scholar]
- [66].Anema H.A., van Zandvoorta M.J.E., de Haan E.H.F., Kappelle L.J., de Kort P.L.M., Jansen B.P.W., et al. A double dissociation between somatosensory processing for perception and action. Neuropsychologia. 2009;47(6):1615–1620. doi: 10.1016/j.neuropsychologia.2008.11.001. [DOI] [PubMed] [Google Scholar]
- [67].Berlucchi G., Aglioti S. The body in the brain revisited. Exp Brain Res. 2010;200:25–35. doi: 10.1007/s00221-009-1970-7. [DOI] [PubMed] [Google Scholar]
- [68].Tubaldi F., Ansuini C., Tirindelli R., Castiello U. The grasping side of odours. PLoS One. 2008;3(3):e1795. doi: 10.1371/journal.pone.0001795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [69].Wang Q.X., Gao E.Q., Burkhalter A. Gateways of ventral and dorsal streams in mouse visual cortex. J Neurosci. 2011;31(5):1905–1918. doi: 10.1523/JNEUROSCI.3488-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [70].Tankus A., Fried I. Visuomotor coordination and motor representation by human temporal lobe neurons. J Cogn Neurosci. 2012;24(3):600–610. doi: 10.1162/jocn_a_00160. [DOI] [PubMed] [Google Scholar]
- [71].Kolster H., Peeters R., Orban G.A. The retinotopic organization of the human middle temporal area MT/V5 and its cortical neighbors. J Neurosci. 2010;30(29):9801–9820. doi: 10.1523/JNEUROSCI.2069-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [72].Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends Cogn Sci. 2000;4(6):223–233. doi: 10.1016/S1364-6613(00)01482-0. [DOI] [PubMed] [Google Scholar]