Skip to main content
PMC home page
Philosophical Transactions of the Royal Society B: Biological Sciences logoLink to Philosophical Transactions of the Royal Society B: Biological Sciences
. 1998 Aug 29;353(1373):1319–1331. doi: 10.1098/rstb.1998.0286

Cross-modal links in spatial attention.

J Driver 1, C Spence 1
PMCID: PMC1692335  PMID: 9770225

Abstract

A great deal is now known about the effects of spatial attention within individual sensory modalities, especially for vision and audition. However, there has been little previous study of possible cross-modal links in attention. Here, we review recent findings from our own experiments on this topic, which reveal extensive spatial links between the modalities. An irrelevant but salient event presented within touch, audition, or vision, can attract covert spatial attention in the other modalities (with the one exception that visual events do not attract auditory attention when saccades are prevented). By shifting receptors in one modality relative to another, the spatial coordinates of these cross-modal interactions can be examined. For instance, when a hand is placed in a new position, stimulation of it now draws visual attention to a correspondingly different location, although some aspects of attention do not spatially remap in this way. Cross-modal links are also evident in voluntary shifts of attention. When a person strongly expects a target in one modality (e.g. audition) to appear in a particular location, their judgements improve at that location not only for the expected modality but also for other modalities (e.g. vision), even if events in the latter modality are somewhat more likely elsewhere. Finally, some of our experiments suggest that information from different sensory modalities may be integrated preattentively, to produce the multimodal internal spatial representations in which attention can be directed. Such preattentive cross-modal integration can, in some cases, produce helpful illusions that increase the efficiency of selective attention in complex scenes.

Full Text

The Full Text of this article is available as a PDF (261.0 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Andersen R. A., Snyder L. H., Bradley D. C., Xing J. Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Annu Rev Neurosci. 1997;20:303–330. doi: 10.1146/annurev.neuro.20.1.303. [DOI] [PubMed] [Google Scholar]
  2. Buchtel H. A., Butter C. M. Spatial attentional shifts: implications for the role of polysensory mechanisms. Neuropsychologia. 1988;26(4):499–509. doi: 10.1016/0028-3932(88)90107-8. [DOI] [PubMed] [Google Scholar]
  3. Butter C. M., Buchtel H. A., Santucci R. Spatial attentional shifts: further evidence for the role of polysensory mechanisms using visual and tactile stimuli. Neuropsychologia. 1989;27(10):1231–1240. doi: 10.1016/0028-3932(89)90035-3. [DOI] [PubMed] [Google Scholar]
  4. Corbetta M., Miezin F. M., Shulman G. L., Petersen S. E. A PET study of visuospatial attention. J Neurosci. 1993 Mar;13(3):1202–1226. doi: 10.1523/JNEUROSCI.13-03-01202.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Driver J. Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature. 1996 May 2;381(6577):66–68. doi: 10.1038/381066a0. [DOI] [PubMed] [Google Scholar]
  6. Driver J., Mattingley J. B. Selective attention in humans: normality and pathology. Curr Opin Neurobiol. 1995 Apr;5(2):191–197. doi: 10.1016/0959-4388(95)80026-3. [DOI] [PubMed] [Google Scholar]
  7. Farah M. J., Wong A. B., Monheit M. A., Morrow L. A. Parietal lobe mechanisms of spatial attention: modality-specific or supramodal? Neuropsychologia. 1989;27(4):461–470. doi: 10.1016/0028-3932(89)90051-1. [DOI] [PubMed] [Google Scholar]
  8. Graziano M. S., Gross C. G. A bimodal map of space: somatosensory receptive fields in the macaque putamen with corresponding visual receptive fields. Exp Brain Res. 1993;97(1):96–109. doi: 10.1007/BF00228820. [DOI] [PubMed] [Google Scholar]
  9. Groh J. M., Sparks D. L. Saccades to somatosensory targets. I. behavioral characteristics. J Neurophysiol. 1996 Jan;75(1):412–427. doi: 10.1152/jn.1996.75.1.412. [DOI] [PubMed] [Google Scholar]
  10. Groh J. M., Sparks D. L. Saccades to somatosensory targets. III. eye-position-dependent somatosensory activity in primate superior colliculus. J Neurophysiol. 1996 Jan;75(1):439–453. doi: 10.1152/jn.1996.75.1.439. [DOI] [PubMed] [Google Scholar]
  11. Jay M. F., Sparks D. L. Auditory receptive fields in primate superior colliculus shift with changes in eye position. Nature. 1984 May 24;309(5966):345–347. doi: 10.1038/309345a0. [DOI] [PubMed] [Google Scholar]
  12. Kustov A. A., Robinson D. L. Shared neural control of attentional shifts and eye movements. Nature. 1996 Nov 7;384(6604):74–77. doi: 10.1038/384074a0. [DOI] [PubMed] [Google Scholar]
  13. Ladavas E. Is the hemispatial deficit produced by right parietal lobe damage associated with retinal or gravitational coordinates? Brain. 1987 Feb;110(Pt 1):167–180. doi: 10.1093/brain/110.1.167. [DOI] [PubMed] [Google Scholar]
  14. Mattingley J. B., Driver J., Beschin N., Robertson I. H. Attentional competition between modalities: extinction between touch and vision after right hemisphere damage. Neuropsychologia. 1997 Jun;35(6):867–880. doi: 10.1016/s0028-3932(97)00008-0. [DOI] [PubMed] [Google Scholar]
  15. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature. 1976 Dec 23;264(5588):746–748. doi: 10.1038/264746a0. [DOI] [PubMed] [Google Scholar]
  16. Moran J., Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science. 1985 Aug 23;229(4715):782–784. doi: 10.1126/science.4023713. [DOI] [PubMed] [Google Scholar]
  17. Reisberg D. Looking where you listen: visual cues and auditory attention. Acta Psychol (Amst) 1978 Jul;42(4):331–341. doi: 10.1016/0001-6918(78)90007-0. [DOI] [PubMed] [Google Scholar]
  18. Reuter-Lorenz P. A., Jha A. P., Rosenquist J. N. What is inhibited in inhibition of return? J Exp Psychol Hum Percept Perform. 1996 Apr;22(2):367–378. doi: 10.1037//0096-1523.22.2.367. [DOI] [PubMed] [Google Scholar]
  19. Rizzolatti G., Camarda R., Grupp L. A., Pisa M. Inhibitory effect of remote visual stimuli on visual responses of cat superior colliculus: spatial and temporal factors. J Neurophysiol. 1974 Nov;37(6):1262–1275. doi: 10.1152/jn.1974.37.6.1262. [DOI] [PubMed] [Google Scholar]
  20. Spence C., Driver J. Audiovisual links in endogenous covert spatial attention. J Exp Psychol Hum Percept Perform. 1996 Aug;22(4):1005–1030. doi: 10.1037//0096-1523.22.4.1005. [DOI] [PubMed] [Google Scholar]
  21. Spence C., Driver J. Audiovisual links in exogenous covert spatial orienting. Percept Psychophys. 1997 Jan;59(1):1–22. doi: 10.3758/bf03206843. [DOI] [PubMed] [Google Scholar]
  22. Spence C., Driver J. Auditory and audiovisual inhibition of return. Percept Psychophys. 1998 Jan;60(1):125–139. doi: 10.3758/bf03211923. [DOI] [PubMed] [Google Scholar]
  23. Spence C., Driver J. Inhibition of return following an auditory cue. The role of central reorienting events. Exp Brain Res. 1998 Feb;118(3):352–360. doi: 10.1007/s002210050289. [DOI] [PubMed] [Google Scholar]
  24. Stricanne B., Andersen R. A., Mazzoni P. Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP. J Neurophysiol. 1996 Sep;76(3):2071–2076. doi: 10.1152/jn.1996.76.3.2071. [DOI] [PubMed] [Google Scholar]
  25. TREISMAN A. M. THE EFFECT OF IRRELEVANT MATERIAL ON THE EFFICIENCY OF SELECTIVE LISTENING. Am J Psychol. 1964 Dec;77:533–546. [PubMed] [Google Scholar]
  26. Tassinari G., Campara D. Consequences of covert orienting to non-informative stimuli of different modalities: a unitary mechanism? Neuropsychologia. 1996 Mar;34(3):235–245. doi: 10.1016/0028-3932(95)00085-2. [DOI] [PubMed] [Google Scholar]
  27. Treisman A. M., Gelade G. A feature-integration theory of attention. Cogn Psychol. 1980 Jan;12(1):97–136. doi: 10.1016/0010-0285(80)90005-5. [DOI] [PubMed] [Google Scholar]
  28. Ward L. M. Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Can J Exp Psychol. 1994 Jun;48(2):242–259. doi: 10.1037/1196-1961.48.2.242. [DOI] [PubMed] [Google Scholar]
  29. Wurtz R. H., Richmond B. J., Judge S. J. Vision during saccadic eye movements. III. Visual interactions in monkey superior colliculus. J Neurophysiol. 1980 Apr;43(4):1168–1181. doi: 10.1152/jn.1980.43.4.1168. [DOI] [PubMed] [Google Scholar]
  30. Yao L., Peck C. K. Saccadic eye movements to visual and auditory targets. Exp Brain Res. 1997 Jun;115(1):25–34. doi: 10.1007/pl00005682. [DOI] [PubMed] [Google Scholar]

Articles from Philosophical Transactions of the Royal Society B: Biological Sciences are provided here courtesy of The Royal Society

RESOURCES