Abstract
Blind (previously sighted) subjects are able to analyse, describe and graphically represent a number of high-contrast visual images translated into musical form de novo. We presented musical transforms of a random assortment of photographic images of objects and urban scenes to such subjects, a few of which depicted architectural and other landmarks that may be useful in navigating a route to a particular destination. Our blind subjects were able to use the sound representation to construct a conscious mental image that was revealed by their ability to depict a visual target by drawing it. We noted the similarity between the way the visual system integrates information from successive fixations to form a representation that is stable across eye movements and the way a succession of image frames (encoded in sound) which depict different portions of the image are integrated to form a seamless mental image. Finally, we discuss the profound resemblance between the way a professional musician carries out a structural analysis of a musical composition in order to relate its structure to the perception of musical form and the strategies used by our blind subjects in isolating structural features that collectively reveal the identity of visual form.
Full Text
The Full Text of this article is available as a PDF (791.0 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Biederman I. Recognition-by-components: a theory of human image understanding. Psychol Rev. 1987 Apr;94(2):115–147. doi: 10.1037/0033-295X.94.2.115. [DOI] [PubMed] [Google Scholar]
- Cronly-Dillon J., Persaud K., Gregory R. P. The perception of visual images encoded in musical form: a study in cross-modality information transfer. Proc Biol Sci. 1999 Dec 7;266(1436):2427–2433. doi: 10.1098/rspb.1999.0942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fink G. R., Halligan P. W., Marshall J. C., Frith C. D., Frackowiak R. S., Dolan R. J. Neural mechanisms involved in the processing of global and local aspects of hierarchically organized visual stimuli. Brain. 1997 Oct;120(Pt 10):1779–1791. doi: 10.1093/brain/120.10.1779. [DOI] [PubMed] [Google Scholar]
- Mansur D. L., Blattner M. M., Joy K. I. Sound graphs: a numerical data analysis method for the blind. J Med Syst. 1985 Jun;9(3):163–174. doi: 10.1007/BF00996201. [DOI] [PubMed] [Google Scholar]
- Meijer P. B. An experimental system for auditory image representations. IEEE Trans Biomed Eng. 1992 Feb;39(2):112–121. doi: 10.1109/10.121642. [DOI] [PubMed] [Google Scholar]
- Stryker M. P. Neurobiology. Elements of visual perception. Nature. 1992 Nov 26;360(6402):301–302. doi: 10.1038/360301a0. [DOI] [PubMed] [Google Scholar]
- Treisman A. Feature binding, attention and object perception. Philos Trans R Soc Lond B Biol Sci. 1998 Aug 29;353(1373):1295–1306. doi: 10.1098/rstb.1998.0284. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zeki S. M. Functional specialisation in the visual cortex of the rhesus monkey. Nature. 1978 Aug 3;274(5670):423–428. doi: 10.1038/274423a0. [DOI] [PubMed] [Google Scholar]