Abstract
This study demonstrates the ability of blind (previously sighted) and blindfolded (sighted) subjects in reconstructing and identifying a number of visual targets transformed into equivalent musical representations. Visual images are deconstructed through a process which selectively segregates different features of the image into separate packages. These are then encoded in sound and presented as a polyphonic musical melody which resembles a Baroque fugue with many voices, allowing subjects to analyse the component voices selectively in combination, or separately in sequence, in a manner which allows a subject to patch together and bind the different features of the object mentally into a mental percept of a single recognizable entity. The visual targets used in this study included a variety of geometrical figures, simple high-contrast line drawings of man-made objects, natural and urban scenes, etc., translated into sound and presented to the subject in polyphonic musical form.
Full Text
The Full Text of this article is available as a PDF (198.7 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Barlow H. B. Single units and sensation: a neuron doctrine for perceptual psychology? Perception. 1972;1(4):371–394. doi: 10.1068/p010371. [DOI] [PubMed] [Google Scholar]
- Fink G. R., Halligan P. W., Marshall J. C., Frith C. D., Frackowiak R. S., Dolan R. J. Neural mechanisms involved in the processing of global and local aspects of hierarchically organized visual stimuli. Brain. 1997 Oct;120(Pt 10):1779–1791. doi: 10.1093/brain/120.10.1779. [DOI] [PubMed] [Google Scholar]
- Gregory R. L. Perceptions as hypotheses. Philos Trans R Soc Lond B Biol Sci. 1980 Jul 8;290(1038):181–197. doi: 10.1098/rstb.1980.0090. [DOI] [PubMed] [Google Scholar]
- Livingstone M. S., Hubel D. H. Anatomy and physiology of a color system in the primate visual cortex. J Neurosci. 1984 Jan;4(1):309–356. doi: 10.1523/JNEUROSCI.04-01-00309.1984. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mansur D. L., Blattner M. M., Joy K. I. Sound graphs: a numerical data analysis method for the blind. J Med Syst. 1985 Jun;9(3):163–174. doi: 10.1007/BF00996201. [DOI] [PubMed] [Google Scholar]
- Meijer P. B. An experimental system for auditory image representations. IEEE Trans Biomed Eng. 1992 Feb;39(2):112–121. doi: 10.1109/10.121642. [DOI] [PubMed] [Google Scholar]
- Stryker M. P. Neurobiology. Elements of visual perception. Nature. 1992 Nov 26;360(6402):301–302. doi: 10.1038/360301a0. [DOI] [PubMed] [Google Scholar]