Skip to main content
The Journal of Neuroscience logoLink to The Journal of Neuroscience
. 2006 Nov 15;26(46):11844–11849. doi: 10.1523/JNEUROSCI.3295-06.2006

The Development of Cortical Multisensory Integration

Mark T Wallace 1,, Brian N Carriere 2, Thomas J Perrault Jr 2, J William Vaughan 2, Barry E Stein 2
PMCID: PMC6674880  PMID: 17108157

Abstract

Although there are many perceptual theories that posit particular maturational profiles in higher-order (i.e., cortical) multisensory regions, our knowledge of multisensory development is primarily derived from studies of a midbrain structure, the superior colliculus. Therefore, the present study examined the maturation of multisensory processes in an area of cat association cortex [i.e., the anterior ectosylvian sulcus (AES)] and found that these processes are rudimentary during early postnatal life and develop only gradually thereafter. The AES comprises separate visual, auditory, and somatosensory regions, along with many multisensory neurons at the intervening borders between them. During early life, sensory responsiveness in AES appears in an orderly sequence. Somatosensory neurons are present at 4 weeks of age and are followed by auditory and multisensory (somatosensory–auditory) neurons. Visual neurons and visually responsive multisensory neurons are first seen at 12 weeks of age. The earliest multisensory neurons are strikingly immature, lacking the ability to synthesize the cross-modal information they receive. With postnatal development, multisensory integrative capacity matures. The delayed maturation of multisensory neurons and multisensory integration in AES suggests that the higher-order processes dependent on these circuits appear comparatively late in ontogeny.

Keywords: cross-modal, anterior ectosylvian sulcus, cat, maturation, auditory, somatosensory

Introduction

It is difficult to overestimate the magnitude and novelty of the environmental shift and the new behavioral demands that an animal experiences after birth. In altricial species such as the cat, these potential difficulties are minimized by an attentive mother who takes on much of the responsibility for protecting her offspring and initiating feeding. However, as the neonate matures, it spends more time away from the mother and must begin taking on increasing responsibility in dealing with environmental challenges (Rosenblatt et al., 1969). This gradual transition toward independence almost certainly depends on the brain developing the ability to use sensory information from multiple modalities to initiate adaptive behaviors.

Critical among these developing behavioral capabilities are sensorimotor transformations such as those involving the midbrain superior colliculus (SC). The maturation of these behaviors has been well documented (Stein and Meredith, 1993) and follows a characteristic chronology with somatosensory responses appearing before birth (Stein et al., 1973), facilitating later orientation to the nipple (Larson and Stein, 1984). These are then followed by the appearance of auditory and then visual responsiveness during postnatal life (Stein et al., 1973; Kao et al., 1994). Multisensory neurons follow a similar, albeit delayed, pattern. However, the earliest multisensory neurons are unable to combine the information they receive from different senses to amplify or degrade the physiological salience of environmental events (Wallace et al., 1997). This process appears only gradually during postnatal life and requires the functional maturation of corticotectal inputs, particularly those from the anterior ectosylvian sulcus (AES) (Wallace et al., 1992; Wallace and Stein, 2000) (see also Wallace et al., 1993; Jiang et al., 2001; Stein, 2005).

However, the importance of higher-order structures such as the AES in the development of the multisensory capabilities of the brain is not limited to the critical influences they provide to structures such as the SC but also includes their intrinsic multisensory processes. In the adult, the AES contains many multisensory neurons, and these integrate multisensory information much like SC neurons (Wallace et al., 1992). Undoubtedly, the maturation of multisensory integration at multiple brain levels is essential for the various sophisticated behavioral, perceptual, and emotive processes that coordinate and characterize complex behaviors. However, the time course and developmental antecedents for multisensory maturation in the cerebral cortex are unknown.

One reasonable inference that is in keeping with current concepts is that these cortical processes develop later in life than do those in the midbrain and require a considerable period of postnatal maturation. However, such an expectation is inconsistent with some theories of human development (Gibson, 1969; Bower, 1974; Marks, 1978) that require those multisensory integration processes underlying perception to be functional in newborns. In light of the impact of such theories [and those of opposing theories (for review, see Lewkowicz and Kraebel, 2004; Lickliter and Bahrick, 2004)], the paucity of direct empirical information in any higher-order model system seems surprising. The intent of the present experiments was to use a well characterized multisensory cortical model system, the cat AES, to begin exploring this issue.

Materials and Methods

Procedures were performed in compliance with the Guide for the Care and Use of Laboratory Animals (National Institutes of Health publication 91-3207) at Wake Forest University, which is accredited by the American Association for Accreditation of Laboratory Animal Care. Details of surgery, stimulation, and data analyses are similar to those used previously, and additional methodological detail can be obtained from Wallace et al. (1993) and Wallace and Stein (1997).

General surgical procedures.

Cats at five developmental stages (4, 8, 12, 16, and 20 postnatal weeks) were prepared for electrophysiological recordings. The earliest time point (i.e., 4 weeks) was chosen because preliminary experiments had revealed little sensory-evoked activity in AES at earlier ages. At the two earliest ages, the recordings were done using an acute preparation. At the older ages, animals were implanted with a head holder/recording chamber and recorded from using a semichronic paradigm (McHaffie and Stein, 1983).

For surgery, anesthesia was induced with a combination of ketamine hydrochloride (5–25 mg/kg, i.m.) and acepromazine maleate (0.2–0.4 mg/kg, i.m.), and surgical anesthesia was maintained with isofluorane (1.0–4.0%). For acute procedures, a craniotomy was made over the AES. A head holder was then attached to the skull using orthopedic screws and orthopedic cement to comfortably support the animal during recording without obstructing the face and ears. For semichronic procedures, a head holder/recording chamber was implanted over a craniotomy providing access to the SC. A second recording chamber was implanted over AES. The chambers were sealed, and the animal recovered from anesthesia. Analgesics and antibiotics were administered in consultation with veterinary staff. Recordings typically began 1 week later.

For recordings, anesthesia (ketamine hydrochloride, 10–25 mg/kg, i.m.; acepromazine malleate, 0.2 mg/kg, i.m.) was induced, and the animal was intubated and artificially respired. The saphenous vein was cannulated for the continuous administration of fluids (lactated Ringer's solution, 4–8 cc/h), anesthetics (ketamine hydrochloride, 4–8 mg · kg−1 · h−1), and neuromuscular blocking agent (pancuronium bromide, 0.1 mg · kg−1 · h−1). Core body temperature was monitored and maintained with a circulating hot water pad. Continuous vital sign monitoring (i.e., expiratory CO2, heart rate, and blood pressure) was used to ensure an adequate plane of anesthesia. The pupils were dilated (1% atropine sulfate), and contact lenses were applied to prevent corneal drying and to correct for refractive errors. The location of the optic disc was projected via reverse ophthalamoscopy onto a translucent 91-cm-diameter Plexiglas hemisphere.

Recordings.

Parylene-insulated tungsten electrodes (impedance, 2–5 MΩ at 1 kHz) were advanced into the AES with a hydraulic microdrive. Single-unit and multiunit neural activity was recorded and amplified, and discharges were routed to an oscilloscope, audio monitor, and computer for subsequent off-line analyses.

Stimulus delivery, receptive field mapping, and latency determination.

The electrode was advanced in 20 μm steps, and visual, auditory, and somatosensory search stimuli were presented. Visual stimuli consisted of moving and flashed spots and bars of light projected onto the Plexiglas hemisphere or the illumination of a light-emitting diode. If the neuron exhibited a visual response, its receptive field was mapped on the hemisphere using a hand-held pantoscope. Auditory stimuli consisted of broadband (i.e., pink) noise bursts delivered from speakers mounted on a hoop (radius, 30 cm) that could be rotated around the animal. Somatosensory stimuli consisted of manual deflections of the hair or skin using a camel's hair brush, blunt probe, or air puff. All receptive fields were transferred onto standard representations of visual, auditory, and somatosensory space (Stein and Meredith, 1993). Mean response latency was determined in response to 10 iterations of a stimulus 2× threshold intensity.

Multisensory tests and analyses.

A multisensory neuron was defined as one that responded to or was influenced by stimuli from more than one sensory modality (Stein and Meredith, 1993).

Once a multisensory neuron was identified, its sensory responses were quantitatively evaluated by randomly interleaving the single-modality and cross-modality stimuli at intervals of 10–15 s. The mean response to the stimulus combination was then statistically compared with the response to the most effective single-modality component stimulus (Student's t test, p < 0.05). Multisensory enhancement was defined as a significant increase in the number of impulses to the combined stimuli compared with the most effective single-modality stimulus. This is considered to be the most robust measure off multisensory integration, because it is evident in virtually all neurons showing this capacity [compared with multisensory depression, which is seen in only a subset of these neurons (Kadunce et al., 1997)]. The magnitude of multisensory response enhancement was calculated as follows: (CM − SMmax)/(SMmax) × 100 = % interaction, where CM is the mean number of impulses evoked by the combined-modality stimulus, and SMmax is the mean number of impulses evoked by the most effective single-modality stimulus.

Histological analyses.

The depth of each recorded neuron was noted in each electrode penetration, and electrolytic marking lesions were made to facilitate the reconstruction of neuronal locations. At the end of the final recording experiment, the animal was killed with sodium pentobarbital (100 mg/kg, i.v.) and perfused transcardially with saline, followed by Formalin. The midbrain was stereotaxically blocked, removed, and placed in sucrose overnight. Frozen coronal sections (50 μm thickness) were counterstained with neutral red. The outlines of the tissue and laminar boundaries were drawn, and electrode tracts and lesions were traced using a projection microscope. Measurements (after accounting for tissue shrinkage) were entered into a Macintosh PowerPC personal computer (Apple Computers, Cupertino, CA) via a digitizing pad.

To pool data across different animals at a given age, a template AES was created that most closely approximated the sulcal morphology in the largest number of cases at that age. Because penetrations were done while directly viewing the sulcus, this allowed a replotting of the penetrations onto the template AES using standard fiduciary landmarks as references.

Results

Sampling

Although there is substantial development of AES after birth, the sulcus is already well formed and clearly evident before the second week of postnatal life (Jiang et al., 2006). Recording experiments began with animals 4 weeks after birth and at 4 week intervals thereafter, resulting in sampling at 4 (n = 4), 8 (n = 4), 12 (n = 3), 16 (n = 3), and 20 (n = 2) weeks of age, as well as in adults (n = 3). The neuronal sampling strategy used electrode penetrations at 1 mm separations into the dorsal and ventral banks of AES. Because the caudalmost aspect of AES is internalized beneath the cortical mantle, electrode penetrations were extended 3 mm caudal to the rear end of the visible sulcus.

The appearance and maturation of sensory responses in AES

Somatosensory

At 4 postnatal weeks, the majority (64%, 37 of 58) of isolated AES neurons failed to respond to any of the visual, auditory, and/or somatosensory “search” stimuli. Most had modest spontaneous firing rates (mean, 2.9 ± 2.7 Hz) that, although higher, were not significantly different from those observed in adult animals (mean, 1.8 ± 1.3 Hz). Those neurons that did respond to sensory stimuli (36%, 21 of 58) were exclusively responsive to somatosensory stimuli (Fig. 1). These early somatosensory neurons were all cutaneous and low threshold, responding best to displacement of the guard hairs [although there was no systematic effort to eliminate the possibility that other hair receptors or even skin receptors were involved (Burgess, 1973)]. Brushing lightly in any direction across the hairs at rapid speeds (>50 mm/s) proved to be the most effective stimulus, and no obvious directional preferences were noted.

Figure 1.

Figure 1.

The developmental chronology of sensory and multisensory responses in AES cortex. A, Schematic drawing of the lateral surface of the cat cortex showing the location of the AES in the adult. Inset shows the modality distributions of neurons within the three major subdivisions of AES: SIV, FAES, and AEV. Colored circles represent penetrations in which only unisensory neurons (red, somatosensory; green, auditory; blue, visual) were encountered, and colored squares represent penetrations in which multisensory neurons [light blue, auditory–somatosensory (AS); yellow, visual–auditory (VA); orange, visual–somatosensory (VS); brown, visual–auditory–somatosensory (VAS)] were found. Data are from a single animal in which AES was extensively sampled. Pie graph shows the modality distributions in the adult and is pooled for the three animals. B, Emergence of sensory-responsive neuron types as a function of postnatal age. For details, see Results. Note that, in contrast to A, data has been pooled across animals to provide a more comprehensive view of the modality distributions in AES at the different ages (for how these data were merged, see Materials and Methods). C, Modality distributions in AES at the sampled ages. Pie graphs represent the pooled data from all animals at each age.

Compared with their adult counterparts, these early somatosensory neurons had longer response latencies, weaker responses to a suprathreshold stimulus, longer discharge train durations, and more rapid and stronger fatigue to repeated stimulus presentations (Table 1). Perhaps the most distinctive feature of these early somatosensory neurons was their large receptive fields, which typically encompassed the entire body surface (Fig. 2).

Table 1.

Maturation of various unisensory receptive field properties as a function of postnatal age in the AES cortex

4 weeks 8 weeks 12 weeks 16 weeks 20 weeks Adult
Somatosensory: latency (ms)# 41.8 ± 27.1* 28.8 ± 15.4* 23.7 ± 12.9* 20.0 ± 9.9 15.6 ± 8.4 16.2 ± 6.5
Somatosensory: discharge duration (ms)# 74.0 ± 37.4* 33.7 ± 22.2* 34.5 ± 20.8* 27.8 ± 13.8* 20.0 ± 13.1 17.9 ± 8.2
Somatosensory: response to 2× threshold stimulus (spikes/trial)# 2.11 ± 1.47* 2.69 ± 1.76* 4.27 ± 1.97 4.02 ± 2.05 4.93 ± 2.36 4.70 ± 1.59
Auditory: latency (ms)# 28.9 ± 14.3* 31.3 ± 14.1* 22.2 ± 9.8* 18.9 ± 9.1* 15.7 ± 6.8 13.7 ± 5.0
Auditory: discharge duration (ms)# 111.3 ± 40.0* 72.1 ± 34.7* 47.7 ± 23.3* 50.2 ± 23.6* 42.9 ± 19.0 35.4 ± 13.4
Auditory: response to 2× threshold stimulus (spikes/trial)# 1.46 ± 1.33* 1.82 ± 1.23* 4.00 ± 2.38 2.99 ± 1.78 3.51 ± 1.66 3.38 ± 1.50
Visual: latency (ms)# 154.0 ± 97.8* 127.3 ± 69.1* 133.0 ± 59.8* 114.3 ± 53.5* 101.8 ± 45.6* 81.1 ± 28.7
Visual: discharge duration (ms)# 208.4 ± 131.6* 136.3 ± 78.8* 110.8 ± 59.0* 99.4 ± 39.3* 59.8 ± 33.4* 78.3 ± 30.7
Visual: response to 2× threshold stimulus (spikes/trial)# 2.18 ± 1.60* 4.95 ± 2.77* 4.5 ± 2.13* 7.7 ± 3.43* 8.3 ± 3.72* 11.7 ± 4.11

Mean ± SD values are shown for each property at each of the sampled ages.

#ANOVA revealed a significant main effect of age.

*t test revealed significant difference (p < 0.05) from adult values.

Figure 2.

Figure 2.

Receptive fields of multisensory AES neurons decline in size as a function of postnatal age. A, Example neurons illustrate the shrinkage of receptive fields (RF) (colored shading) and the emergence of good receptive field overlap with maturation. B, The decline in mean receptive field size as a function of age. Note that all values are shown as a percentage of adult values. C, Average receptive field overlap as a function of age. Error bars in B and C show SDs.

Early somatosensory neurons were found in both the dorsal and ventral banks but were restricted to rostral regions in which the AES somatosensory division (SIV) is located (Fig. 1). In contrast, most (30 of 37) unresponsive neurons were located caudal to this somatosensory zone, in the presumptive visual (AEV) and auditory (FAES) subdivisions of the AES.

As detailed in Table 1 and Figure 2, as development progressed, there was a progressive maturation of somatosensory response properties. Response latencies and discharge durations shortened, response strength increased, and receptive fields contracted, until by 20 weeks of age most of these neuronal properties were indistinguishable from those in adults. However, despite a transient rise at 8 weeks, the absolute incidence of somatosensory neurons remained remarkably constant throughout development (Table 2). Of course, the relative proportion of somatosensory neurons decreased as the incidence of other sensory-responsive neuronal types increased (see below).

Table 2.

Incidence of the different neuronal types in AES as a function of postnatal age

Age (weeks postnatal) Unresp Som Aud Vis AS VS VA VAS Total
4 0.53 (37) 0.30 (21) 0.83 (58)
8 0.31 (24) 0.47 (36) 0.16 (12) 0.04 (3) 0.98 (75)
12 0.16 (14) 0.27 (24) 0.31 (28) 0.18 (16) 0.02 (2) 0.10 (9) 0.07 (6) 0.02 (2) 1.14 (101)
16 0.18 (12) 0.26 (17) 0.31 (20) 0.21 (13) 0.12 (7) 0.17 (11) 0.04 (3) 1.29 (83)
20 0.13 (6) 0.26 (12) 0.32 (15) 0.31 (14) 0.22 (10) 0.12 (6) 0.09 (4) 1.47 (67)
Adult 0.07 (12) 0.33 (57) 0.32 (55) 0.25 (43) 0.03 (5) 0.16 (29) 0.16 (28) 0.05 (10) 1.37 (239)

Numbers show the incidence of neurons per millimeter of electrode traverse. Numbers in parentheses show the n for each category. Unresp, Sensory unresponsive; Som, Somatosensory; Aud, auditory; Vis, visual; AS, auditory–somatosensory; VS, visual–somatosensory; VA, visual–auditory; VAS, visual–auditory–somatosensory.

Auditory

At 8 weeks of age, the first neurons with auditory responses were isolated in the dorsal bank of the caudal AES. At this age, somatosensory neurons represented ∼50% of the sampled neuronal population, auditory neurons 16%, and unresponsive neurons 34% (Fig. 1, Table 2). No visually responsive neurons were present at this age. These early auditory AES neurons had immature response properties: their “receptive fields” were typically omnidirectional (Fig. 2), and they had long response latencies, prolonged discharge trains, weaker responses, and were readily fatigued by repeated stimulus presentation (Table 1). Much like with their somatosensory counterparts, there was a gradual maturation of these response characteristics as development progressed. By 12 weeks of age, the incidence of auditory neurons was equivalent to that seen in the adult (Table 2). The spatial distribution of auditory neurons in the developing AES was consistent with the location of the adult FAES, being restricted to the caudal and dorsal aspects (Fig. 1).

Visual

The first visually responsive neurons were not apparent in AES until 12 weeks after birth. These neurons were primarily distributed in the ventral bank, caudal to the somatosensory representation and ventral to the auditory representation (Fig. 1). As was the case for early auditory and somatosensory neurons, early visual neurons in AES had immature response properties: their receptive fields were very large (Fig. 2), and they had long response latencies, prolonged discharge trains, less vigorous responses, and readily fatigued to repeated stimulus presentations (Table 1). As the animals matured, these response properties became more adult like (Table 1), but, unlike for the somatosensory and auditory populations, some immature properties remained even at the oldest developmental age examined (i.e., 20 weeks). After their appearance, the incidence of visual neurons changes little with age (Table 2).

Multisensory

The first multisensory neurons were encountered at 8 weeks of age and reflected the two modalities present in AES at this time. These auditory–somatosensory neurons were primarily confined to the dorsal bank of the AES between the major domains of somatosensory and auditory neurons. The first visually responsive multisensory neurons were evident at 12 postnatal weeks, coincident with the age at which the first visual responses were seen. Surprisingly, at this age, visual-responsive multisensory neurons already represented the majority of the multisensory AES population (Fig. 1, Table 2). The incidence of multisensory neurons continued to rise at 16 and 20 postnatal weeks, and, by 20 weeks, they were similar in incidence to the adult. It is interesting to note that several subsets of the multisensory population were of higher incidence at the 20 week time point than in the adult (i.e., visual–somatosensory and visual–somatosensory–auditory neurons). Whether this difference was attributable simply to the normal variability in these measures or whether it reflects a true exuberance in these multisensory neuronal types awaits additional investigation.

Early visually responsive multisensory neurons were preferentially located between the major unisensory domains and reflected the modalities represented in these neighboring cortices. The unisensory response properties (e.g., latency, response duration, etc.) of these neonatal multisensory neurons were indistinguishable from their unisensory counterparts at each age. Consequently, the data from both populations have been pooled in the analyses (i.e., Table 1).

The maturation of multisensory integration

Unlike their adult counterparts, early multisensory neurons were unable to integrate their different sensory inputs to enhance their responses. Rather, combined stimulus presentation resulted in responses that were statistically indistinguishable from those to the most effective stimulus component. This is readily evident in the somatosensory–auditory neuron illustrated in Figure 3A, which was recorded at the earliest age at which multisensory neurons were found (i.e., 8 weeks). Multisensory integration was not observed in these earliest neurons despite systematic manipulations of the spatial and temporal features of the stimuli, as well as their relative effectiveness. A similar failure to integrate was observed in the earliest visual–nonvisual multisensory neurons.

Figure 3.

Figure 3.

Multisensory integration is absent in the earliest AES neurons and appears and matures during postnatal life. A, Shown at the top are the receptive fields (shading) and stimulus locations (icons) used in sensory testing of this auditory–somatosensory AES neuron in an 8-week-old animal. Rasters and peristimulus time histograms show the neuron responses to somatosensory (S), auditory (A), and combined (SA) stimulation. Bar graph at the right summarizes these responses and shows the lack of any multisensory interaction. Scale bar at the bottom of the histograms represents 100 ms. B, Multisensory integration in a visual–auditory neuron at 20 weeks of age. A, Auditory stimulation; V, visual stimulation; VA, combined visual–auditory stimulation. Conventions are the same as in A. *p < 0.01, t test. C, Growth in the integrating multisensory population as a function of age. D, As soon as it appears (i.e., at 12 weeks), multisensory integration is of similar magnitude to the adult. Error bars show the SDs.

Later in development, however, neurons exhibited this capacity (Fig. 3B). Paralleling unisensory maturation, the increasing incidence of neurons capable of multisensory integration in AES followed a gradual developmental progression (Fig. 3C). However, the appearance of multisensory integration in any given AES neuron appeared to be quite abrupt, in that the magnitude of the response enhancements evident in the earliest neurons capable of this process was indistinguishable from that found in the adult (Fig. 3D).

Discussion

The present results reveal a sequential and sensory-specific maturation of AES during postnatal life. The unisensory chronology was one in which the earliest sensory-responsive neurons (4 weeks) were somatosensory, followed by auditory-responsive neurons at 8 weeks and then visually responsive neurons at 12 weeks. This unisensory developmental sequence was predictive of the multisensory chronology, with somatosensory–auditory neurons appearing coincident with the appearance of unisensory auditory neurons and visually responsive multisensory neurons appearing coincident with the appearance of unisensory visual neurons. The appearance and distribution of the different neuronal types in AES was spatially restricted and closely followed the adult functional divisions of AES, with the SIV (Clemo and Stein, 1982, 1983) developing first, the FAES (Clarey and Irvine, 1986) developing second, and the AEV (Mucke et al., 1982; Olson and Graybiel, 1987) developing last.

Adult multisensory AES neurons are preferentially concentrated at the transitions between its unisensory subdivisions (Wallace et al., 1992) (but see Jiang et al., 1994). Such a spatial organization was not violated during development, perhaps because this fundamental feature of cortical organization (Barth et al., 1993; Wallace et al., 2004a) (but see Ghazanfar and Schroeder, 2006) is established even before the networks are responsive to sensory stimuli.

The sensory chronology of AES appears to follow a pattern closely paralleling that found in its major subcortical target structure, the SC (Stein et al., 1973). This midbrain structure plays a central role in the transformation of sensory signals into premotor commands (Sparks, 1986; Stein and Meredith, 1993) and depends on AES for its ability to integrate cross-modal inputs to amplify its sensory responses and the behaviors that depend on them (Stein et al., 1989; Wallace et al., 1993; Wilkinson et al., 1996; Wallace and Stein, 2000; Jiang et al., 2001, 2002, 2006). Finally, much like the SC (Wallace and Stein, 1997), the appearance of the amplified multisensory integrative product in any given AES neuron appeared to be an all-or-none event. Once present, and regardless of age, it was indistinguishable from the adult. These parallel sensory chronologies are likely to be independent of interconnections between these regions, because the sensory chronology in the SC is already well established before the functional maturation of AES–SC influences (Wallace and Stein, 2000). Rather, they are likely to reflect a general chronology in sensory development (Gottlieb, 1971). Nonetheless, it remains possible that there is a dynamic developmental interplay between the SC and the AES that is important in shaping the maturation of each of these (multi)sensory representations. Anatomical evidence suggests that AES–SC connectivity is undergoing substantial changes in early postnatal life and may form the substrate for these interactions (McHaffie et al., 1988).

However, the maturational delay between AES and SC conforms to that interval when AES inputs begin influencing the multisensory integrative capabilities of SC neurons. Thus, the AES appears to coordinate the maturation of multisensory capabilities in its intrinsic neurons, presumably involved in higher-order functions, with those of its target neurons in the SC through which it controls orientation behaviors (Wallace and Stein, 2000; Jiang et al., 2006). Furthermore, it appears to exercise this coordination late in the period during which cross-modal experiences critical for multisensory integration are acquired (Wallace et al., 2004b; Wallace and Stein, 2006).

Outside of its role in gating subcortical multisensory processing, the behavioral and perceptual functions mediated by AES remain elusive. Although there is some evidence suggesting that AES may be important for the perception of visual stimulus motion (Scannell et al., 1996; Nagy et al., 2003) and sound source localization (Middlebrooks et al., 1998; Furukawa et al., 2000), more work is needed to determine its behavioral and/or perceptual roles.

It is interesting to note that the present data are inconsistent with those theories of multisensory integration that require a newborn nervous system already endowed with functional connections between sensory representations and capable of multisensory integration (Gibson, 1969; Bower, 1974; Marks, 1978). They are more consistent with those positing a gradual and successive recruitment of sensory functions at different levels of the neuraxis (Lewkowicz and Kraebel, 2004; Lickliter and Bahrick, 2004) and the gradual acquisition of intersensory capabilities that depend on the integration of cross-modal cues (Piaget, 1952; Birch and Lefford, 1963).

Footnotes

This work was supported by National Institutes of Health Grants MH 63861 and NS 36916. We thank Nancy London for her editorial assistance.

References

  1. Barth DS, Kithas J, Di S. Anatomic organization of evoked potentials in rat parietotemporal cortex: somatosensory and auditory responses. J Neurophysiol. 1993;69:1837–1849. doi: 10.1152/jn.1993.69.6.1837. [DOI] [PubMed] [Google Scholar]
  2. Birch H, Lefford A. Intersensory development in children. Monogr Soc Res Child Dev. 1963;28:1–47. [PubMed] [Google Scholar]
  3. Bower TGR. Development in infancy. San Francisco: Freeman; 1974. [Google Scholar]
  4. Burgess PR. Cutaneous mechanoreceptors. In: Carterette EC, Friedman MP, editors. Handbook of perception. New York: Academic; 1973. pp. 219–249. [Google Scholar]
  5. Clarey JC, Irvine DR. Auditory response properties of neurons in the anterior ectosylvian sulcus of the cat. Brain Res. 1986;386:12–19. doi: 10.1016/0006-8993(86)90136-8. [DOI] [PubMed] [Google Scholar]
  6. Clemo HR, Stein BE. Somatosensory cortex: a “new” somatotopic representation. Brain Res. 1982;235:162–168. doi: 10.1016/0006-8993(82)90207-4. [DOI] [PubMed] [Google Scholar]
  7. Clemo HR, Stein BE. Organization of a fourth somatosensory area of cortex in cat. J Neurophysiol. 1983;50:910–925. doi: 10.1152/jn.1983.50.4.910. [DOI] [PubMed] [Google Scholar]
  8. Furukawa S, Xu L, Middlebrooks JC. Coding of sound-source location by ensembles of cortical neurons. J Neurosci. 2000;20:1216–1228. doi: 10.1523/JNEUROSCI.20-03-01216.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Ghazanfar AA, Schroeder CE. Is neocortex essentially multisensory? Trends Cogn Sci. 2006;10:278–285. doi: 10.1016/j.tics.2006.04.008. [DOI] [PubMed] [Google Scholar]
  10. Gibson EJ. Principles of perceptual learning and development. Englewood Cliffs, NJ: Prentice Hall; 1969. [Google Scholar]
  11. Gottlieb G. Ontogenesis of sensory function in birds and mammals. In: The biopsychology of development (Tobach E, Aronson LR, Shaw E, eds), pp 67–128. New York: Academic; 1971. [Google Scholar]
  12. Jiang H, Lepore F, Ptito M, Guillemot JP. Sensory modality distribution in the anterior ectosylvian cortex (AEC) of cats. Exp Brain Res. 1994;97:404–414. doi: 10.1007/BF00241534. [DOI] [PubMed] [Google Scholar]
  13. Jiang W, Wallace MT, Jiang H, Vaughan JW, Stein BE. Two cortical areas mediate multisensory integration in superior colliculus neurons. J Neurophysiol. 2001;85:506–522. doi: 10.1152/jn.2001.85.2.506. [DOI] [PubMed] [Google Scholar]
  14. Jiang W, Jiang H, Stein BE. Two corticotectal areas facilitate multisensory orientation behavior. J Cogn Neurosci. 2002;14:1240–1255. doi: 10.1162/089892902760807230. [DOI] [PubMed] [Google Scholar]
  15. Jiang W, Jiang H, Stein BE. Neonatal cortical ablation disrupts multisensory development in superior colliculus. J Neurophysiol. 2006;95:1380–1396. doi: 10.1152/jn.00880.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Kadunce DC, Vaughan JW, Wallace MT, Benedek G, Stein BE. Mechanisms of within- and cross-modality suppression in the superior colliculus. J Neurophysiol. 1997;78:2834–2847. doi: 10.1152/jn.1997.78.6.2834. [DOI] [PubMed] [Google Scholar]
  17. Kao CQ, McHaffie JG, Meredith MA, Stein BE. Functional development of a central visual map in cat. J Neurophysiol. 1994;72:266–272. doi: 10.1152/jn.1994.72.1.266. [DOI] [PubMed] [Google Scholar]
  18. Larson MA, Stein BE. The use of tactile and olfactory cues in neonatal orientation and localization of the nipple. Dev Psychobiol. 1984;17:423–436. doi: 10.1002/dev.420170408. [DOI] [PubMed] [Google Scholar]
  19. Lewkowicz DJ, Kraebel KS. The value of multisensory redundancy in the development of intersensory perception. In: Calvert GA, Spence C, Stein BE, editors. The handbook of multisensory processes. Cambridge, MA: MIT; 2004. pp. 655–678. [Google Scholar]
  20. Lickliter R, Bahrick LE. Perceptual development and the origins of multisensory responsiveness. In: Calvert GA, Spence C, Stein BE, editors. The handbook of multisensory processes. Cambridge, MA: MIT; 2004. pp. 643–654. [Google Scholar]
  21. Marks LE. The unity of the senses: interrelations among the modalities. New York: Academic; 1978. [Google Scholar]
  22. McHaffie JG, Stein BE. A chronic headholder minimizing facial obstructions. Brain Res Bull. 1983;10:859–860. doi: 10.1016/0361-9230(83)90220-4. [DOI] [PubMed] [Google Scholar]
  23. McHaffie JG, Kruger L, Clemo HR, Stein BE. Corticothalamic and corticotectal somatosensory projections from the anterior ectosylvian sulcus (SIV cortex) in neonatal cats: an anatomical demonstration with HRP and 3H-leucine. J Comp Neurol. 1988;274:115–126. doi: 10.1002/cne.902740111. [DOI] [PubMed] [Google Scholar]
  24. Middlebrooks JC, Xu L, Eddins AC, Green DM. Codes for sound-source location in nontonotopic auditory cortex. J Neurophysiol. 1998;80:863–881. doi: 10.1152/jn.1998.80.2.863. [DOI] [PubMed] [Google Scholar]
  25. Mucke L, Norita M, Benedek G, Creutzfeldt O. Physiologic and anatomic investigation of a visual cortical area situated in the ventral bank of the anterior ectosylvian sulcus of the cat. Exp Brain Res. 1982;46:1–11. doi: 10.1007/BF00238092. [DOI] [PubMed] [Google Scholar]
  26. Nagy A, Eordegh G, Benedek G. Spatial and temporal visual properties of single neurons in the feline anterior ectosylvian visual area. Exp Brain Res. 2003;151:108–114. doi: 10.1007/s00221-003-1488-3. [DOI] [PubMed] [Google Scholar]
  27. Olson CR, Graybiel AM. Ectosylvian visual area of the cat: location, retinotopic organization, and connections. J Comp Neurol. 1987;261:277–294. doi: 10.1002/cne.902610209. [DOI] [PubMed] [Google Scholar]
  28. Piaget J. New York: International UP; 1952. The origins of intelligence in children. [Google Scholar]
  29. Rosenblatt JS, Turkewitz G, Schneirla TC. Development of home orientation in newly born kittens. Trans NY Acad Sci. 1969;31:231–250. doi: 10.1111/j.2164-0947.1969.tb02903.x. [DOI] [PubMed] [Google Scholar]
  30. Scannell JW, Sengpiel F, Tovee MJ, Benson PJ, Blakemore C, Young MP. Visual motion processing in the anterior ectosylvian sulcus of the cat. J Neurophysiol. 1996;76:895–907. doi: 10.1152/jn.1996.76.2.895. [DOI] [PubMed] [Google Scholar]
  31. Sparks DL. Translation of sensory signals into commands for control of saccadic eye movements: role of primate superior colliculus. Physiol Rev. 1986;66:118–171. doi: 10.1152/physrev.1986.66.1.118. [DOI] [PubMed] [Google Scholar]
  32. Stein BE. The development of a dialogue between cortex and midbrain to integrate multisensory information. Exp Brain Res. 2005;166:305–315. doi: 10.1007/s00221-005-2372-0. [DOI] [PubMed] [Google Scholar]
  33. Stein BE, Meredith MA. Cambridge, MA: MIT; 1993. The merging of the senses. [Google Scholar]
  34. Stein BE, Labos E, Kruger L. Sequence of changes in properties of neurons of superior colliculus of the kitten during maturation. J Neurophysiol. 1973;36:667–679. doi: 10.1152/jn.1973.36.4.667. [DOI] [PubMed] [Google Scholar]
  35. Stein BE, Meredith M, Huneycutt W, McDade L. Behavioral indices of multisensory integration: orientation to visual cues is affected by auditory stimuli. J Cogn Neurosci. 1989;1:12–24. doi: 10.1162/jocn.1989.1.1.12. [DOI] [PubMed] [Google Scholar]
  36. Wallace MT, Stein BE. Development of multisensory neurons and multisensory integration in cat superior colliculus. J Neurosci. 1997;17:2429–2444. doi: 10.1523/JNEUROSCI.17-07-02429.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Wallace MT, Stein BE. Onset of cross-modal synthesis in the neonatal superior colliculus is gated by the development of cortical influences. J Neurophysiol. 2000;83:3578–3582. doi: 10.1152/jn.2000.83.6.3578. [DOI] [PubMed] [Google Scholar]
  38. Wallace MT, Stein BE. Early experience determines how the senses will interact. J Neurophysiol. 2006 doi: 10.1152/jn.00497.2006. in press. [DOI] [PubMed] [Google Scholar]
  39. Wallace MT, Meredith MA, Stein BE. Integration of multiple sensory modalities in cat cortex. Exp Brain Res. 1992;91:484–488. doi: 10.1007/BF00227844. [DOI] [PubMed] [Google Scholar]
  40. Wallace MT, Meredith MA, Stein BE. Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus. J Neurophysiol. 1993;69:1797–1809. doi: 10.1152/jn.1993.69.6.1797. [DOI] [PubMed] [Google Scholar]
  41. Wallace MT, Ramachandran R, Stein BE. A revised view of sensory cortical parcellation. Proc Natl Acad Sci USA. 2004a;101:2167–2172. doi: 10.1073/pnas.0305697101. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Wallace MT, Perrault TJ, Jr, Hairston WD, Stein BE. Visual experience is necessary for the development of multisensory integration. J Neurosci. 2004b;24:9580–9584. doi: 10.1523/JNEUROSCI.2535-04.2004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Wilkinson LK, Meredith MA, Stein BE. The role of anterior ectosylvian cortex in cross-modality orientation and approach behavior. Exp Brain Res. 1996;112:1–10. doi: 10.1007/BF00227172. [DOI] [PubMed] [Google Scholar]

Articles from The Journal of Neuroscience are provided here courtesy of Society for Neuroscience

RESOURCES