Abstract
By definition, the region outside the classical receptive field (CRF) of a neuron in the visual cortex does not directly activate the cell. However, the response of a neuron can be influenced by stimulation of the surrounding area. In previous work, we showed that this influence is mainly suppressive and that it is generally limited to a local region outside the CRF. In the experiments reported here, we investigate the mechanisms of the suppressive effect. Our approach is to find the position of a grating patch that is most effective in suppressing the response of a cell. We then use a masking stimulus at different contrasts over the grating patch in an attempt to disinhibit the response. We find that suppressive effects may be partially or completely reversed by use of the masking stimulus. This disinhibition suggests that effects from outside the CRF may be local. Although they do not necessarily underlie the perceptual analysis of a figure–ground visual scene, they may provide a substrate for this process.
Keywords: visual cortex, receptive field, nonclassical receptive field, figure–ground, disinhibition, single cortical neurons
Behavioral tests of human subjects demonstrate that the spatial and temporal context of a visual stimulus may exert a clear influence on perception. For example, flanking contours can reduce stereoscopic acuity, and effects can be observed for both spatial and temporal parameters (Butler and Westheimer, 1978). Physiological studies also suggest the role of context in the responses of single neurons. Although the classical receptive field (CRF) is, by definition, the only area within which one can activate an individual fiber or neuron, the region beyond this area can modulate the response (for review, see Allman et al., 1985). Some cells have been reported to respond more vigorously when the stimulus patterns within and outside the CRF are perceptually different. These response modulations have been observed in neuronal activity associated with perceptual “pop-out” or “figure–ground” stimuli (Nothdurft, 1991;Knierim and van Essen, 1992; Lamme, 1995; Zipser et al., 1996; Kastner et al., 1997). In these cases, neuronal discharge is weaker when the CRF and surround areas (center and background) are perceptually identical. Reports have also been made of increased neuronal responses when perceptually relevant line segments are presented outside the CRF (Polat et al., 1998). Furthermore, reversible inactivation of MT suggests a possible feedback role in figure–ground segregation (Hupe et al., 1998).
The notion of contextual modulation of visual processing, based on figure–ground image analysis, is appealing. However, it is possible that simple local mechanisms, such as those involved in cross-orientation suppression (DeAngelis et al., 1992), may account for the reported findings. In a local mechanism, an inhibitory effect is solely dependent on stimuli in local regions generating the inhibitory signal. The strength of surround inhibition is strictly related to activation levels of cells with CRFs in the surround area. Regarding contextual effects in primary visual cortex, results of a recent study suggest that V1 neurons do not segregate figures from ground (Rossi et al., 2001).
Aside from perceptual implications, the nature of interactions between the CRF and surround areas is of primary interest. We conducted the experiments described here to investigate the characteristics of the local inhibitory surround effects that we identified previously (DeAngelis et al., 1994; Walker et al., 1999, 2000). Specifically, can the suppressive effects of regions outside the CRF be reversed by use of appropriate stimuli? We are also interested in potential mechanisms both within and outside the CRF that may account for interactive effects.
Our primary finding is as follows. When a cell is suppressed by stimulation outside the CRF, a reversal of this effect may be brought about by the addition of a masking stimulus positioned in the surrounding region of the CRF. This disinhibition can restore the response of the cell to the level obtained with optimal stimulation of the CRF by itself. We propose that the suppression from the surrounding region of the CRF is distinct from the contrast normalization process that is thought to be a primary mechanism within the CRF (Heeger, 1992;Carandini et al., 1997, 1999).
MATERIALS AND METHODS
Physiological preparation. Experiments were conducted using anesthetized, paralyzed cats. Before anesthesia, acepromazine maleate (0.5 mg/kg) and atropine sulfate (0.06 mg/kg) are injected subcutaneously to provide tranquilization and to suppress secretion, respectively. Anesthesia is induced and maintained during surgery with 2–4% isoflurane. Forepaw femoral veins are cannulated for intravenous infusion, a tracheal tube and a rectal thermometer are inserted, and electrocardiographic (ECG) leads and electroencephalographic (EEG) screw electrodes are placed. A craniotomy is performed around Horsley-Clarke coordinates P4L2, and the dura is carefully removed. Commercial insulated tungsten microelectrodes are positioned just above the surface of the cortex. The craniotomy is filled with agar and sealed with wax.
Animals are artificially respirated at ∼25 strokes/min with a mixture of N2O (70%) and O2(30%). Anesthesia and paralysis are maintained by intravenous infusion of a mixture of thiopental sodium (Pentothal, 2.5% solution; 1.4 mg · kg−1 · hr−1) and gallamine triethiodide (Flaxedil, 2% solution; 9.4 mg · kg−1 · hr−1), combined with a 5% dextrose and lactated Ringer's solution (0.5 ml · kg−1 · hr−1). Steady-state hydration is provided by a drip system through which lactated Ringer's solution is infused (10 ml · kg−1 · hr−1). Core body temperature is maintained near 38°C, and end-tidal CO2 at 4–4.5%. EEG, ECG, heart rate, core body temperature, and expired CO2 are monitored continuously. The pupils are dilated with 1% atropine sulfate, and nictitating membranes are retracted with 5% phenylephrine hydrochloride. Contact lenses (+2D) with 4 mm artificial pupils are placed on both corneas. The contact lenses are removed and cleaned periodically, and the clarity of the refractive media is checked with a direct ophthalmoscope. Chloromycetin (1.50 ml/d) is given prophylactically every 12 hr.
Experimental apparatus. Visual stimuli are displayed on a tangent screen in front of the animal or on two separate cathode ray tube (CRT) displays, allowing independent stimulation of each eye. A manually controlled joystick is used in preliminary tests of the receptive field (RF) to sweep a bar stimulus of variable size and orientation in any position and direction.
A visual stimulator generates images on each CRT display independently. The stimulator consists of a personal computer with two high-resolution graphics boards and runs custom software. The frame refresh rate of each CRT display is 76 Hz, and both displays are refreshed synchronously. Stimuli are delivered with a temporal resolution of one frame period (13.2 msec) by custom temporal modulation driver software. The spatial resolution is 1024 × 804 pixels. The usable portion of the display subtends an area of 28 × 22° (viewed at 57 cm), and the mean luminance at the front surface of each contact lens is 23 cd/m2.
For presentations requiring two superimposed gratings, the component gratings are displayed on alternate scan lines (line interleaving) to avoid any interaction of the two components resulting from the bandwidth limitations of the video amplifiers in the displays (Pelli and Zhang, 1991). This line interleaving method of producing a plaid results in an effective contrast that is 50% of the nonline interleaving contrast. Thus, an 80% contrast grating without line interleaving is a 40% contrast grating when presented with line interleaving.
Microelectrodes are inserted via a guide tube and advanced through the cortex by a piezoelectric micropositioner. Custom-made digital signal-processing software is used to discriminate individual action potentials. This software allows accurate discrimination of individual spikes from multiple cells. After discrimination, each action potential is recorded as a binary event, time stamped with 1 msec accuracy, and stored for analysis off-line.
Procedures. A cell is encountered, and the spike waveform is isolated. Location and approximate orientation preference of the CRF are determined. An interactive search program (DeAngelis et al., 1993) is then used to determine suitable parameters for a circular patch of drifting sinusoidal grating. The grating patch is presented on the CRT, and the size, orientation, and spatial frequency of the grating are adjusted by the experimenter to determine preferred values.
The subjective tests are followed by quantitative analysis of the CRF. Grating stimuli are presented monocularly for 4 sec at a time (temporal frequency is 2 Hz for all gratings) in blocks of randomly interleaved trials. The size of the stimulus for these initial presentations is typically 5–8° in diameter Each stimulus is presented at least four times, and successive presentations are separated by 3 sec, during which the animal views blank screens of the same mean luminance as the gratings. After presentation of a complete set of stimuli, the DC (mean rate) and first harmonic (at 2 Hz) components of the accumulated response are computed for each stimulus. Response amplitude is defined as the greater of the mean firing rate or the amplitude of the first harmonic of the response. Simple and complex cell designations are determined by classical criteria (Hubel and Wiesel, 1962) and by the ratio of the first harmonic and mean of the response to a drifting grating stimulus (Skottun et al., 1991).
Orientation tuning of the CRF is determined by use of a series of drifting grating stimuli, differing in orientation around the initial orientation estimate. Spatial frequency and size for this run are set to the initial values obtained using the search program. The peak of the resultant tuning curve is used as the optimal orientation for subsequent presentations. Preferred spatial frequency for the cell is similarly determined.
Optimal orientation, spatial frequency, and size for CRF stimulation were determined quantitatively for each cell from the preliminary runs. In this work, “optimal stimulus” is used to refer to a drifting grating with orientation, spatial frequency, and size parameters set to the values that elicit the greatest response from the cell. Contrast was set at an intermediate value that varied from cell to cell but was typically ∼30%. Sinusoidal gratings were drifted for 4 sec at a temporal frequency of 2 Hz. After the optimal stimulus was determined for each cell, the size of the CRF was estimated by presenting a drifting grating within a circularly bounded window of variable size. The resultant size-tuning curve yields an estimate of the spatial dimensions of the CRF and also the degree of surround suppression (Walker et al., 2000).
Spatiotemporal maps of the CRF were also obtained for some cells using either the reverse correlation (DeAngelis et al., 1993) or m-sequence (Sutter and Tran, 1992; Anzai et al., 1997) methods. These maps were used to verify the accuracy and reliability of the parameters obtained with grating stimuli. One particular advantage of these maps is that they provide very accurate information about the center and size of the CRF. In general, we find excellent agreement between the grating and noise measurements.
RESULTS
Results reported here come from a pool of multiprotocol experiments. For the current study, we completed 29 monoptic protocol runs from 24 cells (nine simple and 15 complex). From five cells, tests were run for left and for right eyes. These 24 cells were studied because they all exhibited some degree of surround suppression.
Experimental predictions based on alternative notions of RF surround organization are illustrated in Figure 1. In Figure 1A1, the CRF is stimulated with an optimal grating, causing a strong response from the cell. Predicted responses (action potentials) are depicted schematically by vertical lines under each RFicon. In A2, the cell is also stimulated by an optimal grating, but in this case, it covers the CRF plus the surround. The surround is inhibitory, and the response of the cell is therefore reduced compared with that inA1. In A3 andA4, gratings are presented outside the CRF at optimal and orthogonal orientations, respectively. The cell does not respond in either case. In A5, the region outside the CRF is covered by two gratings, one at an optimal orientation and a second at an orthogonal one. As before, these outer gratings do not drive the cell because they are not within the CRF. Because surround suppression is generally tuned to an orientation that matches the preferred value of the CRF (DeAngelis et al., 1992; Li and Li, 1994), the orthogonal grating (A4) is not likely to cause suppression. However, perceptually, the pair of orthogonal gratings constitutes a plaid pattern that is distinct from that of the grating within the CRF. It therefore constitutes a central figure (the optimal grating) against a plaid texture background. The figure–ground notion is that RF surrounds are required to differentiate between salient features of a scene. The figure of attention is presumed to activate cortical neurons selectively, whereas background components cause weak activity. Therefore, according to the figure–ground model of A5, the cell exhibits a strong response. The alternative model, which we designate “disinhibition,” also indicates a vigorous response. In this case, cells in the region outside the CRF are stimulated by the large grating of optimal orientation, and the activity in these “surround” cells is relayed to the “center” cell via inhibitory connections. However, the suppression is neutralized by the orthogonal grating attributable to cross-orientation suppression (Morrone et al., 1982; Bonds, 1989; DeAngelis et al., 1992; Walker et al., 1998). Cells contributing to surround suppression are therefore inactivated or disinhibited to some degree by the presence of the additional orthogonal grating. Therefore, the reduced suppression results in a strong response from the cell whose CRF is within the surround.
The conditions illustrated in Figure 1B are similar to those of Figure 1A, except that the stimuli outside the CRF are limited to a small region from which suppression of the cell has been localized instead of being presented in the entire surround. This configuration is of interest because many cells receive surround inhibition from a small localized area neighboring the CRF (Walker et al., 1999). In B1, the CRF is activated by an optimal grating. The grating is extended inB2 but only from one edge of the CRF. This suppresses the response of the cell as in the case of the full surround shown in Fig. A2. Grating patches outside the CRF, depicted in B3 andB4, do not activate the cell. InB5, a combination of stimuliB2 and B4, is depicted. The predicted response of the cell to an optimal grating in the CRF together with the surround patch is different for the figure–ground and disinhibition models. Because there is no salient figure–ground distinction, the response of the cell should be relatively weak. However, the disinhibition model predicts a strong response because the orthogonal grating patches outside the CRF should neutralize each other.
In Figure 1C1, an optimal grating fills the CRF and elicits a strong response. A large optimal grating (C2) covering the CRF and surround yields a relatively weaker response. If the cell has an asymmetrical surround as described previously (Walker et al., 1999), then a small portion of the surround can suppress the response to the same degree as that of the entire annulus (C3). A grating that is orthogonal to the optimal, positioned outside the CRF, has no effect (C4), and the cell does not respond. InC5, a combination of stimuli (C2 and C4), a large optimal grating covers the CRF and surround. In addition, a small orthogonal grating patch is positioned on one side of the surround. Assuming that stimulation of this region with an optimal grating causes suppression of the response, then the addition of an orthogonal (cross-orientation) patch should reverse the suppression. This effect is predicted by the disinhibition model, and, in this case, the cell should exhibit a strong response. However, in the figure–ground model, a poor response is predicted because only a small local patch of the surround is clearly different from the CRF and the “figure” (plaid) is outside the CRF in this case (Lamme, 1995).
Full-field stimulation and masking
Figure 2 shows responses from a complex cell (A) and two simple cells (B,C). Testing conditions include stimulation of the CRF alone (icon 1), the CRF plus surround (icon 2), and the CRF plus surround, which contains an orthogonal grating in addition to the optimal one to form a plaid (icon 3). The experiments were performed at seven or eight contrast levels for the orthogonal surround grating. With increased contrast of the orthogonal grating, the perceptual saliency of the plaid becomes stronger so that, when the contrasts are matched, the image attains a strong figure–ground appearance, as illustrated in icon 3. At the highest contrasts, the orthogonal grating dominates the surround, although the plaid is still apparent. Contrasts used for the optimal grating were 30% for the two cells shown in A and B and 20% for the cell given in C.
In general, the data show two trends. First, when the orthogonal surround grating is absent, or of low contrast, the cell responds well below the level obtained with center stimulation alone. This is an example of standard surround suppression. Second, when the contrast of the orthogonal grating equals or exceeds that of the optimal grating (Fig. 2, upward arrow on x-axis), the response increases, i.e., is disinhibited.
To explore a range of disinhibition effects, the tests were conducted using contrast levels for the CRF grating that elicited robust responses but which did not saturate. The resulting discharge rates were maintained during the multiple measurements. Generally, we used contrast levels of ∼30%. We refer to the response levels elicited in this manner as “optimal.” In fact, greater responses could be obtained in some cases using higher contrast gratings. Examples of the range of disinhibition that we observed are shown in Figure 2. For the complex cell shown in A, the response is fully disinhibited by the orthogonal grating at the highest contrasts. In other words, the response is equal to that for stimulation of the CRF alone. The net effect is slightly more than a doubling of the response compared with the full-field optimal grating. The simple cell shown in Bprovides an example of partial disinhibition. This cell is completely suppressed by the optimal surround stimulus. The disinhibition is robust, but the cell only recovers approximately half of the optimal response. The simple cell shown in C was tested through both the dominant and nondominant eyes. Strong suppression is observed through the dominant left eye, and minor disinhibition is seen. For the nondominant right eye, the disinhibition is approximately equivalent in terms of the change in spikes per second, but, because the response rate is much lower, the disinhibition provides a complete recovery of the optimal response for stimulation through that eye.
To summarize the results across the population of cells studied, each response is normalized to the response of the full-field optimal grating. By using this stimulus as the baseline, i.e., the cell is in a suppressed state, we determine the effect of the orthogonal grating. Figure 3 shows the population results for 29 data sets. In Figure 3A, the amount of change in response is given for each cell for different contrast levels of the orthogonal surround grating. These plots illustrate two general properties that are observed for nearly every cell. At low contrasts, the orthogonal grating has no effect, and responses remain suppressed. At moderate and high contrasts, the orthogonal grating has a clear disinhibition effect. For example, at 32% contrast, when the orthogonal and optimal gratings are of nearly equal strength in the surround, 23 of 29 cells show an increase in response relative to the suppressed state. At the highest contrast level, 64%, 26 of 29 cells respond above the suppressed baseline level. Table 1 shows all of the response increases and decreases at different contrast levels.
Table 1.
Contrast values | 1% | 2% | 4% | 8% | 16% | 32% | 50%* | 64% | 80% |
Number of cells with increased responses | 9 | 18 | 16 | 16 | 23 | 23 | 10 | 26 | 24 |
Number of cells with decreased responses | 11 | 11 | 13 | 13 | 6 | 6 | 2 | 3 | 5 |
Number of cells with ≥ doubling of response (%) | 0 of 20 | 0 of 29 | 0 of 29 | 1 of 29 | 2 of 29 | 4 of 29 | 0 of 12 | 7 of 29 | 12 of 29 |
(0%) | (0%) | (0%) | (3.4%) | (6.9%) | (13.8%) | (0%) | (24.1%) | (41.4%) |
indicates that the 50% stimulus was only used in the early phase of the experiment for 12 cells.
In Figure 3A, the median values of the population are indicated at each contrast level by the triangles (slightly shifted to the right for clarity). The median is plotted because it is a more conservative estimate of the effect than the mean. The mean indicates a larger effect, but it is heavily weighted by the cells with pronounced disinhibition. To compare the population distributions at various contrasts, the data at 1% contrast are used as the null conditions, and nonparametric sign-rank tests have been performed for all pairwise combinations. The distributions are not significantly different at the three lowest contrasts (p ≫ 0.05 for 2, 4, and 8%) but are different for the highest contrasts at high significance levels (p < 0.02 at 16%;p < 0.02 at 32%; p < 0.008 at 64%;p < 0.002 at 80%). These data demonstrate that the disinhibition effect can be very substantial. For our population, the addition of high contrast masking gratings results in a nearly doubling of the response of the median cell (1.89).
In Figure 3B, a histogram is given showing the number of cells with increased (open bars) or decreased (shaded bars) responses when an orthogonal grating of different contrasts is superimposed on the optimal grating in the surround region of the CRF. To convey an indication of the extent of these effects, we consider an arbitrary criterion as follows. Disinhibition that causes a doubling or greater of response strength is indicated in Table 1. In Figure 3C, the strength of suppression is plotted against the strength of disinhibition. A suppression index is used as a metric for suppression strength, and a disinhibition index is computed as a measure of disinhibition strength. The scatter plot is fit using linear regression and indicates that, to a first approximation, the effect of disinhibition is equivalent across all cells, regardless of the strength of surround suppression.
The robust effects described above are consistent with both figure–ground and disinhibition models because both predict stronger responses in the full surround configuration (Fig.1A5). These results demonstrate that a nonpreferred stimulus that does not drive the cell, when placed in a portion of the visual field that the cell does not respond to, causes the response of the cell to increase. In the figure–ground model, high-level feedback mechanisms are proposed to account for this effect (Zipser et al., 1996; Hupe et al., 1998). To further explore CRF and surround interactions and to differentiate between figure–ground and disinhibition models, we conducted tests in which only selected portions of the surround are stimulated.
Partial surround masking
In previous work, we determined that, for most cortical cells, a relatively small region outside the CRF is as effective in suppressing the response of a cell as an entire annulus (Walker et al., 1999). We therefore decided to see whether the specific small region outside the CRF can be disinhibited, as in the case of the full annulus. Figure4 illustrates disinhibition for a cell under two different surround configurations. In the first case (A), the cell was stimulated with a full-field (15° diameter) optimal grating covering the center and surround. As the graph shows, complete disinhibition of the response of the cell was obtained with this configuration. In the second case (B), the experiment was repeated, but with the orthogonal grating presented only to the suppressive portion of the surround. This suppressive portion was determined from previous surround mapping runs (Walker et al., 1999). All of the surround suppression for this cell arises from the bottom portion of the surround (see icon 3). Therefore, a second stimulus configuration was used for the disinhibition test, as shown inicon 4. The optimal grating covers the CRF and extends into the suppressive end. The orthogonal grating covers only the suppressive region. Again, complete disinhibition is found. This indicates clearly that it is not necessary to stimulate the entire surround to induce both surround suppression and disinhibition. It also shows that figure–ground saliency is not required to obtain the same effect as that for Figure 4A (for which figure–ground saliency is high). Note that, for both stimulus configurations, the response reached the level obtained with the optimal grating presented to the CRF alone.
To ensure that our surround stimulus was not directly driving the cell, we included the following control condition. On separate trials, an orthogonal grating was presented in the surround at the same contrasts as for the test conditions, with or without the optimal grating restricted to the CRF. This allowed us to examine the effect of the orthogonal grating by itself. In most cases, orthogonal gratings had no effect on the cells; they neither increased nor decreased the response at any contrast. In a few cases, the orthogonal grating caused suppression. Generally, this was attributable to an error in centering, and the suppression disappeared when the experiment was repeated with new center coordinates. However, in two cases, cells were suppressed by orthogonal surround stimuli and exhibited disinhibition when the orthogonal grating was combined with the optimal grating in the surround. For the stimulus configurations shown in Figure 4, the control condition had negligible effect on the response of the cell. The mean of the response to the control condition at all contrast levels is indicated by solid horizontal lines on the plots.
Figure 5 summarizes the results obtained when only a portion of the surround is masked with an orthogonal grating. In A, the normalized responses from two cells are plotted. Both of these cells were tested with a limited portion of the surround stimulated, based on detailed mapping (see icon 1). These cells display a clear disinhibition effect that exceeds that of the population median with full-field stimulation (open triangles). These results show that it is not necessary to stimulate the entire surround to get a pronounced effect. Furthermore, there does not need to be a figure–ground component in the image. The stimulus shown here does not convey a pop-out or figure–ground impression.
Another stimulus configuration was tested for three cells for which surround mapping revealed clear spatial asymmetries. We stimulated the entire center and surround with an optimal grating while placing an orthogonal grating over just the inhibitory portion of the surround (Fig. 5, icon 2). With this configuration, the small plaid region forms a locally prominent figure against the background of the large optimal grating. If response is modulated based on the context of the stimulus, the response of the cell should be decreased because the CRF lies in a portion of the image that corresponds to the background. Therefore, as the contrast (and perceptual saliency) of the orthogonal grating increases, the figure–ground model predicts no change in response or even an additional decrease. As the results in Figure5B demonstrate, this did not occur. On the contrary, disinhibition was observed for all three cells. For comparison, population data from full-field masking conditions are included (open triangles). These data suggest a simple local interaction process without a requirement for context-based images or higher-order feedback. The disinhibition model provides a parsimonious account of the data.
Facilitation or disinhibition?
The individual cells we studied exhibit varying degrees of disinhibition. Responses do not increase significantly beyond the optimal level for any of the examples shown. To see whether this trend is consistent across the population, we re-normalized the data to the responses obtained with the optimal gratings restricted to the CRF as shown in Figure 6A. Optimal responses were recorded in separate trials immediately after the main test trials, and some cells were lost before the complete set of control measurements were collected, so results for 13 cells are shown. In this plot, 1 represents the response to the optimal stimulus presented to the center alone. Therefore, at the lowest contrasts of the orthogonal grating, one sees the distribution of surround suppression across the population. For low contrasts, there is no change in the suppression. At the higher contrasts, the responses increase, as illustrated in previous figures. As shown in the population mean and median (Fig. 6B), there is a slight increase above 1 for the highest contrast level.
These results indicate that, although many cells are fully disinhibited, they do not generally respond much stronger than the level obtained with optimal center stimulation alone. The data shown in Figure 6B provide a clear demonstration of the disinhibition effect over the population, with only minor facilitation.
DISCUSSION
The main finding of this study is that surround suppression may be partially or completely reversed by appropriate stimuli. We found in previous work that nearly all influence from outside the CRF is inhibitory in nature (Walker et al., 1999, 2000). In the current study, we determined that this inhibition may be offset by a stimulus that, by itself, has no effect on the response of the cell. A grating patch that is orthogonal to the preferred orientation of the cell, and is positioned outside the CRF, does not influence the response of the cell. However, when placed over a grating patch of the preferred orientation to form an orthogonal grid, the combination reduces the inhibitory effect, partially or completely. This process of disinhibition may be accounted for by local neural connections, as described below.
Figure–ground segregation
Considerable interest has been raised by a possible perceptual application of CRF and surround organization. Specifically, it has been proposed that the segregation of a figure from a background is assisted by the suppressive region surrounding the CRF (Nothdurft, 1991;Lamme, 1995; Kastner et al., 1997). This is an appealing idea, but it is also difficult to interpret. The standard figure–ground pattern consists of a central patch of a given pattern that is surrounded by a different pattern, as in the case of the icon of Figure1A5. However, a looser definition could include adjoining patterns that are different, such as those illustrated by the icons in Figure1B5. Another potential difficulty is that figure–ground processing could occur in one or more of several cortical areas. Therefore, ruling out figure–ground segregation in V1, as reported recently (Rossi et al., 2001), does not eliminate the possibility that this function occurs in other cortical areas. Obviously, because it is a perceptual reality, figure–ground segregation must occur in one or more cortical areas.
The interactions we report in the current study may be accounted for by local processes that are not necessarily connected to perceptual events. For example, we find the same degree of suppression and disinhibition for surround–CRF interaction for a small patch of gratings as for a complete pattern that covers the entire circumference of the CRF. In the classical pattern, a figure is surrounded entirely by the surround. Unless, as noted above, one includes any adjacent pattern differences as a figure–ground pattern, our results may be accounted for on the basis of local events that are not necessarily connected to a perceptual process.
A neural mechanism for disinhibition
A neural circuit that could form the basis of a disinhibition process is illustrated in Figure 7. This model assumes a spatiotemporal convolution, followed by a contrast normalization process and a static output nonlinearity, as depicted within the rectangle of Figure 7 (Heeger, 1992; Carandini et al., 1997). We assume that this process is characteristic of all striate cortex RFs in the entire visual field. We also assume that, for certain cells, there is a subset of neurons with similar RF properties that serves as the basis of surround suppression for a given cell. The example in Figure 7 arbitrarily uses four cells in the surround pool. They are all spatially overlapping but displaced from the central RF, and all four cells prefer orientations near vertical, as does the cell in the center (DeAngelis et al., 1992). The cells in the surround could inhibit the center cell directly through monosynaptic inhibition or they could act through interneurons.
We assume a contrast normalization process for the CRF. Contrast normalization exhibits two prominent properties. First, it is divisive. Second, the signal that serves as the denominator in the division is proportional to the total contrast energy of the visual stimulus within a specified region of space (Heeger, 1992; Carandini et al., 1999). It has been suggested that the surround may act as an extension of the contrast normalization mechanism in the CRF (Cavanaugh et al., 1998). Consistent with this idea is the observation that, with increasing contrast of iso-oriented surround gratings, the contrast response function of the center shifts to the right on log coordinates (Cavanaugh et al., 1998). This is the expected result of a divisive operation or contrast normalization (Heeger, 1992; Cavanaugh et al., 1998; Carandini et al., 1999). In addition, iso-oriented surround suppression increases proportionately with contrast (Cavanaugh et al., 1998). This is also consistent with a normalization process. However, other aspects of surround suppression are not consistent with contrast normalization. For example, surround suppression is generally tuned to orientations and spatial frequencies that match the preferred values of the CRF (Nelson and Frost, 1978; DeAngelis et al., 1994; Li and Li, 1994), whereas contrast normalization in the CRF is presumed to pool over the entire range of orientations (Heeger, 1992). In addition, our current results suggest that the cells comprising the surround of the CRF are themselves subject to local broadband contrast normalization. When an orthogonal grating is added to the surround, the total contrast energy in the stimulus increases. However, contrary to the prediction of a general contrast normalization mechanism, our results show that most cells respond more vigorously to this added contrast energy. Considered together, these findings suggest that the center plus surround should not be considered as a pool for a combined contrast normalization.
The nature of influence from the surround
A fundamental question that must be addressed concerns the nature of the influence from the region beyond the CRF. Several reports suggest that surround stimulation can increase the response of the cell (Maffei and Fiorentini, 1976; Sillito et al., 1995; Levitt and Lund, 1997; Polat et al., 1998). This means that activation of the surround excites a cell to respond above the level obtained with optimal stimulation of the center. This has been reported to occur even for stimulation in the CRF with a grating that is orthogonal to the preferred orientation (Sillito et al., 1995).
In general, we observed very limited facilitation from the surround (Walker et al., 1999, 2000). We find that the surround modulates the excitation generated by stimulation of the CRF. In extensive tests, we found that apparent facilitation by stimulation of the surround is nearly always caused by faulty centering of the grating such that part of the stimulus is delivered to the CRF (Walker et al., 1999,2000).
It is important to distinguish the results of disinhibition that we report here from those of facilitation. In the case of disinhibition, increased response strength results from a withdrawal of inhibition. Another factor that could play a role in this process is tonic inhibition from cells whose RFs are in the surround. If a grating that is orthogonal to the optimal orientation silences the surround cells, then the source of tonic inhibition is removed, and this would increase the response to CRF stimulation.
An advantage of the plaid surround used in our current study is that the contrast energy of the optimal surround grating remains constant throughout the tests. The addition of the orthogonal grating simply adds contrast energy in another part of the spectrum. There is still sufficient contrast energy in the stimulus to activate surround suppression. The resultant disinhibition shows that responses of cells providing surround suppression are masked by the orthogonal grating.
Finally, it should be mentioned that the choice of a response reference frame can influence the interpretation of a given set of findings. In some figure–ground studies, the response to a full-field homogeneous texture stimulus is taken as the baseline (Lamme, 1995; Zipser et al., 1996). This means that the baseline response consists of excitation from the CRF and suppression from the surround. The overall result is that the baseline response is lower than that of the CRF alone. If the cell is then tested with texture restricted to the CRF, with or without texture in the surround, this could be interpreted as facilitation. An additional interpretation is that the facilitated response is attributable to a restricted stimulus, i.e., a figure, standing out as perceptually relevant against a background. If an alternative baseline is used consisting of stimulation of the CRF alone, then manipulations of the surround would not influence the response of the cell, except to reduce it.
Footnotes
This work was supported by National Eye Institute Research and CORE Grants EY01175 and EY3176.
Correspondence should be addressed to Ralph D. Freeman, 360 Minor Hall, University of California, Berkeley, Berkeley, CA 94720-2020. E-mail: freeman@neurovision.berkeley.edu.
G. A. Walker's present address: Guidant Corporation, 1525 O'Brien Drive, Menlo Park, CA 94025.
I. Ohzawa's present address: Department of Biophysical Engineering, Osaka University, 1-3 Machikaneyama, Toyonaka-shi, Osaka 560-8531, Japan.
REFERENCES
- 1.Allman J, Miezin F, McGuinness E. Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. Annu Rev Neurosci. 1985;8:407–430. doi: 10.1146/annurev.ne.08.030185.002203. [DOI] [PubMed] [Google Scholar]
- 2.Anzai A, Ohzawa I, Freeman RD. Neural mechanisms underlying binocular fusion and stereopsis: position vs. phase. Proc Natl Acad Sci USA. 1997;94:5438–5443. doi: 10.1073/pnas.94.10.5438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Bonds AB. Role of inhibition in the specification of orientation selectivity of cells in the cat striate cortex. Vis Neurosci. 1989;2:41–55. doi: 10.1017/s0952523800004314. [DOI] [PubMed] [Google Scholar]
- 4.Butler TW, Westheimer G. Interference with stereoscopic acuity: spatial, temporal, and disparity tuning. Vision Res. 1978;18:1387–1392. doi: 10.1016/0042-6989(78)90231-6. [DOI] [PubMed] [Google Scholar]
- 5.Carandini M, Heeger DJ, Movshon JA. Linearity and normalization in simple cells of the macaque primary visual cortex. J Neurosci. 1997;17:8621–8644. doi: 10.1523/JNEUROSCI.17-21-08621.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Carandini M, Heeger DJ, Movshon JA. Linearity and gain control in V1 simple cells. In: Ulinski PS, Jones EG, Peters A, editors. Models of cortical circuits. Cerebral cortex, Vol 13. Plenum; New York: 1999. pp. 3–31. [Google Scholar]
- 7.Cavanaugh JR, Bair W, Movshon JA. Signals setting contrast gain arise from iso-oriented domains aligned with the receptive field axis of macaque striate cortex neurons. Soc Neurosci Abstr. 1998;24:1875. [Google Scholar]
- 8.DeAngelis GC, Robson JG, Ohzawa I, Freeman RD. Organization of suppression in receptive fields of neurons in cat visual cortex. J Neurophysiol. 1992;68:144–163. doi: 10.1152/jn.1992.68.1.144. [DOI] [PubMed] [Google Scholar]
- 9.DeAngelis GC, Ohzawa I, Freeman RD. Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. J Neurophysiol. 1993;69:1118–1135. doi: 10.1152/jn.1993.69.4.1118. [DOI] [PubMed] [Google Scholar]
- 10.DeAngelis GC, Freeman RD, Ohzawa I. Length and width tuning of neurons in the cat's primary visual cortex. J Neurophysiol. 1994;71:347–374. doi: 10.1152/jn.1994.71.1.347. [DOI] [PubMed] [Google Scholar]
- 11.Heeger DJ. Normalization of cell responses in cat striate cortex. Vis Neurosci. 1992;9:181–197. doi: 10.1017/s0952523800009640. [DOI] [PubMed] [Google Scholar]
- 12.Hubel DH, Wiesel TN. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol (Lond) 1962;160:106–154. doi: 10.1113/jphysiol.1962.sp006837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hupe JM, James AC, Payne BR, Lomber SG, Girard P, Bullier J. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature. 1998;394:784–787. doi: 10.1038/29537. [DOI] [PubMed] [Google Scholar]
- 14.Kastner S, Nothdurft HC, Pigarev IN. Neuronal correlates of pop-out in cat striate cortex. Vision Res. 1997;37:371–376. doi: 10.1016/s0042-6989(96)00184-8. [DOI] [PubMed] [Google Scholar]
- 15.Knierim JJ, van Essen DC. Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. J Neurophysiol. 1992;67:961–980. doi: 10.1152/jn.1992.67.4.961. [DOI] [PubMed] [Google Scholar]
- 16.Lamme VA. The neurophysiology of figure–ground segregation in primary visual cortex. J Neurosci. 1995;15:1605–1615. doi: 10.1523/JNEUROSCI.15-02-01605.1995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Levitt JB, Lund JS. Contrast dependence of contextual effects in primate visual cortex. Nature. 1997;387:73–76. doi: 10.1038/387073a0. [DOI] [PubMed] [Google Scholar]
- 18.Li CY, Li W. Extensive integration field beyond the classical receptive field of cat's striate cortical neurons—classification and tuning properties. Vision Res. 1994;34:2337–2355. doi: 10.1016/0042-6989(94)90280-1. [DOI] [PubMed] [Google Scholar]
- 19.Maffei L, Fiorentini A. The unresponsive regions of visual cortical receptive fields. Vision Res. 1976;16:1131–1139. doi: 10.1016/0042-6989(76)90253-4. [DOI] [PubMed] [Google Scholar]
- 20.Morrone MC, Burr DC, Maffei L. Functional implications of cross-orientation inhibition of cortical visual cells. I. Neurophysiological evidence. Proc R Soc Lond B Biol Sci. 1982;216:335–354. doi: 10.1098/rspb.1982.0078. [DOI] [PubMed] [Google Scholar]
- 21.Nelson JI, Frost BJ. Orientation-selective inhibition from beyond the classic visual receptive field. Brain Res. 1978;139:359–365. doi: 10.1016/0006-8993(78)90937-x. [DOI] [PubMed] [Google Scholar]
- 22.Nothdurft HC. Texture segmentation and pop-out from orientation contrast. Vision Res. 1991;31:1073–1078. doi: 10.1016/0042-6989(91)90211-m. [DOI] [PubMed] [Google Scholar]
- 23.Pelli DG, Zhang L. Accurate control of contrast on microcomputer displays. Vision Res. 1991;31:1337–1350. doi: 10.1016/0042-6989(91)90055-a. [DOI] [PubMed] [Google Scholar]
- 24.Polat U, Mizobe K, Pettet MW, Kasamatsu T, Norcia AM. Collinear stimuli regulate visual responses depending on cell's contrast threshold. Nature. 1998;391:580–584. doi: 10.1038/35372. [DOI] [PubMed] [Google Scholar]
- 25.Rossi AF, Desimone R, Ungerleider LG. Contextual modulation in primary visual cortex of macaques. J Neurosci. 2001;21:1698–1709. doi: 10.1523/JNEUROSCI.21-05-01698.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sillito AM, Grieve KL, Jones HE, Cudeiro J, Davis J. Visual cortical mechanisms detecting focal orientation discontinuities. Nature. 1995;378:492–496. doi: 10.1038/378492a0. [DOI] [PubMed] [Google Scholar]
- 27.Skottun BC, De Valois RL, Grosof DH, Movshon JA, Albrecht DG, Bonds AB. Classifying simple and complex cells on the basis of response modulation. Vision Res. 1991;31:1079–1086. doi: 10.1016/0042-6989(91)90033-2. [DOI] [PubMed] [Google Scholar]
- 28.Sutter EE, Tran D. The field topography of ERG components in man. I. The photopic luminance response. Vision Res. 1992;32:433–446. doi: 10.1016/0042-6989(92)90235-b. [DOI] [PubMed] [Google Scholar]
- 29.Walker GA, Ohzawa I, Freeman RD. Binocular cross-orientation suppression in the cat's striate cortex. J Neurophysiol. 1998;79:227–239. doi: 10.1152/jn.1998.79.1.227. [DOI] [PubMed] [Google Scholar]
- 30.Walker GA, Ohzawa I, Freeman RD. Asymmetric suppression outside the classical receptive field of the visual cortex. J Neurosci. 1999;19:10536–10553. doi: 10.1523/JNEUROSCI.19-23-10536.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Walker GA, Ohzawa I, Freeman RD. Suppression outside the classical cortical receptive field. Vis Neurosci. 2000;17:369–379. doi: 10.1017/s0952523800173055. [DOI] [PubMed] [Google Scholar]
- 32.Zipser K, Lamme VA, Schiller PH. Contextual modulation in primary visual cortex. J Neurosci. 1996;16:7376–7389. doi: 10.1523/JNEUROSCI.16-22-07376.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]