Skip to main content
Physiological Reports logoLink to Physiological Reports
. 2016 Apr 6;4(7):e12746. doi: 10.14814/phy2.12746

A normalized contrast‐encoding model exhibits bright/dark asymmetries similar to early visual neurons

Emily A Cooper 1,
PMCID: PMC4831320  PMID: 27044852

Abstract

Biological sensory systems share a number of organizing principles. One such principle is the formation of parallel streams. In the visual system, information about bright and dark features is largely conveyed via two separate streams: the ON and OFF pathways. While brightness and darkness can be considered symmetric and opposite forms of visual contrast, the response properties of cells in the ON and OFF pathways are decidedly asymmetric. Here, we ask whether a simple contrast‐encoding model predicts asymmetries for brights and darks that are similar to the asymmetries found in the ON and OFF pathways. Importantly, this model does not include any explicit differences in how the visual system represents brights and darks, but it does include a common normalization mechanism. The phenomena captured by the model include (1) nonlinear contrast response functions, (2) greater nonlinearities in the responses to darks, and (3) larger responses to dark contrasts. We report a direct, quantitative comparison between these model predictions and previously published electrophysiological measurements from the retina and thalamus (guinea pig and cat, respectively). This work suggests that the simple computation of visual contrast may account for a range of early visual processing nonlinearities. Assessing explicit models of sensory representations is essential for understanding which features of neuronal activity these models can and cannot predict, and for investigating how early computations may reverberate through the sensory pathways.

Keywords: Lateral geniculate nucleus, ON/OFF pathways, retinal ganglion cells, visual contrast

Introduction

Visual contrast – a change in the luminance or wavelength of light relative to a local average – is a primary signal transmitted by the retina. This is likely because contrast provides a useful and efficient representation of behaviorally relevant information (Land and McCann 1971; Laughlin 1981; Shapley and Enroth‐Cugell 1984; Brady and Field 2000). The retina conveys contrast information to the brain via two segregated pathways devoted to brightness (ON) and darkness (OFF) (Hartline 1938; Kuffler 1953; Werblin and Dowling 1969; Schiller et al. 1986; Westheimer 2007). Intuitively, neurons in the ON and OFF pathways might be expected to respond similarly to stimuli of equal and opposite contrast. But in fact, the contrast response functions of ON and OFF neurons have systematic differences (Chichilnisky and Kalmar 2002; Zaghloul et al. 2003; Liang and Freed 2010; Kremkow et al. 2014; Jiang et al. 2015). ON/OFF asymmetries also extend to neuronal spatial receptive fields and temporal properties (Dacey and Petersen 1992; Chichilnisky and Kalmar 2002; Pandarinath et al. 2010; Ratliff et al. 2010; Jin et al. 2011; Nichols et al. 2013).

But the computational role that these asymmetries play in early visual processing is an open question. In this report, we examine whether differences in ON and OFF contrast response functions necessarily reflect differences in their underlying representations of visual information. This work is motivated by two main observations: (1) some ON/OFF asymmetries may arise at the level of the photoreceptor, prior to the point at which bright and dark information become segregated (Angueyra and Rieke 2013; Kremkow et al. 2014; Carandini 2016), and (2) several simple models proposed for physiologically plausible contrast encoding contain nonlinearities, but these models have not been directly compared to the nonlinearities of ON and OFF neurons (Peli 1990; Tadmor and Tolhurst 2000; Ratliff et al. 2010; Haun and Peli 2013).

Here, we define an explicit computational model of contrast encoding and directly compare the predicted responses from this model to a range of previously reported electrophysiological measurements from different species (guinea pig and cat) and cell types (retinal ganglion cells [RGCs] and lateral geniculate cells). While the exact details of early visual response characteristics vary between species (Chichilnisky and Kalmar 2002; Zaghloul et al. 2003; Liang and Freed 2010; Nichols et al. 2013), we ask whether a simple model can capture common features across species. Surprisingly, we find that many differences in the response characteristics of ON and OFF neurons can be recreated using a single, basic contrast‐encoding model. This is because asymmetries naturally result from a fundamental neural computation – divisive normalization (Carandini and Heeger 2012).

Materials and Methods

Model

We employ a generic, yet physiologically plausible contrast‐encoding model derived from previous definitions of visual contrast (Fig. 1A) (Peli 1990; Tadmor and Tolhurst 2000; Bex and Makous 2002; Ratliff et al. 2010; Haun and Peli 2013). The model consists of a linear antagonistic step that detects spatial changes in luminance, and a nonlinear normalization step in which the antagonistic output is divided by the local average luminance (i.e., a 2D divisively normalized difference of Gaussians (DoG)).

Figure 1.

Figure 1

Measuring luminance contrast. (A) In the model, an image is convolved (*) with both an antagonistic and a low‐pass filter. The antagonistic filter output is divided (normalized) by the low‐pass output. Half‐wave rectification is used to segregate bright (ON) and dark (OFF) responses without additional nonlinearities. (B) A disk in equal steps of Weber contrast from 0 to 100%, either decremental/dark (left) incremental/bright (right). (C, D) Predicted ON and OFF contrast response functions for the antagonistic stage alone (C) and the full model (D). (E, F) Response functions are shown as in (C, D), except the stimulus background level was increased by a factor of two. The ordinate scales are matched for C/E and D/F.

Thus, the model response – r, a scalar value – to a particular stimulus is:

r=f(x,y)(g(x,y;σc)g(x,y;σs))f(x,y)g(x,y;σn), (1)

where the luminance image, f(x,y), is defined over a 2D lattice of spatial positions with origin (0,0) at the image center, and where * is the convolution operator. Each convolution filter, g(x,y;σ), is a 2D Gaussian of the form:

g(x,y;σ)=12πσ2e(x2+y2)2σ2. (2)

Note that for the stimuli described here, the luminance image and the filter are the same size, so the convolution is computed at a single point in the center of the image, and thus the response is a scalar value.

Three different standard deviations (σ c, σ s, and σ n) determine the relative shapes/sizes of the antagonistic (center, surround) and normalization steps, respectively. Modifying these standard deviations changes the spatial extent over which contrast is computed. To create a family of filters with different shapes and sizes, σ c was fixed in arbitrary units and σ s and σ n were varied by scale factors. σ s ranged from 1.25× to 6× σ c (1.25, 1.5, 2, 3, 4, 6); σ n ranged from 1× to 6× σ c (1, 1.25, 1.5, 2, 3, 4, 6). Between these two parameters, 42 unique model units were analyzed.

While we do not propose this as a literal model of early visual processing, the DoG filter captures the center‐surround antagonism and the spatial properties of early visual neuron receptive fields (both RGCs and cells in the lateral geniculate nucleus [LGN]) (Enroth‐Cugell and Robson 1966; Derrington and Lennie 1984; Croner and Kaplan 1995). The range of surround/center ratios explored is consistent with those measured in cat RGCs (Linsenmeier et al. 1982). The inclusion of normalization is reflective of the response adaptation that results from retinal gain control mechanisms (Shapley and Enroth‐Cugell 1984). Note, however, that this model considers only spatial properties of contrast‐encoding, whereas early visual neurons also encode temporal contrast (e.g., Derrington and Lennie 1984; Lee et al. 1989).

After filtering a stimulus, we modeled ON/OFF parallelization by performing half‐wave rectification that preserved only the positive (ON) or negative (OFF) outputs. Importantly, we did not apply any additional nonlinearity after this rectification, because our goal was to examine the predicted output in the absence of any explicit bright/dark encoding asymmetries. Thus, the modeling steps leading up to predicting ON and OFF responses were completely symmetric.

Stimuli

To measure the model contrast response functions, stimuli consisted of images of uniform disks on a uniform background. The background level was either 50 or 100 (arbitrary units), and the disks ranged in Weber contrast from −100 to 100%. Weber contrast is defined as 100(− b)/b, where d and b are the luminance of the disk and background, respectively. The disk diameter was 4× the standard deviation of the model central Gaussian. For the luminance response analysis (Fig. 4), stimuli instead consisted of squares on one of three background intensities (2, 61, or 120), so as to match the Kremkow et al. (2014) stimulus values in cd/m2. The width of the squares was also 4× the standard deviation of the central Gaussian.

Figure 4.

Figure 4

Comparison between lateral geniculate nucleus (LGN) cells and model units. (A–D) Firing rates (baselined) are shown for example OFF and ON LGN cells from Kremkow et al. (2014). The ordinate scale is the same for each panel. (A, B) show responses of an OFF cell with different luminance levels (cd/m2) on the abscissa. Note that the abscissa is reversed in these panels. (A) shows luminance responses on a light (120 cd/m2) background and (B) shows responses to a subset of the same luminances when presented on a gray (61 cd/m2) background (see insets). (C, D) are similar to (A, B), except firings rates are shown for an ON cell. In this case, the background luminance was either dark (C; 2 cd/m2) or gray (D; 61 cd/m2). (E–H) The responses of one example model unit are shown as in panels (A–D). (I, J) The relative luminance values at which individual LGN cells reached half of their maximum response on each background are shown as scatter plots for OFF (I) and ON units (J). (K, L) The normalized responses to the maximum contrast are shown as in panels (I, J). (M–P) Same as (I–L) except for the model population. For clarity, panels with model data have a shaded background.

Analysis

For the comparison with guinea pig RGC responses (Zaghloul et al. 2003), nonlinearity indices were calculated for the model units by taking the log of the ratio of the contrast response function slope at 50% contrast and 5% contrast. Slopes were estimated using finite differences. This was similar to the nonlinearity indices in Zaghloul et al. (2003) and other studies (Chichilnisky and Kalmar 2002; Kastner and Baccus 2013). To ensure that the results were not specific to this particular index, this calculation was repeated for slopes measured at contrasts ranging from 20 to 90%.

For the comparison with cat LGN cell responses (Kremkow et al. 2014), values of luminance half‐response saturation (L50) were computed by finding the target luminance that resulted in a response that was half as large as the response at the largest luminance contrast that was presented for a given stimulus (Rmax). As in the previous report (Kremkow et al. 2014), these values were then converted to proportions.

Note that in both studies to which the model predictions were compared (Zaghloul et al. 2003; Kremkow et al. 2014), the response functions reflect the initial neuronal response to a change in contrast. In Kremkow et al. (2014), this was the number of spikes recorded in the 100 ms during which the stimulus was flashed on a uniform background. In Zaghloul et al. (2003), this was the instantaneous nonlinearity component of a model fit to neuronal responses to white noise stimulation (in terms of spikes per second). Since the Weber contrast of the Zaghloul et al. (2003) stimulus was not defined, comparisons to these data are limited to the nonlinearity indices described above.

Results

Different contrast response functions for brights and darks

The contrast response function of a neuron is characterized by plotting the average spike rate as a function of the contrast of a stimulus presented within the receptive field (Fig. 1B). Several different studies have produced similar conclusions about the contrast responses of precortical visual neurons to spots of bright and dark contrast. First, the responses do not vary linearly as a function of contrast (Burkhardt et al. 1998; Chichilnisky and Kalmar 2002; Zaghloul et al. 2003; Kremkow et al. 2014). Second, the nonlinearity is stronger for OFF cells than for ON cells over the same range of contrast magnitudes (Chichilnisky and Kalmar 2002; Zaghloul et al. 2003; Kastner and Baccus 2013). Third, the response of OFF cells at high contrasts is greater than ON cells (Zaghloul et al. 2003; Kremkow et al. 2014).

Each of these features is captured in the contrast response functions of the model. Response functions from an example model unit are shown in Figure 1C–F (σ s = σ n = 2σ c). For ease of comparison, Weber contrast is plotted in terms of absolute value for bright (ON) and dark (OFF) contrasts. Model ON responses are shown as solid red lines and model OFF responses are shown as dashed black lines. While the antagonistic step in isolation produces linear and symmetric ON/OFF response functions (Fig. 1C), the inclusion of normalization causes the model responses to become asymmetric and nonlinear (Fig. 1D). For this example unit, the response to darks has an accelerating nonlinearity, and the response to brights is decelerating. When the background illumination level is increased by a factor of two, the response function of the antagonistic stage alone also increases by a factor of two (Fig. 1C and E). However, the response function of the full model is unchanged (Fig. 1D and F).

Thus, the inclusion of normalization in the full model results in contrast constancy within a polarity at the cost of contrast constancy between polarities. Within a polarity (bright or dark), contrast responses are the same regardless of the overall illumination level – but for a given contrast level, the bright and dark responses differ from each other. This asymmetry arises because of differences between the values that go into the normalization (eq. 1). For dark points, the value of the normalization area decreases as the spot gets darker, and the decreasing values in the divisor result in a boosting of the OFF response. For bright points, the reverse is true: as the spot gets brighter, the divisor gets larger, and the ON response begins to saturate. This effect is sufficient to create asymmetric contrast response functions. Note, however, that this analysis necessarily excludes the modeling of ON responses to dark contrasts and OFF responses to bright contrasts, which have additional asymmetries (Chichilnisky and Kalmar 2002).

Clearly, the nonlinearity and asymmetry depend on the parameters of normalization. Figure 2A shows the contrast response functions for a sample of the model units with a range of parameters. Different surround/center ratios (σ s/σ c) are shown in each panel (from top to bottom: 1.5, 3, and 6). Icons show the relative extent of the center and surround, with the size of the disk stimulus outlined in black. Within the panels, different normalization/center ratios (σ n/σ c) are shown (1, 2, and 4). Several patterns are clear. First, all model units show the same general results as in Figure 1: a greater OFF nonlinearity and a greater OFF response overall. Second, larger surround/center ratios result in larger responses overall. This is because as the antagonistic surround becomes more diffuse, the positive lobe of the DoG extends from partial to full coverage of the stimulus disk, increasing the response magnitude overall. Third, smaller adaptation/center ratios result in larger differences between the ON and OFF response functions.

Figure 2.

Figure 2

Model contrast response functions. (A) Each panel shows the contrast response function for ON and OFF units (solid and dashed lines, respectively) with a different surround/center ratio (see icons on the left). For the icons, the color map is the same as in Figure 1, but the scale differs across panels so as to make the surround visible (with large surrounds, the filter response at each point in the surround is very small). The circle outline represents the area covered by the stimulus. Within each panel, the response functions are shown for three different normalization/center ratios. The ordinate scales are matched for all panels. (B) For each of the surround/center ratios in (A), the ratio of the model OFF to ON response at 100% contrast is shown. Each point shows the results for one normalization/center ratio (abscissa). Ratios for which full response functions are shown in (A) are color coded.

Figure 2B shows the ratio of the OFF to ON responses at maximum contrast (100%) for each unit. These values are the same for each surround/center ratio (three panels), but vary as a function of the normalization/center ratio (abscissa values). Smaller normalization areas result in larger OFF/ON ratios. A given normalization area can be thought of as determining the relative weight given to the luminance of the disk and the luminance of the background in the divisor of equation (1). When the normalization area is small, the divisor is mostly determined by the disk luminance, resulting in more asymmetric responses for bright and dark disks. When the normalization area is large, more weight is given to the background, which is the same for all disks. Consistent with measurements from early visual neurons, across normalization areas the OFF/ON ratios at 100% contrast are all greater than 1 (OFF > ON). This is because, regardless of the size of the normalization area, the normalization value for a 100% contrast decrement is always lower than for a 100% contrast increment on the same background. Note that this would not be the case if the central region where the disc is present was excluded from the normalization area. In the current model, the OFF/ON ratio at 100% contrast ranges from 1.1 to 13.7, so some values are substantially larger than those reported for early visual neurons (e.g., Zaghloul et al. 2003; Kremkow et al. 2014). The very large ratio for σ n/σ c = 1 is affected by the fact that the 100% contrast dark disk in the stimulus actually has an intensity value of 0, something that is not typically the case on physical display systems.

Comparison to contrast response nonlinearities of retinal ganglion cells

We next compared the nonlinearities of all of the unique model units to nonlinearities that have been previously reported from a set of ON and OFF RGCs in the guinea pig retina (Zaghloul et al. 2003). Figure 3A–B show histograms of nonlinearity indices computed for the retinal and model data, respectively. In both cases, the indices are systematically larger for the OFF units, indicating a more accelerating nonlinearity. As it was not possible to exactly match the nonlinearity index measure between the experimental and model stimuli, these indices were also computed using several different points along the model contrast response curve. The same pattern of results was present regardless of the points used to compute the model index.

Figure 3.

Figure 3

ON and OFF nonlinearities of retinal ganglion cells (RGCs) and model units. (A) Nonlinearity indices from a population of RGCs are replotted from Zaghloul et al. (2003). Striped lines indicate overlapping frequencies for ON and OFF cells. (B) Nonlinearity indices are shown for a population of model units. For clarity, panels in this figure and Figure 4 with model data have a shaded background.

Note, however, that the range of the indices differs between the models and the RGCs: the RGCs (both ON and OFF) have a more accelerating nonlinearity than predicted by this model. ON and OFF nonlinearities reported in the literature vary, but tend to be larger than those measured in the model. Chichilnisky and Kalmar (2002) reported average OFF and ON indices of 1.1 and 0.1 in the primate retina, and Kastner and Baccus (2013) reported average OFF and ON indices of 2.2 and 1.3 in the tiger salamander retina. Thus, while the greater OFF than ON nonlinearity can be qualitatively captured by divisive normalization, additional mechanisms may serve to modify or exaggerate this difference.

Comparison to luminance responses in the lateral geniculate nucleus

A recent report characterized the response properties of ON and OFF LGN neurons in terms of their luminance response functions (Kremkow et al. 2014). This function differs only slightly from traditional contrast response measurements – the abscissa on which the spike rates are plotted is in terms of stimulus luminance against a particular background luminance, rather than contrast. The authors reported that OFF luminance responses increased with approximately the same slope regardless of the brightness of the surrounding background (see example unit replotted in Fig. 4A–B). In comparison, the ON responses on a dark background were much more compressive than the response to the same stimulus on a gray background (Fig. 4C–D).

It is not immediately obvious whether this constellation of responses in the LGN suggests different properties than those typically measured in the retina, and those captured by the current model. Thus, we compared these data to our same model. The results for a model example unit are shown in Figure 3E–H (σ s = 3σ c and σ n = 2σ c). Several features of this unit are reflective of the LGN cells: the luminance responses for dark spots are similar regardless of the background level (Fig. 3E–F) and the ON responses are more compressive on the dark background (Fig. 3G–H).

A population‐level comparison revealed several similarities, and one notable difference between the LGN and model populations. In the LGN population, the relative luminance at half‐response saturation (L50) was similar for OFF cells on both backgrounds (light/gray background = 0.96), but tended to be much smaller for ON cells on a dark background (dark/gray background = 0.26) (Fig. 3I–J). These ratios were similar to the model: light/gray = 1.0, dark/gray = 0.13 (Fig. 3M–N). The model closely captured the asymmetric effects of background light level on the LGN responses.

However, in the LGN population, the responses at maximum contrast (Rmax) for both ON and OFF cells were unaffected by background luminance (OFF light/gray background = 0.96, ON dark/gray background = 1.13) (Fig. 3K–L). The model predictions for OFF units were in agreement with the LGN OFF cells (light/gray background = 1.06), but the predictions for ON units differed substantially (dark/gray background = 4.90) (Fig. 3O–P). The reason for this mismatch is clear: the model will always respond more to greater contrast levels, within a given polarity. So for ON units, the model predicts a much larger response to a given luminance if it appears on the darker background. However, the response of the LGN cells to 120 cd/m2 is very similar on both a dark and a gray background (Fig. 4C and D).

Thus, while their nonlinearities are well‐captured by the current model, clearly the LGN responses are modulated by absolute luminance in a way that does not reflect within polarity contrast constancy. To fully explain these data, an additional mechanism that selectively boosts ON responses is necessary. Interestingly, this runs contrary to the common assessment that early visual processing favors darks over brights (Ratliff et al. 2010; Kremkow et al. 2014).

Discussion

This report shows that a simple contrast‐encoding model that has been proposed in the literature shares several bright/dark response asymmetries with precortical visual processing. These similarities arise without ever directly fitting the model to a specific dataset, and the same model predicts features from different species, different cell types, and different recording preparations.

Other ON/OFF asymmetries

Obviously, there are a range of asymmetries between the ON and OFF pathways that cannot be accounted for by the current model. In addition to those highlighted in the Results, these include the higher baseline firing rate of ON cells (and the ability of ON cells to signal decrements), the fact that OFF RGCs are more numerous, and differences in temporal dynamics and receptive fields (Dacey and Petersen 1992; Benardete and Kaplan 1999; Chichilnisky and Kalmar 2002; Zaghloul et al. 2003; Pandarinath et al. 2010; Ratliff et al. 2010; Jin et al. 2011; Nichols et al. 2013). Although, with regards to relative numerosity, it remains unclear if this asymmetry exists across all species (Baden et al. 2016), and with regards to temporal asymmetries, other studies have not found compelling asymmetries between ON and OFF neuronal responses (Kremers et al. 1993; Benardete and Kaplan 1997). In addition, across the many species that have been studied, other types of RGCs transmit contrast information, such as ON‐OFF RGC‐types that respond to both light increments and decrements (Masland 2012; Baden et al. 2016). Examining the role of these properties of early visual processing will further our understanding of how visual information is represented. New resources that allow for the detailed prediction and exploration of retinal responses promise to expand our ability to examine a range of physiologically plausible early visual models (Wohrer and Kornprobst 2009; ISETbio 2015).

Normalization mechanisms

In the current model, the receptive field is spatially antagonistic, but the normalization area is not. While the current model is a conceptual encoding model for spatial contrast, rather than a mechanistic model of early visual processing, this form of normalization may be consistent with retinal adaptation mechanisms that commence prior to the formation of antagonistic receptive fields. Here, we will examine similarities between the current model and photoreceptor adaptation. Indeed, origins of ON/OFF contrast response asymmetries at the level of the photoreceptors have been proposed previously (Angueyra and Rieke 2013; Baden et al. 2013) and explicitly modeled (Kremkow et al. 2014; Carandini 2016). Other asymmetries between ON and OFF neurons (different spatial receptive field properties) have similarly been suggested to derive from photoreceptor responses (Kremkow et al. 2014).

Measurements from cone photoreceptors that have been adapted to a steady light level show that these cells hyperpolarize in response to increases in light intensity and depolarize in response to decreases in light intensity – relative to a baseline resting potential (Baylor and Fuortes 1970; Normann and Perlman 1979). The normalized photoreceptor polarization (V) in response to a given light intensity (I b) can be generally described by the following equation:

V=IbIb+Ia, (3)

where I a is the stimulus intensity that produces half of the maximum response. Previous work has shown that the magnitude of I a advances systematically when photoreceptors are adapted to greater light levels such that the dynamic range of cone responses is roughly centered around the adapted intensity level (Boynton and Whitten 1970; Normann and Perlman 1979).

Figure 5A shows predicted cone response curves for two different adaptation levels based on this equation. When plotted in terms of light intensity on a log axis (left panel), the depolarizing and hyperpolarizing responses are symmetric and centered around the adapted value (I a). When the light intensity levels are converted to Weber contrast (right panel), it is clear that the depolarization in response to dark contrasts (negative values) is more accelerating than the hyperpolarization in response to bright contrasts (positive values). Note that in this case, Weber contrast represents the contrast over time rather than space (i.e., how much brighter or darker was I b relative to the previously adapted light level I a). The ON and OFF bipolar cells that form the initial separation into ON and OFF pathways either preserve this polarization (OFF) or invert it (ON). To illustrate this, Figure 5B superimposes the hyperpolarization and depolarization curves from 5A for positive (red line) and negative (black line) Weber contrasts. The shapes of these curves are extremely similar to those produced by the current model (See Fig. 2).

Figure 5.

Figure 5

Contrast asymmetry in cone polarization. (A) In the left panel, intensity response functions are shown for a model cone photoreceptor adapted to two different light intensities (I a). The horizontal dashed line represents the baseline polarization. In the right panel, the same data are plotted with the abscissa converted to Weber contrast. (B) Hyperpolarization and depolarization responses are overlaid to illustrate the different nonlinearities providing input to OFF bipolar cells for dark contrasts, and ON bipolar cells for bright contrasts.

The similarity derives from the fact that these curves are produced by a normalization factor that includes the sum of the currently adapted light intensity and a second brighter or darker light level (eq. (3)). This is similar to the Gaussian normalization used in the current model (eqs. (1) and (2)), which averages over both the central stimulus and surround areas. Thus, these cone responses share the general features that produce ON/OFF asymmetries for spatial contrast in the model, but for temporal contrast: constancy within polarities, but not between them. At present, these effects are difficult to directly relate because, for example, in the Kremkow et al. (2014) study, the background luminance that preceded the onset of bright and dark stimuli was the same as the luminance of the surrounding area, thus temporal and spatial contrast were correlated. However, if one wanted to predict early visual responses to natural images, it may be reasonable to use the current model and assume that local spatial and temporal contrast are correlated in these signals as well (Ratliff et al. 2010; Cooper and Norcia 2015).

It is also notable that several studies have reported that OFF pathway cells are actually less sensitive to low contrasts than ON cells (Chichilnisky and Kalmar 2002; Zaghloul et al. 2003). This is contrary to the prediction of a normalization‐driven process, because in this model the slope and magnitude of the OFF contrast response function will be greater than the ON slope at all contrasts.

Cortical asymmetries

Characterizing the principles that govern early visual responses is essential for understanding retinal processing, but it will also be crucial for interpreting a spate of recent results showing downstream cortical bright/dark asymmetries (Yeh et al. 2009; Xing et al. 2010; Polack and Contreras 2012; Kremkow et al. 2014; Liu and Yao 2014; Veit et al. 2014; Zurawel et al. 2014; Tan et al. 2015). Cortical asymmetries may reflect an extension of the asymmetries explored here, or may reflect additional optimizations for patterns in natural images (Ratliff et al. 2010; Tkacik et al. 2010; Clark et al. 2014; Cooper and Norcia 2015). To differentiate these possibilities, rather than model cortical asymmetries via explicitly different ON/OFF mechanisms (Liu and Yao 2014; Zurawel et al. 2014), it may be valuable to consider to what extent normalization models can and cannot also predict these downstream effects. This could provide further insight into cortical representations of visual contrast at the level of neuronal populations (Naselaris and Kay 2015). Similarly, normalization has been proposed to play a role in perceptual asymmetries between brights and darks, which generally reflect greater sensitivity to darks (Chubb and Nam 2000; Lu and Sperling 2012; Haun and Peli 2013).

Conclusion

A simple description of the ingredients for visual contrast responses is a high priority for understanding visual encoding. We propose that a symmetric ON/OFF model that incorporates divisive normalization can provide a simple and useful starting point.

Conflict of Interest

The author declares no competing financial interests.

Acknowledgments

The author thanks Jens Kremkow for providing the LGN response data.

Cooper E. A.. A normalized contrast‐encoding model exhibits bright/dark asymmetries similar to early visual neurons. Physiol Rep, 4 (7), 2016, e12746, doi: 10.14814/phy2.12746

Funding Information

No funding information provided.

References

  1. Angueyra, J. , and Rieke F.. 2013. Asymmetries between ON and OFF responses in primate vision first arise in photoreceptors. IOVS 54:1293 [Abstract]. [Google Scholar]
  2. Baden, T. , Schubert T., Chang L., Wei T., Zaichuk M., Wissinger B., et al. 2013. A tale of two retinal domains: near‐optimal sampling of achromatic contrasts in natural scenes through asymmetric photoreceptor distribution. Neuron 80:1206–1217. [DOI] [PubMed] [Google Scholar]
  3. Baden, T. , Berens P., Franke K., Romän Rosón M., Bethge M., and Euler T.. 2016. The functional diversity of retinal ganglion cells in the mouse. Nature 529:345–350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Baylor, D. A. , and Fuortes M. G. F.. 1970. Electrical responses of single cones in the retina of the turtle. J. Physiol. 207:77–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Benardete, E. A. , and Kaplan E.. 1997. The receptive field of the primate P retinal ganglion cell, I: linear dynamics. Vis. Neurosci. 14:169–185. [DOI] [PubMed] [Google Scholar]
  6. Benardete, E. A. , and Kaplan E.. 1999. The dynamics of primate M retinal ganglion cells. Vis. Neurosci. 16:355–368. [DOI] [PubMed] [Google Scholar]
  7. Bex, P. J. , and Makous W.. 2002. Spatial frequency, phase, and the contrast of natural images. J. Opt. Soc. Am. A. 19:1096–1106. [DOI] [PubMed] [Google Scholar]
  8. Boynton, R. M. , and Whitten D. N.. 1970. Visual adaptation in monkey cones: recordings of late receptor potentials. Science 170:1423–1426. [DOI] [PubMed] [Google Scholar]
  9. Brady, N. , and Field D. J.. 2000. Local contrast in natural images: normalisation and coding efficiency. Perception 29:1041–1055. [DOI] [PubMed] [Google Scholar]
  10. Burkhardt, D. A. , Fahey P. K., and Sikora M. A.. 1998. Responses of ganglion cells to contrast steps in the light‐adapted retina of the tiger salamander. Vis. Neurosci. 15:219–229. [DOI] [PubMed] [Google Scholar]
  11. Carandini, M. 2016. Light adaptation explains different linearity of ON and OFF responses. BioRxiv, doi: 10.1101/039248. [Google Scholar]
  12. Carandini, M. , and Heeger D. J.. 2012. Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13:51–62. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Chichilnisky, E. J. , and Kalmar R. S.. 2002. Functional asymmetries in ON and OFF ganglion cells of primate retina. J. Neurosci. 22:2737–2747. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Chubb, C. , and Nam J.‐H.. 2000. Variance of high contrast textures is sensed using negative half‐wave rectification. Vis. Res. 40:1677–1694. [DOI] [PubMed] [Google Scholar]
  15. Clark, D. A. , Fitzgerald J. E., Ales J. M., Gohl D. M., Silies M. A., Norcia A. M., et al. 2014. Flies and humans share a motion estimation strategy that exploits natural scene statistics. Nat. Neurosci. 17:296–303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Cooper, E. A. , and Norcia A. M.. 2015. Predicting cortical dark/bright asymmetries from natural image statistics and early visual transforms. PLoS Comput. Biol. 11:e1004268. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Croner, L. J. , and Kaplan E.. 1995. Receptive fields of P and M ganglion cells across the primate retina. Vis. Res. 35:7–24. [DOI] [PubMed] [Google Scholar]
  18. Dacey, D. M. , and Petersen M. R.. 1992. Dendritic field size and morphology of midget and parasol ganglion cells of the human retina. PNAS 89:9666–9670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Derrington, A. M. , and Lennie P.. 1984. Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. J. Physiol. 357:219–240. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Enroth‐Cugell, C. , and Robson J. G.. 1966. The contrast sensitivity of retinal ganglion cells of the cat. J. Physiol. 187:517–552. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Hartline, H. K. 1938. The response of single optic nerve fibers of the vertebrate eye to illumination of the retina. Am. J. Physiol. 121:400–415. [Google Scholar]
  22. Haun, A. M. , and Peli E.. 2013. Perceived contrast in complex images. J. Vis. 13:3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. ISETbio . 2015. ISETbio: tools for modeling biological vision. Available at http://isetbio.org (accessed 22 February 2015).
  24. Jiang, Y. , Purushothaman G., and Casagrande V. A.. 2015. The functional aymmetry of ON and OFF channels in the perception of contrast. J. Neurophysiol. 114:2816–2829. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Jin, J. , Wang Y., Lashgari R., Swadlow H. A., and Alonso J. M.. 2011. Faster thalamocortical processing for dark than light visual targets. J. Neurosci. 31:17471–17479. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Kastner, D. B. , and Baccus S. A.. 2013. Spatial segregation of adaptation and predictive sensitization in retinal ganglion cells. Neuron 79:541–554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Kremers, J. , Lee B. B., Pokorny J., and Smith V. C.. 1993. Responses of macaque ganglion cells and human observers to compound periodic waveforms. Vis. Res. 33:1997–2011. [DOI] [PubMed] [Google Scholar]
  28. Kremkow, J. , Jianzhong J., Komban S. J., Wang Y., Lashgari R., Li X., et al. 2014. Neuronal nonlinearity explains greater visual spatial resolution for darks than lights. PNAS 111:3170–3175. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Kuffler, S. W. 1953. Discharge patterns and functional organization of mammalian retina. J. Neurophysiol. 16:37–68. [DOI] [PubMed] [Google Scholar]
  30. Land, E. H. , and McCann J. J.. 1971. Lightness and retinex theory. J. Opt. Soc. Am. 61:1–11. [DOI] [PubMed] [Google Scholar]
  31. Laughlin, S. 1981. A simple coding procedure enhances a neuron's information capacity. Z. Naturforsch. 36:910–912. [PubMed] [Google Scholar]
  32. Lee, B. B. , Martin P. R., and Valberg A.. 1989. Sensitivity of macaque retinal ganglion cells to chromatic and luminance flicker. J. Physiol. 414:223–243. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Liang, Z. , and Freed M. A.. 2010. The ON pathway rectifies the OFF pathway of the mammalian retina. J. Neurosci. 30:5533–5543. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Linsenmeier, R. A. , Frishman L. J., Jakieka H. G., and Enroth‐Cugell C.. 1982. Receptive field properties of X and Y cells in the cat retina derived from contrast sensitivity measurements. Vis. Res. 22:1173–1183. [DOI] [PubMed] [Google Scholar]
  35. Liu, K. , and Yao H.. 2014. Contrast‐dependent OFF‐dominance in cat primary visual cortex facilitates discrimination of stimuli with natural contrast statistics. Eur. J. Neurosci. 39:2060–2070. [DOI] [PubMed] [Google Scholar]
  36. Lu, Z. L. , and Sperling G.. 2012. Black‐white asymmetry in visual perception. J. Vis. 12:1–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Masland, R. H. 2012. The neuronal organization of the retina. Neuron 76:266–280. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Naselaris, T. , and Kay K. N.. 2015. Resolving ambiguities of MVPA using explicit models of representation. Trends Cogn. Sci. 19:551–554. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Nichols, Z. , Nirenberg S., and Victor J.. 2013. Interacting linear and nonlinear characteristics produce population coding asymmetries between ON and OFF cells in the retina. J. Neurosci. 33:14958–14973. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Normann, R. A. , and Perlman I.. 1979. The effects of background illumination on the photoresponses of red and green cones. J. Physiol. 286:491–507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Pandarinath, C. , Victor J. D., and Nirenberg S.. 2010. Symmetry breakdown in the ON and OFF pathways of the retina at night: functional implications. J. Neurosci. 30:10006–10014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Peli, E. 1990. Contrast in complex images. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 7:2032–2040. [DOI] [PubMed] [Google Scholar]
  43. Polack, P. O. , and Contreras D.. 2012. Long‐range parallel processing and local recurrent activity in the visual cortex of the mouse. J. Neurosci. 32:11120–11131. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Ratliff, C. P. , Borghuis B. G., Kao Y.‐H., Sterling P., and Balasubramanian V.. 2010. Retina is structured to process an excess of darkness in natural scenes. PNAS 107:17368–17373. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Schiller, P. H. , Sandell J. H., and Maunsell J. H. R.. 1986. Functions of the ON and OFF channels of the visual system. Nature 322:824–825. [DOI] [PubMed] [Google Scholar]
  46. Shapley, R. , and Enroth‐Cugell C.. 1984. Visual adaptation and retinal gain controls Pp. 263–346 in Osborne M. and Chader G., eds. Progress in Retinal Research. Pergamon, Oxford, U.K. [Google Scholar]
  47. Tadmor, Y. , and Tolhurst D. J.. 2000. Calculating the contrasts that retinal ganglion cells and LGN neurones encounter in natural scenes. Vis. Res. 40:3145–3157. [DOI] [PubMed] [Google Scholar]
  48. Tan, Z. , Sun W., Chen T. W., Kim D., and Ji N.. 2015. Neuronal representation of ultraviolet visual stimuli in mouse primary visual cortex. Sci. Rep. 5:12597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Tkacik, G. , Prentice J. S., Victor J. D., and Balasubramanian V.. 2010. Local statistics in natural scenes predict the saliency of synthetic textures. PNAS 107:18149–18154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  50. Veit, J. , Bhattacharyya A., Kretz R., and Rainer G.. 2014. On the relation between receptive field structure and stimulus selectivity in the tree shrew primary visual cortex. Cereb. Cortex 24:2761–2771. [DOI] [PubMed] [Google Scholar]
  51. Werblin, F. S. , and Dowling J. E.. 1969. Organization of the retina of the mudpuppy, Necturus maculosus. II. Intracellular recording. J. Neurophysiol. 32:339–355. [DOI] [PubMed] [Google Scholar]
  52. Westheimer, G. 2007. The ON‐OFF dichotomy in visual processing: from receptors to perception. Prog. Retin. Eye Res. 26:636–648. [DOI] [PubMed] [Google Scholar]
  53. Wohrer, A. , and Kornprobst P.. 2009. Virtual Retina: a biological retina model and simulator, with contrast gain control. J. Comput. Neurosci. 26:219–249. [DOI] [PubMed] [Google Scholar]
  54. Xing, D. , Yeh C. I., and Shapley R. M.. 2010. Generation of black‐dominant responses in V1 cortex. J. Neurosci. 30:13504–13512. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Yeh, C.‐I. , Xing D., and Shapley R. M.. 2009. “Black” responses dominate macaque primary visual cortex V1. J. Neurosci. 29:11753–11760. [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Zaghloul, K. A. , Boahen K., and Demb J. B.. 2003. Different circuits for ON and OFF retinal ganglion cells cause different contrast sensitivities. J. Neurosci. 23:2645–2654. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Zurawel, G. , Ayzenshtat I., Zweig S., Shapley R., and Slovin H.. 2014. A contrast and surface code explains complex responses to black and white stimuli in V1. J. Neurosci. 34:14388–14402. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Physiological Reports are provided here courtesy of Wiley

RESOURCES