Abstract
Anomalous trichromacy is a common form of congenital color-deficiency resulting from a genetic alteration in the photopigments of the eye’s light receptors. The changes reduce sensitivity to reddish and greenish hues, yet previous work suggests that these observers may experience the world to be more colorful than their altered receptor sensitivities would predict, potentially indicating an amplification of post-receptoral signals. However, past evidence suggesting such a gain adjustment rests on subjective measures of color appearance or salience. We directly tested for neural amplification by using fMRI to measure cortical responses in color-anomalous and normal control observers. Color contrast response functions were measured in two experiments with different tasks to control for attentional factors. Both experiments showed a predictable reduction in chromatic responses for anomalous trichromats in primary visual cortex. However, in later areas V2v and V3v, chromatic responses in the two groups were indistinguishable. Our results provide direct evidence for neural plasticity that compensates for the deficiency in the initial receptor color signals and suggest that the site of this compensation is in early visual cortex.
Introduction
Typical color perception in humans is trichromatic, beginning with responses to light from three types of cone photoreceptors, known as long-, medium-, and short-wave receptors (L, M, and S) according to the wavelengths they are most sensitive to. A second stage of processing compares signals from the cones; for example the L and M cone responses are subtracted from each other in post-receptoral cells that receive opposing inputs (excitation or inhibition) from them. However, in common inherited color deficiencies the L or M photopigment gene is absent or altered [1–3], leading to a loss of one receptor type (dichromacy), or to a shift in wavelength sensitivity of the affected cone so that it is more similar to the normal M or L cone (anomalous trichromacy). The latter results in a smaller difference in the L vs M signal, and produces weaker sensitivity to the colors conveyed by this difference [4–7]. As an X-linked recessive trait, L vs M color deficiencies affect 6–8% of people with XY chromosomes, but are relatively rare in those with XX (<1%).
Color deficiencies are often modeled as a reduced form of normal trichromacy, in which visual processing is the same except for an initial alteration in the photopigments. In dichromats this reduction model accounts well for poorer color detection and discrimination thresholds in color deficient observers, and has played a critical role in estimating the cone spectral sensitivities [8, 9]. It also is the basis for most simulations of color deficiencies [10–12]. However, in anomalous trichromats the relationship between cone spectra and chromatic sensitivity can be highly variable and complex [13]. Moreover, for these observers the reduction model does not consider potential plasticity in visual coding, which could in principle compensate for a loss in sensitivity by amplifying the post-receptoral difference signals. In anomalous trichromats, the weakened L vs M signal could be restored by gain changes within color-opponent mechanisms, analogous to turning up the contrast on a monitor [14, 15]. Testing for such amplification provides an ideal natural model for studying the limits of long-term compensation in the visual system.
Yet despite this theoretical importance, whether and how color compensation occurs in anomalous trichromacy remains poorly understood (for review see [13] and [16]. The tasks indicating compensation tend to involve judging the similarity or size or salience of color differences [17–19], and thus could potentially reflect conceptual rather than perceptual adaptations. There have been few direct tests of compensation by measuring neural activity [20], and to our knowledge none using functional MRI to assess color processing in anomalous trichromats, a technique that has been shown to be an effective measure of color and contrast coding throughout cortex [21–26] [27–30]. Multiple color-selective areas have been identified along the ventral pathway [31–33], each with potentially different functions and representations of chromatic information. We focused on characterizing the strength of the responses to chromatic contrast in early cortical areas. Primary visual cortex appears to show some plasticity with respect to color over both the long [34] and short term [35], the latter consistent with numerous psychophysical and physiological studies, including fMRI [36, 37]. Thus, if amplification occurs in the neural responses to color for anomalous observers, then early visual cortex is a likely candidate site.
Results
Detection Thresholds.
Thresholds were collected for 5 out of the 7 anomalous trichromats (AT), and 6 of the 7 color normal controls (CN) (3 observers were unavailable for the threshold session). As expected, the ATs showed dramatically higher thresholds for detecting stimuli defined by L vs M cone differences. On average L vs M thresholds were 7.3 times higher for AT than control participants (AT mean = 9.39, AT SD = 1.81, CN mean = 1.29, CN SD = 0.25, t(9) = 10.98, p<0.001), while thresholds for detecting S vs LM stimuli, which should be relatively unaffected by the color deficiency, did not significantly differ (S vs LM color axis; AT mean = 1.77, AT SD = 0.35, CN mean = 1.71, CN SD = 0.57, t(9) = 0.221, P = 0.830)
Experiment 1: Simple Fixation Task.
We conducted two fMRI experiments to assess neural responses to chromatic contrast in the AT and CN observers. In the first, data were collected from a total of 10 participants (5 CN, 2 deuteranomalous, and 3 protanomalous AT), and stimuli consisted of reversing radial sinewave gratings along the 2 chromatic axes presented at 4 contrast levels (Figure 2A). Participants monitored the fixation point for occasional changes (from black to white) to ensure they were attending to the display. fMRI responses to the gratings arose most strongly in early visual areas, and the amount of activation was similar across groups, with greater chromatic responses in the ventral portions of V2 and V3 than in other regions, consistent with previous work [38]. Accordingly, we used the ventral portions of V2 and V3 in all analyses (Figure 2B, 3).
Figure 2. Experiment 1: Simple Fixation Task.
Results from Experiment 1. A) Illustration of the 2 color axes and 4 contrast levels used for both experiments. B) Points are β weights from Exp. 1, representing the estimated amplitude of the fMRI response during the simple fixation task. The top row are responses to the L vs M stimuli, and the bottom row are responses to the S vs LM stimuli. Columns are the three regions-of-interest: V1 (left), V2v (center), and V3v (right). The solid red and blue lines are model contrast response functions (CRFs) fitted to the data. The black dashed lines are response predictions for the AT group using the reduction model (see section on Testing for Amplification). Error bars are standard error of the mean. (See also Table S1, Figure S2, and Figure S3 for full statistics and individual results.)
Figure 3. Experiment 2: High-Attention Fixation Task.
Results from Experiment 2, high-attention fixation task for the L vs M axis. Plotting conventions are as in Figure 2. (See also Tables S1 and S2 and Figures S1, S2, and S3 for full statistics, individual results, and comparisons between the two conditions.)
The fMRI data showed reduced responses to L vs M stimuli for AT observers compared to normals in V1, but strikingly this reduction disappeared in V2 and V3, consistent with amplification in these later areas (Figure 2B). The statistical reliability of this pattern was assessed with a 2 x (3 × 2 × 4) mixed ANOVA using the β weights calculated from the GLM analysis of the fMRI data. The between subject factor was Observer Type (CN, AT), and the three within subject factors were Visual Area (V1, V2v, V3v), Color Axis (L vs M, S vs LM), and Contrast (10, 20, 40, 80 in nominal threshold units). Post-hoc pairwise comparisons were performed for the L vs M data in each ROI. All statistics reported were Greenhouse-Geisser corrected for sphericity, and pairwise comparisons were Bonferroni corrected for multiple comparisons. Critically, there was a significant difference between ATs and CNs (CI 95%, p = 0.04) in the L vs M response in V1, but not in V2v (CI 95%, p = 0.62) or V3v (CI 95%, p = 1.00). In comparison AT and CN responses were relatively equal in all three areas for S vs LM contrast, where amplification was not predicted. This overall pattern was evidenced in the ANOVA as a highly significant interaction between Group, Visual Area, and Color Axis (F3.195,25.558 = 3.67, p = 0.023, = 0.315). See Table S1 for full ANOVA results.
Experiment 2: High-Attentional Fixation.
A second experiment was designed to replicate our results using a more demanding attentional task. Attention and task can strongly modulate fMRI responses and alter the relationship between response amplitude and stimulus contrast [39, 40], as well as the representation of color, especially in later visual areas [28]. In this experiment we used a highly-demanding fixation task to further isolate “bottom-up” processing to the unattended color patterns. As in past work, observers monitored a stream of black and white numbers at fixation for specific feature conjunctions (e.g. a white 3) [41]. Measurements were collected for 5 AT and 7 CN observers, 3 AT participants and 5 controls participated in both Experiment 1 and 2.
The fMRI data revealed a very similar pattern to that observed in Experiment 1, again supporting amplification – with weaker L vs M responses in V1 for AT observers, but not in later regions (Figure 3, V1: CI 95%, p = 0.02, V2v: CI 95%, p = 0.995, V3v: CI 95%, p = 1.00), see Table S1 for full ANOVA results. The closeness of the two curves suggests that amplification almost completely compensated for receptoral differences by bringing AT cortical responses to CN levels. As in Experiment 1, there were no reliable differences between the ATs and CNs in cortical responses to S vs LM contrasts. As a further control, data were also collected from 1 protanopic observer (male, 31). This participant did not show consistent contrast response functions to the L vs M stimuli, thus providing support that our stimuli were specifically targeting chromatic channels (see Figure S4).
5 CNs and 3 ATs participated in both Experiments 1 and 2. We used their data to compare the two attention tasks. (See Figure S1). Overall, AT participants showed slightly lower activation in general during the simple fixation task, but this difference was not significant and only appeared in area V1. We also found no significant effects of the attention task (F1,6.000 = 3.74, p = 0.101, = 0.384). (See Table S2 for full ANOVA.)
Testing for Amplification by Modeling Contrast Response.
To quantify post-receptoral gain in the chromatic signal, we compared cortical responses to an implementation of the reduction model. As a first step, we quantified how responses varied with contrast, by fitting to the data a standard contrast response function (CRF) that has been previously used to quantify the changes in BOLD signal with contrast [42]:
where R is the measured BOLD response, c is the stimulus contrast, and Rmax, c50, p, and q control the function’s shape. Rmax, c50, p, and q were all allowed to vary. The fitted functions are shown as the solid lines in Figures 2B and 3, with control observers in gray, and AT observers in red and blue, and these fitted functions accounted for the data well. Note that these fits were calculated separately for each visual area, since the contrast response functions tend to flatten in higher visual areas [43–46]. See Table S4 for fitted parameters.
We next compared responses of AT observers to predictions of the reduction model, which assumes that all differences between groups are due to photoreceptor sensitivity differences (i.e. that no amplification occurs). The model assumes: 1) that L vs M sensitivity differences arise when information from the cones is first combined into color-opponent signals, that include L vs M contrast, 2) that this reduced L vs M signal propagates through the entire visual pathway, and 3) that the reduced L vs M signal strength is proportional to the reduction in L vs M contrast detection thresholds. This model predicts that L vs M differences at threshold index an identical loss in effective contrast in each area along the cortical pathways, and so CRFs for AT observers in each region should be the same as CNs after rescaling the effective stimulus contrast by the ratio of normal to anomalous thresholds. This rescaling produces a shift of the curve along the horizontal contrast axis, and is a standard model of reduced visual sensitivity (e.g. it is also routinely used to account for differences in sensitivity to different spatial frequencies, velocities, etc.) The model predictions are shown as the black dashed line in Figures 2B and 3., and they approximate the weaker BOLD responses observed in V1 but clearly fall below the responses in V2v and V3v. (See Figures S2 and S3 for individual data and fits.), suggestive of amplification in the AT observers.
To quantify the amount of amplification, we instead scaled the stimulus contrast (c) to fit each AT observer’s individual CRF, with other parameters held constant, and compared this to the contrast scaling predicted by the reduction model (i.e. scaled by their thresholds). Note again that this comparison was done separately for each area to control for differences in the CRF across areas. A ratio of 1 would indicate that the AT’s CRF was consistent with the reduction model, while values greater than 1 would indicate compensation. The resulting ratios again showed clear evidence for amplification. Mean values were 2.94 (sd = 2.81) for V1, 6.39 (sd = 5.21) for V2v, and 7.82 (sd = 5.76) for V3v. For Experiment 2, where we had threshold measures for all 5 AT observers, we compared this scaling factor to 1 (the reduction model prediction), and it was significantly above 1 in V2v (t(4) = 5.12, p = 0.01) and in V3v (t(4) = 4.27, p = 0.03), but not in V1 (t(4) = 1.42, p = 0.07). We also performed a repeated measures ANOVA on the scaling factors and found a significant effect of ROI, (F(2) = 4.98, p = 0.04).
Discussion
Our results point to strong compensation for color losses in anomalous trichromacy through amplification of cortical responses to chromatic contrast. This in turn suggests that the greater than expected responses to colors observed behaviorally [17–19] may reflect actual gain changes in early cortical processing. Both the neural and behavioral evidence are not inconsistent with the profound sensitivity losses in color-anomalous observers in threshold discrimination for color, since these thresholds are limited by noise, which may also be amplified by the gain change [14, 15, 47]. The suprathreshold compensation for color contrast may be similar to effects observed for spatial contrast, where thresholds depend strongly on spatial frequency (pattern size) yet once above threshold perceived contrast is independent of frequency [48]. In this regard it is notable that less compensation is evident at the lowest contrast we tested (10) which was near the mean threshold for the anomalous observers, though this difference only appears in Experiment 1.
Our results also point to an early but not initial stage of cortical coding as the site of the contrast amplification. Both experiments showed that the L vs M responses were consistent with the reduction model in V1 but were indistinguishable from color-normals in V2v and V3v. The fact that this pattern persisted under the attentionally demanding task of Experiment 2 suggests top-down modulation is not responsible for the neural gain occurring between V1 and V2v. Given the plasticity of V1, it is not clear why a long-term adjustment for chromatic contrast would first emerge in V2. While chromatic processing is known to undergo a series of transformations along the ventral stream, the function of different areas and representations remains uncertain [27, 30, 49, 50]. How these stages might be impacted by a color deficiency could further elucidate not only the nature of the plasticity but also their potential role in color perception. Thus it would be instructive in future studies to explore the magnitude and pattern of compensations at higher stages of the ventral pathway.
Importantly, however, our results do not preclude a gain change occurring in V1, since the BOLD contrast response could be disproportionately driven by the input layers and thus depend on the responses inherited from the LGN [51]. Thus it may be that AT and CN participants have more similar responses in the output layers of V1 (for review see [52]). Moreover, the differences between V1 and V2v varied for individual observers, consistent with previous studies showing that anomalous trichromats are a highly heterogeneous group [18, 53]. Of our 7 AT participants, 3 seemed to show more similar levels of activation to CN observers in area V1 (Figure S3, Table S3). Considering this, we cannot rule out some amplification within V1. One AT (PA-01) also showed unusually low responses to every level of L vs M contrast (Figure S3). However, the general pattern we observed persisted when the results were re-analyzed without including this observer.
The weak chromatic responses in V1 do imply that there is relatively little compensation prior to cortex. This conclusion is also consistent with a recent study using visual evoked potentials, which found evidence for color compensation but only when the stimuli were viewed binocularly [20], implying a cortical site since signals from the two eyes first converge in V1. The emergence of compensation in the cortex would mean that the retina and LGN remain in a weakened, unadjusted state for processing the L vs M signals. While there are increasing signs of short-term plasticity, specifically contrast adaptation, at these early stages [54–56], contrast adaptation is known to be substantially stronger in the visual cortex [36], especially within the parvocellular pathway along which the L vs M signals are carried [54, 57].
The adjustments we measured could potentially represent a very long-term form of visual plasticity, though we cannot rule out a process that acts more rapidly. Color vision adjusts to changes in the environment or observer over widely varying timescales [58], and compensation for the color losses could similarly involve multiple timescales and processes. For example a recent study found that color percepts in anomalous observers could be enhanced after just a few days wearing glasses that increased the L vs M contrasts [59]. One potential mechanism that could account for the compensatory adjustments we observed is sensory adaptation, in which neural signals adjust to the average and range of the ambient stimulation [60]. If the contrast is too low, then a neuron may increase its sensitivity so that the range of outputs is maintained [47, 61]. Most studies of adaptation have focused on very short-term aftereffects and on sensitivity losses rather than gains. However, exposures to contrast losses as brief as a few hours have been found to lead to compensatory enhancements of contrast sensitivity [62–64]. Our study is a natural color analog of adapting to a contrast reduction but measured over a lifetime of exposure.
The results of the present study are relevant not only to color but to understanding adaptation and neural calibration more generally, for the patterns and mechanisms of plasticity appear to be very similar across sensory levels and modalities [37]. Our results suggest that the nervous system can, at least in some cases, strongly compensate for a weakened initial coding of stimuli. How and under what circumstances such compensation can occur has important implications for treatment of visual disorders, as well as for the increasing prospects of gene therapy for color deficiencies [65]. In turn, it is clear that perception and performance for many visual tasks remains compromised for most anomalous trichromats, and even when there is clear evidence for compensation it is typically not complete [21]. Understanding what factors act to mitigate full compensation might help elucidate fundamental neural constraints on sensory plasticity [16].
STAR Methods
Resource Availability
Lead Contact.
Further information and requests for resources should be sent to the Lead Contact, Katherine E.M. Tregillus (kmussell@umn.edu). There is no restriction for distribution of materials.
Material Availability.
This study did not generate any new reagents.
Data and Code Availability.
Original/source data for Figures 2B and 3 in the paper are available for download on the Open Science Framework at https://osf.io/2sv9y
Experimental Model and Subject Details.
A total of 7 anomalous trichromats (AT) were recruited from The University of Nevada-Reno and the community (3 deuteranomalous, 4 protanomalous, all male), ages 19–42. Color-normal control participants were all UNR students (including author KT), ages 24–38, 2 female. We also tested one dichromat (a protanope) as a further control (see Figure S4). 3 AT participants and 5 controls participated in both Experiment 1 and 2. AT participants were recruited with flyers and classroom announcements specifically seeking “colorblind” participants, or who had failed color screenings from previous assessments at UNR and who had agreed to be contacted for future experiments. Due to our recruitment methods (including initial self-diagnosis), it is likely we gathered participants with generally more severe deficits. Chromatic contrast detection thresholds were collected for 6 of the controls and 5 AT participants, 2 AT and 1 CN were not tested because they were not available. All procedures were approved by the University of Nevada, Reno’s institutional review board, and all participants provided informed consent prior to testing.
Method Details
Anomaloscope.
The color vision of all participants was assessed using standard color screening techniques, including Rayleigh matching using a Heidelbert-Multi-Color Anomaloskop (OCULUS, Inc., Wetzlar, Germany). The match range was then used to calculate the anomaly quotient (AQ), which was used as the diagnostic criterion with an AQ of less than 0.7 indicating protanomalous, an AQ range of 0.7 to 1.4 color normal, and an AQ of greater than 1.4 deuteranomalous, where 1 is an equal mixture of red and green, less than 1 is a higher proportion of red, and greater than 1 is a higher proportion of green. Dichromats are able to match the orange test field to almost any red-green mixture by adjusting the brightness, and are thus easily differentiable from AT observers.
Stimuli.
Stimuli were presented on calibrated computer screens in testing rooms at UNR or the fMRI facility at Renown Health Hospital (Reno, NV). Thresholds were collected using a SONY 20SE monitor, with displays controlled by a Cambridge Research Systems (Kent, UK) Visual Stimulus Generator (VSG) board, which allowed for high color resolution. fMRI stimuli were displayed on a 32 in. SensaVue (85 Hz refresh rate) monitor (Invivo, Inc. Gainesville, FL) situated behind the scanner bore and viewed through a head-mounted mirror. The monitor’s maximum visual field was 31 deg. by 19 deg. Both monitors were calibrated with a Photo Research (Syracuse, NY) PR655 spectroradiometer, and gun outputs were linearized through lookup tables.
Participants were presented with phase reversing (1 Hz) radial sinewave gratings (0.28 c/deg., 14.5 deg field) defined by chromatic variations along either the L vs M or S vs LM cone-opponent axes (Figure 2A). The same stimuli were used in the scanner and during the threshold task, similar to stimuli used by Mullen et al. [26]. Both chromatic directions were shown at 4 levels of chromatic contrast for a total of 8 conditions (Figure 2A). Contrasts were scaled roughly as multiples of detection threshold for normal trichromats based on a previous study [66, 67]. In units of pooled cone contrast the highest contrast stimuli were 12% and 70% for L vs M and S vs LM gratings respectively. All stimuli were produced with the Psychophysics Toolbox [68] for MATLAB (Mathworks Inc., Natick, MA).
Isoluminance Settings.
Participants were first adapted to a neutral gray background for 1 minute, and then completed a minimum motion task to determine isoluminance [69]. The minimum motion stimuli consisted of alternating achromatic and chromatic concentric sinusoidal gratings that were offset in phase. Participants were instructed to adjust the gratings until the stimuli no longer appeared to radiate inward or outward. Stimulus luminance was adjusted individually for each observer. Individual isoluminance measures were obtained separately for the different display systems used for the threshold and fMRI experiments.
Chromatic Detection Thresholds.
We used a temporal 2-alternative forced choice task to measure contrast detection thresholds. The grating was shown in one of two temporal intervals (1 sec. on, 1 sec. off) signaled by beeps, and participants pressed a button to indicate at which interval the grating appeared. Contrast was varied in two randomly interleaved staircases (2 up, 1 down). Each staircase terminated after 10 reversals. The average of the last 8 reversals across each staircase was taken as the participant’s detection threshold. S vs LM and L vs M contrast thresholds were collected during the same session, but across different runs. Thresholds were collected in a separate session and location from the fMRI data.
fMRI Procedure.
Data were acquired on a Philips 3T Ingenia scanner using a 32-channel digital SENSE head coil (Philips Medical Systems, Best, Netherlands). Functional data for Experiments 1 and 2 were obtained using T2*-weighted, echo planar images (2 sec. TR, 180 volumes, voxel size 2.75 × 2.75 × 3 mm3, 36 slices, 55 ms inter slice time, 0 mm gaps). We used a block design where a run consisted of 16 blocks of 14 sec. each, interleaved with 8 sec. fixation-only gaps. Each stimulus type was presented twice per run, and the order was counterbalanced across runs. Each run lasted 360 sec. In Experiment 1, all participants completed 8 runs. In Experiment 2, participants completed 6 runs, reduced from Experiment 1. Anatomical scans occurred halfway through a session in order to reduce motion artifacts. Anatomical scans were collected using T1 weighted images (voxel size of 1×1×1 mm3, 30 sec transverse slices, 17 ms TE, 76o flip angle, and 220 × 220 mm2 field of view). Anatomical and functional runs were collected within a single session for 12 of the participants, while the remaining 2 participants completed functional runs across two sessions.
Fixation Tasks.
During scans in Experiment 1, participants completed a simple fixation task to ensure that they were responsive and fixating during the stimulus presentation. The black fixation circle flickered at random, jittered intervals, and the participants were instructed to make a response when a change occurred. In order to further test and control for attentional effects on the BOLD contrast response, Experiment 2 used a more demanding fixation task [39]. The fixation mark for this task was a number that randomly switched from black to white at a jittered rate, while also changing to a random number from 1 to 9. Participants were assigned a random pair of number conjunctions and asked to press a button when either conjunction appeared (e.g. black nine or white three) [41].
Quantification and Statistical Analysis
fMRI Data Analysis.
Images acquired from the scanner were pre-processed before analysis. This included slice scan time correction as well as motion correction, which were both conducted using SPM12 (SPM software package, Wellcome Department, London, UK; http://www.fil.ion.ucl.ac.uk/spm/) and custom lab scripts. Data were motion corrected using a rigid body transform and 7th degree B-spline interpolation. Images were slice scan time corrected (ascending, interleaved) using the first image as the reference slice and resliced into the space of the first image.
Volumetric segmentation of white matter was performed using Freesurfer (v6.0) (http://surfer.nmr.mgh.harvard.edu/) [70, 71]. 3D surface reconstructions of the left and right hemisphere were generated using mrMesh (a function within the mrVista Toolbox) by growing a 3-voxel thick layer above the gray/white boundary. To improve data visualization (i.e. when projecting functional data onto surfaces), these surfaces were also computationally-inflated using the “smoothMesh” option in mrMesh (8 iterations). Note that the cortical surface models were only used for data visualization and region-of-interest (ROI) definition. All analyses and statistics were performed using the volumetric data.
Due to limited scan time, an anatomical template of retinotopic maps in early visual areas was used to approximate the cortical location of visual areas (V1, V2, V3) and eccentricity ranges that the stimulus subtended (0.00°–9.50°) [72, 73]. The retinotopy template was fitted to each subject’s anatomical segmentation using Freesurfer (v6.0) (http://surfer.nmr.mgh.harvard.edu/) [70, 71]. This is a well validated approach to estimating the location of early visual areas that accounts for anatomical variability across subjects by aligning and morphing the template onto each individual subject’s anatomy (see Figure 4A for an example of the retinotopic template aligned to a subject’s cortical surface). As a sanity check, we plotted percent signal change from ROIs drawn from the template (see Figure 4B for an example), and we find that ROIs across visual areas V1, V2v, and V3v demonstrate reliable signal change in response to each color/contrast condition used in the present study.
Figure 4. fMRI Data Analysis.
A) Example retinotopic template (polar angle–left, eccentricity—right) aligned to an exemplar subject’s left hemisphere (sub-04, CN, exp-02). V1, V2v, and V3v ROIs are drawn on the inflated cortical surface depicted here. The range of the eccentricity map was clipped to 0.00° to 9.50°, corresponding to the range the stimulus subtended. The ROIs have the central 0.00°–0.95° clipped to exclude the fixation point and the mean luminance gray gap between the fixation point and the stimulus. B) Plots of percent signal change in V1, V2v, and V3v in an exemplar subject (sub-04, CN, exp-02). The data was averaged across 6 runs. Each run consisted of 16 blocks where each condition was presented twice (6 runs x 2 repetitions = 12 repetitions total for each condition). The stimulus was presented for 14 seconds (stimulus onset is at 0 seconds in the plots above). A mean luminance blank screen was presented for 8 seconds between blocks.
Statistics.
Analysis of the fMRI results were performed using SPSS (IMB Corp., Chicago, IL). A 2 x (3 × 2 × 4) mixed ANOVA was conducted on the β weights calculated from the GLM analysis of the fMRI data for Experiment 1 (n = 10, 5 CN, 5 AT) and Experiment 2 (n = 12, 7 CN, 5 AT). The between subject factor was Color Vision Type (CN, AT), and the three within subject factors were Visual Area (V1, V2v, V3v), Color (L vs M, S vs LM), and Contrast (10, 20, 40, 80). See Results section and Table S1 for these results. To compare Experiment 1 and Experiment 2 results, another ANOVA was conducted with the additional within subject factor of Attention (high, low). Only participants in both experiments were included in this analysis (n = 8, 5 CN, 3 AT). See Results section and Table S2 for these results.
Fitting Contrast Response Function.
Further analysis in the mrVista Toolbox included a general linear model (GLM) of responses across early visual areas (V1, V2v, V3v) for each individual subject. The eccentricity range 0.00°–0.95° was excluded from each ROI prior to analysis to exclude the fixation point and mean luminance gray gap between the fixation point and the stimulus. A standard gamma-function HRF was used to model the hemodynamic response function [42]. All runs were concatenated and the null gray background condition was used as baseline. After β weights were calculated, a repeated measures ANOVA was performed on these values in order to determine the effects of each condition individually across visual areas.
We then fit data with a contrast response function:
where Rmax, c50, p, and q varied freely, though to aid fitting we set an upper-bound of 4 for p and q since previous work estimates their values for early visual areas to sit between 0.1 and 2.0 [42]. No bounds were set on Rmax and c50. In its typical form, when c>c50, the function is a simple power function with an exponent of p+q. The function is expansive at low contrasts, and compressive at high contrasts. See Table S4 for a list of all fitted parameters.
To compute predictions of the reduction model, we scaled the contrast by the ratio of thresholds of CN and AT observers, t:
Other values were fixed at values that best fit the mean response from CN observers.
To compute the amount of amplification, we further scaled contrast by a scaling factor, sc, and again kept all other parameters fixed at values from the mean CN response:
We estimated sc for each individual AT observer, and these results are listed in Table S3. Because it is a multiplicative factor, we used the log of the scaling parameter in a one-sample t-test to determine if the AT responses were amplified, i.e. they differed significantly from their threshold-scaled predictions, which will be the case if the scaling factor differs from 1.
Supplementary Material
Figure 1. Detection Thresholds.
Chromatic contrast detection thresholds for the two chromatic axes, represented in nominal multiples of threshold where thresholds for observers with no color deficits should be at about 1. Settings are shown for each individual observer and for the mean of the control (gray) or anomalous (red or blue) participants. Error bars represent one standard error of the mean. (See also Table S3 for individual participant summaries.)
KEY RESOURCES TABLE.
| REAGENT or RESOURCE | SOURCE | IDENTIFIER |
|---|---|---|
| Deposited Data | ||
| Open Science Framework | This study | https://osf.io/2sv9y |
| Software and Algorithms | ||
| MATLAB | Mathworks Inc., Natick, MA | https://www.mathworks.com/products/matlab.html |
| Psychophysics Toolbox | [68] | http://psychtoolbox.org/ |
| SPSS Statistics | IBM Corp. Chicago, IL | https://www.ibm.com/products/spss-statistics |
| mrVISTA | VISTA Lab Tools, Stanford VISTA Laboratory | https://web.stanford.edu/group/vista/cgi-bin/wiki/index.php/Main_Page |
| Freesurfer (v6.0) | Laboratory for Computational Neuroimaging, Athinoula A. Martinos Center for Biomedical Imaging | http://surfer.nmr.mgh.harvard.edu |
| Retinotopy Template | [72, 73] | https://cfn.upenn.edu/aguirre/wiki/public:retinotopy_template |
| SPM12 | SPM software package, Wellcome Department, London, UK | http://www.fil.ion.ucl.ac.uk/spm |
| Other | ||
| Heidelbert-Multi-Color Anomaloskop | OCULUS, Inc., Wetzlar, Germany | https://www.oculus.de/us/products/visual-test-equipment/hmc-anomaloskop/highlights |
| Philips 3T Ingenia scanner | Philips Medical Systems, Best, Netherlands | https://www.usa.philips.com/healthcare |
| Visual Stimulus Generator (VSG) | Cambridge Research Systems, Kent, UK | https://www.crsltd.com/ |
| SensaVue (85 Hz refresh rate) monitor | Invivo, Inc. Gainesville, FL | https://www.usa.philips.com/healthcare/product/HC784005/sensavue-audio-and-visual-display-for-mri-suites |
| PR655 Spectroradiometer | Photo Research, Syracuse, NY | https://www.jadaktech.com/products/photo-research/ |
Highlights.
fMRI results reveal neural compensation for color deficiency in early visual cortex
Anomalous trichromat BOLD responses to color are elevated in V2 and V3 but not V1
Results persist with altered attention, suggesting adaptive gain in early cortex
Acknowledgements
Research supported by EY-10834 and P20-GM103650 (MW). Additional support for color screening and participant recruitment from Dr. Michael Crognale and the Crognale Color Vision Assessment Clinic at UNR.
Footnotes
Declaration of Interests
The authors declare no competing interests.
References
- 1.Neitz M, and Neitz J (2000). Molecular genetics of color vision and color vision defects. Archives of Ophthalmology 118, 691–700. [DOI] [PubMed] [Google Scholar]
- 2.MacLeod DIA, and Hayhoe M (1974). Three pigments in normal and anomalous color vision. JOSA 64, 92–96. [DOI] [PubMed] [Google Scholar]
- 3.Neitz J, and Neitz M (2011). The genetics of normal and defective color vision. Vision research 51, 633–651. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Merbs SL, and Nathans J (1992). Absorption spectra of human cone pigments. Nature 356, 433. [DOI] [PubMed] [Google Scholar]
- 5.Merbs SL, and Nathans J (1992). Absorption spectra of the hybrid pigments responsible for anomalous color vision. Science 258, 464–467. [DOI] [PubMed] [Google Scholar]
- 6.Nathans J, Piantanida TP, Eddy RL, Shows TB, and Hogness DS (1986). Molecular genetics of inherited variation in human color vision. Science 232, 203–210. [DOI] [PubMed] [Google Scholar]
- 7.Asenjo AB, Rim J, and Oprian DD (1994). Molecular determinants of human red/green color discrimination. Neuron 12, 1131–1138. [DOI] [PubMed] [Google Scholar]
- 8.Stockman A, MacLeod DI, and Johnson NE (1993). Spectral sensitivities of the human cones. J Opt Soc Am A Opt Image Sci Vis 10, 2491–2521. [DOI] [PubMed] [Google Scholar]
- 9.Smith VC, and Pokorny J (1975). Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Res 15, 161–171. [DOI] [PubMed] [Google Scholar]
- 10.Vienot F, Brettel H, Ott L, Ben M’Barek A, and Mollon JD (1995). What do colour-blind people see? Nature 376, 127–128. [DOI] [PubMed] [Google Scholar]
- 11.Jacobs GH (2018). Photopigments and the dimensionality of animal color vision. Neuroscience and biobehavioral reviews 86, 108–130. [DOI] [PubMed] [Google Scholar]
- 12.Yaguchi H, Luo J, Kato M, and Mizokami Y (2018). Computerized simulation of color appearance for anomalous trichromats using the multispectral image. JOSA A 35, B278–B286. [DOI] [PubMed] [Google Scholar]
- 13.Bosten J (2019). The known unknowns of anomalous trichromacy. Current Opinion in Behavioral Sciences 30, 228–237. [Google Scholar]
- 14.Webster MA, Juricevic I, and McDermott KC (2010). Simulations of adaptation and color appearance in observers with varying spectral sensitivity. Ophthalmic and Physiological Optics 30, 602–610. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.MacLeod DIA (2003). Colour discrimination, colour constancy, and natural scene statistics (The Verriest Lecture). In Normal and Defective Colour Vision, Mollon JD, Pokorny J, and Knoblauch K, eds. (London: Oxford University Press; ). [Google Scholar]
- 16.Isherwood ZI, Joyce DS, Kuppuswamy Parthasarathy M, & Webster MA, (In press). Plasticity in perception: Insights from color deficiencies F1000 Faculty Rev. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Boehm AE, MacLeod DIA, and Bosten JM (2014). Compensation for red-green contrast loss in anomalous trichromats. Journal of vision 14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Regan BC, and Mollon JD (1997). The relative salience of the cardinal axes of colour space in normal and anomalous trichromats. In Colour Vision Deficiencies, Cavonius CR, ed. (Kluwer: Dordrecht: ), pp. 261–270. [Google Scholar]
- 19.Knoblauch K, Marsh-Armstrong B, and Werner JS (2020). Suprathreshold contrast response in normal and anomalous trichromats. J Opt Soc Am A Opt Image Sci Vis 37, A133–A144. [DOI] [PubMed] [Google Scholar]
- 20.Rabin J, Kryder A, and Lam D (2018). Binocular facilitation of cone-specific visual evoked potentials in colour deficiency. Clinical and Experimental Optometry 101, 69–72. [DOI] [PubMed] [Google Scholar]
- 21.Mullen KT, Chang DHF, and Hess RF (2015). The selectivity of responses to red-green colour and achromatic contrast in the human visual cortex: an fMRI adaptation study. European Journal of Neuroscience 42, 2923–2933. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Johnson EN, and Mullen KT (2016). Color in the Cortex. In Human Color Vision (Springer; ), pp. 189–217. [Google Scholar]
- 23.Kuriki I, Sun P, Ueno K, Tanaka K, and Cheng K (2015). Hue selectivity in human visual cortex revealed by functional magnetic resonance imaging. Cerebral Cortex, bhv198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Engel S, Zhang X, and Wandell B (1997). Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature 388, 68–71. [DOI] [PubMed] [Google Scholar]
- 25.Wade A, Augath M, Logothetis N, and Wandell B (2008). fMRI measurements of color in macaque and human. Journal of Vision 8, 6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Mullen KT, Dumoulin SO, McMahon KL, De Zubicaray GI, and Hess RF (2007). Selectivity of human retinotopic visual cortex to S-cone-opponent, L/M-cone-opponent and achromatic stimulation. European Journal of Neuroscience 25, 491–502. [DOI] [PubMed] [Google Scholar]
- 27.Brouwer GJ, and Heeger DJ (2009). Decoding and reconstructing color from responses in human visual cortex. The Journal of Neuroscience 29, 13992–14003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Brouwer GJ, and Heeger DJ (2013). Categorical clustering of the neural representation of color. J Neurosci 33, 15454–15465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Persichetti AS, Thompson-Schill SL, Butt OH, Brainard DH, and Aguirre GK (2015). Functional magnetic resonance imaging adaptation reveals a noncategorical representation of hue in early visual cortex. J Vis 15, 18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Kim I, Hong SW, Shevell SK, and Shim WM (2020). Neural representations of perceptual color experience in the human ventral visual pathway. Proceedings of the National Academy of Sciences 117, 13145–13150. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Beauchamp MS, Haxby JV, Jennings JE, and DeYoe EA (1999). An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex. Cereb Cortex 9, 257–263. [DOI] [PubMed] [Google Scholar]
- 32.Lafer-Sousa R, Conway BR, and Kanwisher NG (2016). Color-Biased Regions of the Ventral Visual Pathway Lie between Face- and Place-Selective Regions in Humans, as in Macaques. J Neurosci 36, 1682–1697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Siuda-Krzywicka K, Witzel C, Bartolomeo P, and Cohen L (2020). Color naming and categorization depend on distinct functional brain networks. BioRxiv. [DOI] [PubMed] [Google Scholar]
- 34.Webster MA, and Mollon JD (1997). Adaptation and the color statistics of natural images. Vision research 37, 3283–3298. [DOI] [PubMed] [Google Scholar]
- 35.Engel SA, and Furmanski CS (2001). Selective adaptation to color contrast in human primary visual cortex. Journal of Neuroscience 21, 3949–3954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kohn A (2007). Visual adaptation: physiology, mechanisms, and functional benefits. Journal of neurophysiology 97, 3155–3164. [DOI] [PubMed] [Google Scholar]
- 37.Webster MA (2015). Visual adaptation. Annual Review of Vision Science 1, 547–567. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Brewer AA, Liu J, Wade AR, and Wandell BA (2005). Visual field maps and stimulus selectivity in human ventral occipital cortex. Nature neuroscience 8, 1102–1109. [DOI] [PubMed] [Google Scholar]
- 39.Kay KN, and Yeatman JD (2017). Bottom-up and top-down computations in word-and face-selective cortex. eLife 6, e22341. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Gandhi SP, Heeger DJ, and Boynton GM (1999). Spatial attention affects brain activity in human primary visual cortex. Proceedings of the National Academy of Sciences 96, 3314–3319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Goddard E, Mannion DJ, McDonald JS, Solomon SG, and Clifford CWG (2010). Combination of subcortical color channels in human visual cortex. Journal of vision 10, 25. [DOI] [PubMed] [Google Scholar]
- 42.Boynton GM, Demb JB, Glover GH, and Heeger DJ (1999). Neuronal basis of contrast discrimination. Vision research 39, 257–269. [DOI] [PubMed] [Google Scholar]
- 43.Boynton GM, Engel SA, Glover GH, and Heeger DJ (1996). Linear systems analysis of functional magnetic resonance imaging in human V1. Journal of Neuroscience 16, 4207–4221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Olman CA, Ugurbil K, Schrater P, and Kersten D (2004). BOLD fMRI and psychophysical measurements of contrast response to broadband images. Vision Res 44, 669–683. [DOI] [PubMed] [Google Scholar]
- 45.Buracas GT, Fine I, and Boynton GM (2005). The relationship between task performance and functional magnetic resonance imaging response. J Neurosci 25, 3023–3031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Isherwood ZJ, Schira MM, and Spehar B (2017). The tuning of human visual cortex to variations in the 1/f(alpha) amplitude spectra and fractal properties of synthetic noise images. Neuroimage 146, 642–657. [DOI] [PubMed] [Google Scholar]
- 47.Rieke F, and Rudd ME (2009). The challenges natural images pose for visual adaptation. Neuron 64, 605–616. [DOI] [PubMed] [Google Scholar]
- 48.Georgeson MA, and Sullivan GD (1975). Contrast constancy: deblurring in human vision by spatial frequency channels. J Physiol 252, 627–656. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Conway BR (2014). Color signals through dorsal and ventral visual pathways. Visual neuroscience 31, 197–209. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Zaidi Q, and Conway B (2019). Steps towards neural decoding of colors. Current Opinion in Behavioral Sciences 30, 169–177. [Google Scholar]
- 51.Marquardt I, Schneider M, Gulban OF, Ivanov D, and Uludağ K (2018). Cortical depth profiles of luminance contrast responses in human V1 and V2 using 7 T fMRI. Human Brain Mapping 39, 2812–2827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Sincich LC, and Horton JC (2005). The circuitry of V1 and V2: integration of color, form, and motion. Annu Rev Neurosci 28, 303–326. [DOI] [PubMed] [Google Scholar]
- 53.He JC, and Shevell SK (1995). Variation in color matching and discrimination among deuteranomalous trichromats: Theoretical implications of small differences in photopigments. Vision research 35, 2579–2588. [DOI] [PubMed] [Google Scholar]
- 54.Solomon SG, Peirce JW, Dhruv NT, and Lennie P (2004). Profound contrast adaptation early in the visual pathway. Neuron 42, 155–162. [DOI] [PubMed] [Google Scholar]
- 55.Chang DHF, Hess RF, and Mullen KT (2016). Color responses and their adaptation in human superior colliculus and lateral geniculate nucleus. Neuroimage 138, 211–220. [DOI] [PubMed] [Google Scholar]
- 56.Gollisch T, and Meister M (2010). Eye smarter than scientists believed: neural computations in circuits of the retina. Neuron 65, 150–164. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Lutze M, Pokorny J, and Smith VC (2006). Achromatic parvocellular contrast gain in normal and color defective observers: Implications for the evolution of color vision. Visual neuroscience 23, 611–616. [DOI] [PubMed] [Google Scholar]
- 58.Tregillus KE, and Engel SA (2019). Long-term adaptation to color. Current Opinion in Behavioral Sciences 30, 116–121. [Google Scholar]
- 59.Werner JS, Marsh-Armstrong B, and Knoblauch K (2020). Adaptive Changes in Color Vision from Long-Term Filter Usage in Anomalous but Not Normal Trichromacy. Current Biology. [DOI] [PubMed] [Google Scholar]
- 60.Webster MA (1996). Human colour perception and its adaptation. Network: Computation in Neural Systems 7, 587–634. [Google Scholar]
- 61.von der Twer T, and MacLeod DIA (2001). Optimal nonlinear codes for the perception of natural colours. Network: Computation in Neural Systems 12, 395–407. [PubMed] [Google Scholar]
- 62.Haak KV, Fast E, Bao M, Lee M, and Engel SA (2014). Four days of visual contrast deprivation reveals limits of neuronal adaptation. Current Biology 24, 2575–2579. [DOI] [PubMed] [Google Scholar]
- 63.Kwon M, Legge GE, Fang F, Cheong AMY, and He S (2009). Adaptive changes in visual cortex following prolonged contrast reduction. Journal of vision 9, 20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Zhang P, Bao M, Kwon M, He S, and Engel SA (2009). Effects of orientation-specific visual deprivation induced with altered reality. Current Biology 19, 1956–1960. [DOI] [PubMed] [Google Scholar]
- 65.Neitz M, and Neitz J (2014). Curing color blindness—mice and nonhuman primates. Cold Spring Harb Perspect Med 4:a017418. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Webster MA, and Mollon JD (1994). The influence of contrast adaptation on color appearance. Vision research 34, 1993–2020. [DOI] [PubMed] [Google Scholar]
- 67.Webster MA, Miyahara E, Malkoc G, and Raker VE (2000). Variations in normal color vision. I. Cone-opponent axes. JOSA A 17, 1535–1544. [DOI] [PubMed] [Google Scholar]
- 68.Brainard DH (1997). The psychophysics toolbox. Spatial vision 10, 433–436. [PubMed] [Google Scholar]
- 69.Cavanagh P, MacLeod DIA, and Anstis SM (1987). Equiluminance: spatial and temporal factors and the contribution of blue-sensitive cones. JOSA A 4, 1428–1438. [DOI] [PubMed] [Google Scholar]
- 70.Fischl B, Sereno MI, Tootell RBH, and Dale AM (1999). High-resolution intersubject averaging and a coordinate system for the cortical surface. Human brain mapping 8, 272–284. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Fischl B, and Dale AM (2000). Measuring the thickness of the human cerebral cortex from magnetic resonance images. Proceedings of the National Academy of Sciences 97, 11050–11055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Benson NC, Butt OH, Datta R, Radoeva PD, Brainard DH, and Aguirre GK (2012). The retinotopic organization of striate cortex is well predicted by surface topology. Current Biology 22, 2081–2085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Benson NC, Butt OH, Brainard DH, and Aguirre GK (2014). Correction of distortion in flattened representations of the cortical surface allows prediction of V1-V3 functional organization from anatomy. PLoS Comput Biol 10, e1003538. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Original/source data for Figures 2B and 3 in the paper are available for download on the Open Science Framework at https://osf.io/2sv9y




