Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2020 Feb 13;10:2608. doi: 10.1038/s41598-020-59415-3

Incentive motivation improves numerosity discrimination: Insights from pupillometry combined with drift-diffusion modelling

Annika Dix 1,2,, Shu-Chen Li 1,2
PMCID: PMC7018719  PMID: 32054923

Abstract

Recent studies show that training the approximate number system (ANS) holds promise for improving symbolic math abilities. Extending this line of research, the present study aims to shed light on incentive motivation of numerosity discrimination and the underlying mechanisms. Thirty-two young adults performed a novel incentivized dot comparison task, that we developed, to discern the larger of two numerosities. An EZ-diffusion model was applied to decompose motivational effects on component processes of perceptual decision-making. Furthermore, phasic pupil dilation served as an indicator of the involvement of the salience network. The results of improved accuracy and a higher information accumulation rate under the reward condition suggest that incentive motivation boosts the precision of the ANS. These novel findings extend earlier evidence on reward-related enhancements of perceptual discrimination to the domain of numerosity perception. In light of the Adaptive Gain Theory, we interpret the results in terms of two processes of gain modulation driven by the locus coeruleus-norepinephrine system. Specifically, the reward-induced increase in pupil dilation may reflect incentive modulation of (i) salience attention during reward anticipation towards incentivized stimuli to upregulate stimulus processing that results in a larger drift rate; and (ii) response caution that leads to an increased decision threshold.

Subject terms: Perception, Reward

Introduction

“Number sense” refers to the intuitive ability to process numerical information without consciously dealing with symbolic representations of numbers1. This sense of numerosity has been widely studied and discussed as a foundational perceptual function that serves higher-order cognitive processes for the acquisition of abstract numerical concepts and mathematical skills in humans2. A subcomponent of this function is the approximate number system (ANS), which allows for a quick, albeit inexact, estimation of the number of sensory (e.g., visual or auditory) objects. The precision of ANS correlates with mathematic achievements throughout the lifespan3,4 and has been investigated in earlier training studies that were aimed at enhancing individuals’ ANS precision and related symbolic math abilities5. Such training usually only relies on accuracy-based feedback68, although reward incentive has been validated as a potent modifier of performance in many other cognitive and sensory domains (for reviews, see911). So far, systematic research on incentive motivation of the precision of the ANS has not been undertaken. Thus, the aim of the current study is twofold: (i) investigating whether incentive motivation improves numerosity discrimination; and (ii) understanding mechanisms underlying the potential incentive benefits.

Incentive motivational regulation implicates neural activities in the brain’s reward network, which broadly comprises various cortical and striatal regions that are richly innervated by the mesolimbic and nigrostriatal dopamine (DA) projections (for reviews, see1216). According to the Incentive Salience hypothesis13, reward-related DA signals in the mesolimbic system are assumed to strengthen the perceptual salience assigned to the neural representations of reward-associated objects; thereby, incentive motivation directs attention towards incentivized, though not necessarily task-relevant, stimuli (e.g., task-irrelevant features associated with reward during visual search)17. In a different vein, reward-induced perceptual enhancement has also been considered to stem from the impact of endogenous, top-down attentional regulation, which biases perception. The detection or discrimination of anticipated reward cues is facilitated through such processes10,1821. In line with these ideas, the present study aimed to examine the potential benefit of reward-related incentive salience on enhancing the precision of numerosity representations and thereby improving perceptual discrimination. In so doing, earlier studies on incentive-driven attention in visual search can be extended to the domain of numerosity perception. To better capture mechanisms underlying incentive motivation, other than behavioural performance we also assessed task-related pupil dilation (PD) – a measure that has been linked to activities in the brain’s salience network during reward processing22,23.

In earlier research, pupil size has primarily been used as a proxy to indicate norepinephrinergic activities subserving affective (e.g., arousal) and cognitive (e.g., attention or mental load) functions (see24,25 for reviews). According to the Adaptive Gain Theory (AGT) of locus coeruleus-norepinephrine (LC-NE) function by Aston-Jones and Cohen26, task-evoked (phasic) PD reflects neural activity in the LC that favours the processing of task-relevant information over task-irrelevant explorative behaviour in the environment. The AGT proposes that the LC receives direct inputs about costs and feedback in the current task from cortical structures, such as the anterior cingulate cortex (ACC) as part of the reward system. In line with this postulate, a study by Schneider et al.23, which combined pupillometry with functional magnetic resonance imaging (fMRI), found increased activation in the dorsal ACC to be positively correlated with PD during the expectation of monetary rewards. Another study by Manohar and Husain27 further lends support for the roles of the reward network and mesolimbic DA in mediating the association between incentive motivation and reward-induced PD. Using a speeded saccade task with monetary incentives, it was shown that pupillary reward sensitivity in patients with Parkinson’s disease was restored after being treated with a DA agonist. In the present study, we were particularly interested in whether phasic PD evoked by a reward cue may reflect effects of incentive modulation during a numerosity discrimination task. Furthermore, we examined whether incentive benefits on performance would be related to reward-induced phasic increase in pupil size.

One typical paradigm for studying numerosity discrimination is the non-symbolic dot comparison task, in which two arrays of dots are presented on each trial and the participants have to decide which array contains more dots3,4. In the research on perceptual decision-making, the drift-diffusion model (DDM) has been used widely to dissociate the decision process into distinct components28. In recent years, its application in the field of numerosity perception has gained increased attention. Park and Starns29 demonstrated that one parameter of this model, the drift rate (v), could serve as a measure of the precision of the ANS. It represents the efficiency of sensory evidence accumulation about the to-be-compared quantities. Since the DDM allows the decomposition of the decision process into subcomponents, it has advantages not only for studying numerical processing at the behavioural level with more specificity, but also for examining the mechanisms underlying reward-related modulations of the ANS. For instance, the drift rate of perceptual decision depends on various stimulus features, such as difficulty or perceptual salience. Further, it can also be affected by the person’s attentional focus28. Consistent with the Incentive Salience hypothesis, Spaniol et al.30 observed greater drift rates (i.e., more efficient information accumulation) in the reward condition as compared to a neutral condition of a perceptual discrimination task.

Besides the drift rate, DDMs have another parameter that reflects the decision criterion (threshold) at which point the necessary amount of evidence is reached for a given decision to be taken. This decision threshold, also known as the boundary separation (a) parameter, can be adapted to optimize accuracy per unit of time based on feedback favouring response speed over the accuracy or vice versa31 (cf. optimal-decision theories32). In a new reinforcement learning-based DDM, Fontanesi et al.33 recently observed a lower decision threshold for highly attractive options in a value-based decision-making task. This is in accordance with the findings by Cavanagh et al.34, who showed a reduced decision threshold in the most appetitive condition of a probabilistic selection task. Interestingly, in this latter study, which combined a hierarchical Bayesian DDM with pupillometry, larger PD was associated with increased response caution (i.e., a higher decision threshold) in high-conflict situations (i.e., appetitive conflict in the most appetitive and aversive conflict in the most aversive condition, respectively). Furthermore, the non-decision time (tER) parameter of DDMs captures response time (RT) that is not directly related to the decision process (e.g., sensory encoding or response execution)35. Due to its broad definition, this parameter theoretically reflects all non-decision related processes, which makes it – in terms of the meaning – less specific. It has been associated with various psychological constructs including attention and may thus be subject to reward-related modulation as well.

Taken together, the twofold purpose of the present study was to investigate the impact of incentive motivation on numerosity discrimination and to examine the underlying mechanisms by combining pupillometric measures with the application of a simplified version of the DDM, the EZ-diffusion model36. To this end, we developed a new incentivized dot comparison task (see Fig. 1 and the Methods section for more details). We expected that reward incentive would improve task performance by increasing the salience of the representations of different numerosities13. Relatedly, we assumed task-evoked PD to be larger during reward anticipation and when processing stimuli in rewarded trials compared to unrewarded trials. Moreover, we expected that a stronger reward modulation effect at the psychophysiological level would be associated with reward-induced performance outcomes (i.e., higher levels of bonus won in the task)23. Other than effects related to reward anticipation, we hypothesized that larger PD would reflect increased discrimination difficulty, that is, smaller differences between the quantities of the to-be-compared dot arrays in our paradigm (e.g., a ratio between the two arrays of 10:9 vs. 5:4).

Figure 1.

Figure 1

Schematic representation of the experimental task: (a) Trial scheme of the incentivized dot comparison task depicting the three phases (i.e., incentive cue, stimulus, feedback) of a correctly answered trial for both the reward (top) and the control (bottom) condition; (b) Scoring scheme shown after each block giving an overview about the points the participant collected in reward trials during the last block (white number) and the accumulated total points (red number and white bar) as well as the obtained bonus winning level (levels 1–15) and the corresponding items (pencil or vouchers; right panel) the participant had already won (see Methods section for more details about the task).

Regarding the subcomponents of the decision process, we hypothesized that reward would lead to an increase in drift rate (v)30, indicating enhanced precision of the ANS29 as well as affecting the decision threshold (boundary separation a) and the non-decision time (tER)35. To date, findings on the effects of reward on boundary separation are still somewhat mixed and studies on non-decision time are still underrepresented. Thus, it is harder to make clear predictions about these two parameters. In contrast, evidence of the effects of task difficulty or cognitive demand is more unequivocal. For instance, in conditions with higher processing conflicts that are subsequently cognitively more demanding, information accumulation should be slowed and the individuals probably would raise their response caution, while responses may generally also take more time (e.g., longer non-decision time)28. We thus anticipated drift rate (v) to decrease and boundary separation (a) and non-decision time (tER) to increase with greater task difficulty.

As for potential interactions between the effects of incentive and task difficulty on performance or pupillary response, conceptually we expected the difficulty effect to be attenuated under the reward condition if the effect of reward is in sharpening the representation of numerosity. Empirical evidence on this interaction in other domains of functioning is still mixed. In a study on speech processing, for instance, performance improvement under reward was only observed in the more demanding tasks. Further, in these tasks, PD was reduced for high but not low reward levels37. The authors interpret these findings in terms of strategic effort control to achieve a rewarding goal. By contrast, in the perceptual domain, a fMRI study investigating the influence of reward on visual discrimination showed the opposite pattern, with reward yielding a larger performance enhancement in easier tasks than in the most difficult one38.

Results

Behavioural performance

Analysing RT data using a linear mixed-effects model revealed main effects of Incentive, F(1,217) = 117.00, p < 0.0001, ηp² = 0.35, and Ratio, F(3,217) = 59.64, p < 0.0001, ηp² = 0.45. Reward and more difficult numerosity discrimination (smaller differences between the two dot arrays) slowed participants’ decision time. Pairwise t-tests showed no significant difference between the two easiest (ratio 4:3 vs. 5:4; p = 0.32, one-tailed) and the two hardest (ratio 8:7 vs. 10:9; p = 0.32, one-tailed) ratio conditions, respectively (all other ps < 0.04, one-tailed; see Fig. 2a). The linear mixed-effects model for accuracy also revealed main effects of Incentive, F(1,217) = 23.44, p < 0.0001, ηp² = 0.10, and Ratio, F(3,217) = 251.02, p < 0.0001, ηp² = 0.78. Participants’ answers were more often correct in rewarded trials than in the control condition as well as in trials with larger differences between the two dot arrays, i.e., the easier discriminations (all ps < 0.02, one-tailed; see Fig. 2b). The Incentive × Ratio interaction effect was not significant, neither for RTs (p = 0.22) nor for accuracy (p = 0.94).

Figure 2.

Figure 2

Behavioural performance: Mean and standard error (SE) for (a) response times (RT) in milliseconds and (b) accuracy in per cent, both separated for the two incentive conditions (reward vs. control) and the four ratio conditions.

Parameters of the drift diffusion model

Analysing the drift rate (v) of the EZ-DDM using a linear mixed-effects model revealed main effects of Incentive, F(1,217) = 19.30, p < 0.0001, ηp² = 0.08, and Ratio, F(3,217) = 262.33, p < 0.0001, ηp² = 0.89. The information accumulation rate was higher in trials with reward compared to the control trials as well as in trials with a larger difference between the two dot arrays (all ps < 0.003, one-tailed; see Fig. 3a). The linear mixed-effects model for boundary separation (a) also revealed main effects of Incentive, F(1,217) = 14.10, p = 0.0002, ηp² = 0.06, and Ratio, F(3,217) = 54.57, p < 0.0001, ηp² = 0.43. The value of the boundary separation parameter was larger – reflecting a more conservative response criterion – in trials with reward compared to the control trials as well as in trials with larger differences between the two dot arrays (all ps < 0.03, one-tailed; see Fig. 3b). This latter finding seems to contradict the frequently reported positive correlation between the decision threshold and RTs, which, by contrast, were larger in trials with smaller differences between the two dot arrays. However, computing Pearson’s product-moment correlations between RTs and boundary separation (a) separately for each condition yielded the expected positive correlations (with 0.57 ≤ r ≤ 0.79, all ps < 0.01; Holm-correction for multiple testing). The linear mixed-effects model for non-decision time (tER) revealed main effects of Incentive, F(1,217) = 70.56, p < 0.0001, ηp² = 0.25, and Ratio, F(3,217) = 51.37, p < 0.0001, ηp² = 0.41. The value of tER was larger (indicating slower non-decision time) in trials with reward as well as in trials with smaller differences between the two dot arrays. Pairwise t-tests showed no significant difference between the two easiest (ratio 4:3 vs. 5:4; p = 0.12, one-tailed) and the two hardest (ratio 8:7 vs. 10:9; p = 0.12, one-tailed) conditions (with all other ps < 0.03, one-tailed; see Fig. 3c). For all three parameters of the DDM, no significant Incentive × Ratio interaction effect was observed (p = 0.68 for v, p = 0.17 for a, and p = 0.36 for tER).

Figure 3.

Figure 3

Model parameters of the decision-making process: Mean and standard error (SE) for (a) drift rate (v), (b). boundary separation (a), and (c) non-decision time (tER), separately for the two incentive conditions (reward vs. control) and the four ratio conditions.

Pupillometry measures

The mean courses of the pupil response over a trial for the different conditions are shown in Fig. 4a. Linear mixed-effects models for peak PD in the three trial phases revealed main effects of Incentive during reward anticipation (cue phase), F(1,217) = 96.37, p < 0.0001, ηp² = 0.31, numerosity discrimination (stimulus phase), F(1,217) = 192.09, p < 0.0001, ηp² = 0.47, and feedback processing (feedback phase), F(1,217) = 150.98, p < 0.0001, ηp² = 0.41. The PD was larger for trials with reward compared to the control condition in all three phases of the task, reflecting incentive modulation effects during reward anticipation, stimulus, and feedback processing. The main effects of Ratio were only observed during numerosity discrimination, F(3,217) = 4.58, p = 0.004, ηp² = 0.06, and feedback processing, F(3,217) = 9.67, p < 0.0001, ηp² = 0.12 (p = 0.22 during reward anticipation). Pairwise t-tests showed no significant difference between the four ratio conditions, neither during the stimulus (all ps > 0.51, one-tailed) nor during the feedback phase (ps > 0.08, one-tailed). Nevertheless, polynomial contrasts testing the linear component of the main effect Ratio (using the aov function of the stats package in R39) revealed increased peak PD during feedback processing the smaller the difference between the two dot arrays, F(1,252) = 6.33, p = 0.01, ηp² = 0.02 (see Fig. 4b). The polynomial contrast for the linear component of the Ratio effect during stimulus processing did not reach significance (p = 0.13). Further, no significant interaction between Incentive and Ratio was observed, neither for peak PD during reward anticipation (p = 0.84) nor during numerosity discrimination (p = 0.83) or feedback processing (p = 0.45).

Figure 4.

Figure 4

Pupillometry measures: (a) Mean pupil dilation (in millimetres) across the time course of the trial (in milliseconds), stimulus-locked to the onset of the cue (zero point in time), and separately for the different conditions (incentive condition: reward vs. control; four ratio conditions); arrow at the top indicates the associated phase of the trial; (b) mean and standard error (SE) for the pupil dilation (in millimetres) measured at the peak of the pupil response during reward anticipation (cue phase; left), numerosity discrimination (stimulus phase; middle), and feedback processing (feedback phase; right), separately for the two incentive conditions and the four ratio conditions.

The analyses of the correlation between incentive modulation of the peak PD and the level of winning bonus obtained in the task showed a positive relationship between the two. Greater increases in PD during reward anticipation was associated with a higher level of win at the end of the experiment (ρ = 0.39, p = 0.04, one-tailed). This relation was not observed during the phase of numerosity discrimination (p = 0.77, one-tailed) or feedback processing (p = 0.77, one-tailed). For further details regarding descriptive statistics of all dependent variables, see Table S1 in Supplementary Results.

Discussion

Math achievements depend on non-symbolic numerical abilities3,4 and can be improved by training the precision of the ANS5. While early theories of numerosity discrimination suggest reward as a potent modifier of numerosity perception40, to the best of our knowledge, the present study is the first to systematically investigate whether incentive motivation can enhance the precision of the ANS during a novel incentivized dot comparison task designed by us. We expected incentive salience to facilitate numerical representations and thus improve numerosity discrimination13. To scrutinize mechanisms underlying effects of incentive modulation, we recorded phasic PD, a measure known to be associated with the activity of the brain’s salience network23. Furthermore, we fit the EZ-diffusion model36 to the behavioural data to separate the decision process into subcomponents. The main findings of this study are that reward enhanced numerosity discrimination as indicated by higher accuracy and more efficient information accumulation (i.e., higher drift rate). Moreover, reward slowed the discrimination process, which was accompanied by raised response caution as reflected in an increased decision threshold (i.e., greater boundary separation). The duration of non-decision time, partly reflecting sensorimotor processes, was also extended by reward. Of note, the pupillary response was modulated by reward as well: the PD was larger in rewarded compared to non-rewarded trials, both during numerosity discrimination and feedback processing. Moreover, the increase of PD was already observed during the phase of reward anticipation when the reward cue was presented. This reward-evoked PD correlated positively with the level of bonus wins that the participants obtained at the end of the experiment. We discuss these main findings in more detail below.

This study shows that incentive motivation manipulated by monetary rewards enhances non-symbolic numerical discrimination as assessed with our incentivized dot comparison task. This finding replicates and extends earlier evidence on reward-related enhancements of perceptual and cognitive processing10 to the domain of numerosity perception. The better numerosity discrimination under reward (i.e., higher accuracy) suggests that incentive motivation facilitates perceptual representations of the to-be-compared quantities and thereby increases the precision of the ANS. At the same time, it needs to be kept in mind that slowed decision speed – as observed in the present study – could also be indicative of an effect of speed-accuracy trade-off. By fitting the data to an EZ-diffusion model that takes into account both performance accuracy and RTs, we were able to shed light on the effects of incentive motivation on different components of the decision process. The drift rate of the model constitutes a measure of the precision of numerosity representation29. We observed greater drift rates in rewarded compared to unrewarded trials, which supports the interpretation of more distinctive numerical representations due to incentive motivation. Reward-related modulations of the drift rate during perceptual discrimination have been observed before by Spaniol et al.30. They compared the effects of incentives on perceptual efficiency in younger and older adults during colour perception. Likewise, the attentional DDM by Krajbich and Rangel41 illustrates that the value assigned to an object seems to be reflected in the drift rate of their model, which was increased in favour of attended objects. Following the Incentive Salience hypothesis13, in the present study we assumed that the reward cue would increase attention during rewarded trials and thus enhance the salience of the numerical representations. Results of the pupillary data are well in line with this notion of incentive salience being an underlying mechanism of reward-evoked enhancement of numerosity perception.

In particular, first, during the reward anticipation phase we observed increased PD during rewarded relative to the control trials. This may reflect enhanced resource allocation due to incentive motivation. In a recent combined pupillometry/fMRI study, PD associated with the anticipation of monetary rewards turned out to be coupled with neuronal activity in the salience network of the brain, particularly in the dorsal ACC23. The ACC plays a crucial role in performance monitoring (for a review, see42). According to the AGT by Aston-Jones and Cohen26, the ACC regulates the allocation of attentional resources and has direct projections to the LC to optimise the level of task-engagement and related outcome. Further, together with other regions of the salience network, the ACC has been widely discussed as being a key player in the bottom-up detection of salient information, given its effects in triggering attentional processes and motor preparation (for a review, see43). Besides, the consistency of our findings with the Incentive Salience hypothesis supports previous evidence indicating that pupil response measures can capture the interplay between the dopaminergic reward system and the LC-NE system27,44. Interestingly, the extent to which PD was enhanced by the presence of reward cues correlated with the level of bonus won by the participants at the end of the experiment. Consequently, the interplay between the dopamine reward and the LC-NE attention systems may play an important role in promoting numerosity perception for optimal goal-directed behaviour26. Admittedly, the effect observed in the current study was weak and our interpretation needs to be verified in future studies that examine the relationship between the pupillary and behavioural effects in more detail and their underlying neural mechanisms directly. For instance, the correlations between PD data and diffusion model parameters will need to be investigated in larger samples. Multi-modal approaches that integrate positron-emission tomography (PET) receptor imaging with fMRI or electroencephalography (EEG) measures as well as methods for modelling neurophysiological data as a diffusion process (for a review, see45) would need to be considered.

Second, other than effects during reward anticipation, we showed that incentive motivation also elevated PD during the phases of numerosity discrimination and feedback processing. Moreover, besides the effects of reward, we observed a ratio-dependent modulation of PD, with PD being larger when the difference of the two to-be-discriminated dot arrays was smaller. This effect is in line with findings from previous studies showing impacts of feedback and cognitive conflict on PD (e.g.,34,46). Of note, given the established roles of the ACC, this brain region might assess performance-related information like internal conflict during stimulus processing or external feedback (e.g., anticipated or received reward)42 to regulate LC activation for task engagements (reflected in changes of PD; cf. the AGT26) in the current context of numerosity discrimination. As to be expected from previous studies (cf.29), the ratio between the to-be-compared quantities also affected performance: smaller differences (higher conflicts) between the dot arrays resulted in longer RTs and lower accuracy. One study by Cavanagh et al.34 linked conflict-related PD with adjustments of decision threshold in terms of higher response caution in high-conflict situations. This could also explain the ratio-dependent RT slowing that was accompanied by increased PD in the present study. Nevertheless, we did not find an effect of ratio on increasing response caution. Thus, other explanations of this finding may still be necessary.

An earlier study47 fitted RT data by standard and moderately adapted diffusion models in conditions of high response or reinforcement conflict and showed that the data can be best accounted for when boundary separation (i.e., the decision threshold) and non-decision time increase with response or reward conflict. In agreement with these findings, conflict in the present study (i.e., smaller differences between the quantities in the dot arrays) was associated with slowed non-decision time. However, as stated above boundary separation decreased with increasing conflict. This seems to contradict the increase in RTs observed here and the frequently reported positive correlation between decision threshold and RTs. Apart from the seemingly reversed impacts of task difficulty (i.e., ratio) on both measures in our study, individual differences in RTs and decision thresholds correlated positively in our data as to be expected. The observed effect of task difficulty in decreasing boundary separation of the decision process resembles the reward-rate optimal boundary values proposed in another study48. This study compared younger and older adults’ ability to trade off speed and accuracy to optimize performance in a numerosity task. The calculated reward-rate optimal boundary values, representing an objective criterion defining the decision threshold for an optimal speed-accuracy trade-off, decreased with increasing difficulty. Although participants typically show wider decision thresholds than this objective criterion, it is known that accuracy feedback and extensive task practice can help to bring one’s decision threshold closer to these values. Given the effects reported in the earlier study48, the design of our task (performance feedback after every trial, 768 trials in total) might explain the atypical result pattern that we observed and reflect a close to optimal decision threshold.

Furthermore, the EZ-diffusion model revealed increases in boundary separation and non-decision time during rewarded compared to unrewarded trials and ensuing decreases in response speed. Raising the decision threshold in response to reward has also been linked with mesolimbic DA functioning. For instance, a study with attention deficit hyperactivity disorder (ADHD) patients showed increased response caution in a reinforcement learning task after medication that modulates DA-levels49. As in the present study, non-decision time became longer in ADHD patients after DA medication49. It should be noted that our findings appear to contradict recent evidence by Fontanesi et al.33, who reported lower decision thresholds for objects with high values. Our results are also inconsistent with insights from a modelling approach by Manohar et al.50, who demonstrated reward-related reductions of precision costs in fast decisions. Notwithstanding, the current results can be integrated well into the framework of optimal-decision theories32. Participants in our study were rewarded for correct decisions, where decision speed only played a minor part due to the relatively long durations of stimulus presentation and the response time window. It is likely that accuracy was favoured over RT in our numerosity discrimination task for several other reasons. Participants received accuracy-related feedback at the end of each trial and incorrect decisions were “punished” (bonus points lost). Further, unlike the highly valuable situation in the study by Fontanesi et al.33, information in our task was characterized by high uncertainty. Taken together, incentive motivation in our task increased the rate of perceptual evidence accumulation (reflected in drift rate), raised response caution (reflected in boundary separation), and lengthened non-decision time. We interpret these findings by referring to two processes that could underlie the reward-related modulation of the ANS precision: (i) the LC-NE driven gain modulation of stimulus processing due to incentive salience that is reflected in the increased drift rate; and (ii) a strategic process via top-down control processes of the prefrontal cortex to increase response caution as reflected in the increased boundary separation. In light of previous findings, both processes might be triggered by the ACC. These interpretations, however, need to be further validated in future studies.

In conclusion, combining pupillometry with drift-diffusion modelling provides insights into mechanisms underlying incentive modulation of numerosity perception. We showed that incentive motivation enhances the precision of ANS in young adults performing an incentivized dot comparison task. This extends earlier evidence on the reward-related enhancement of perceptual discrimination10 to the processing of numerical information. These findings are in line with the Incentive Salience hypothesis13 and the AGT by Aston-Jones and Cohen26. In future studies, it might be worthwhile to develop an experimental paradigm that also systematically manipulates the valence of the outcome. It has been shown that the threat of losses increases arousal compared to the promise of gains (e.g.,51), which should be reflected in a more pronounced pupil response. Manipulating the valence of the outcome would provide additional information about incentive-related modulations of the precision of the ANS dependent on the type of reward. Furthermore, the consideration of reward feedback effects could yield complementary information, as research in other domains indicates outcome effects on performance that might even surpass reward anticipation effects (cf.52). The EZ-diffusion model, which we combined with the pupillometry measures in the present study, considered the central parameters of the DDM. These parameters were also assumed to play crucial roles in modelling perceptual efficiency (i.e., drift rate) and performance optimization (i.e., boundary separation) under incentive motivation. Future studies might still want to apply a full DDM or modified versions thereof to explore further aspects of the perceptual decision process during numerosity discrimination. Such aspects of interest may be attention in an attentional DDM41 or modulatory effects on the decision threshold by allowing the parameter of the boundary separation to collapse over time47. A full DDM can also account for drift rate variability, which is not considered by the EZ-diffusion model applied here and may have resulted in an underestimation of the drift rate36 in the present study (see Supplementary Methods). Moreover, it might be worthwhile to examine whether adjustments of the decision threshold still occur in a task that emphasizes processing speed. If this adjustment is also one mechanism underlying the performance modulatory effects of incentive motivation, it should be present even when the allowed response time interval is limited. Besides, an independent effect of reward on the drift rate in a task design with a response deadline would lend further support to the notion that the enhanced precision of ANS is due to incentive salience of the numerical representations. These open questions notwithstanding, the present study identified incentive motivation as a promising modifier of numerosity discrimination, with potential implications for mathematical education. To put these lab-based results into educational practice, further studies on the impact of incentive motivation are necessary. They would need to take age-related changes in the ANS3, brain maturation and their interplay into account. Here, the role of developmental trajectories of the dopaminergic system during childhood and adolescence53 might be of particular interest.

Methods

Participants

Thirty-three students at Technische Universität (TU) Dresden aged 18–33 years took part in this study. Due to severe signal loss during pupil tracking in one participant, 32 participants were included in the analysis (17 females; age: M = 23.75 years, SD = 4.68). An a priori power calculation indicated sufficient power with a reasonably low probability of a type II error and a high likelihood to detect potential effects of reward in a sample of this size (required sample size of N = 16). The power calculation was based on prior knowledge of the following: (i) the impact of reward on the performance in an earlier version of the incentivized non-symbolic dot comparison task that we validated in a pilot study; and (ii) reported changes in peak PD in response to reward for relevant cognitive functions (e.g., decision-making, number processing) in young adults5457. Only one study specified the effect size of such a change54, which was smaller than the effects observed in our behavioural pilot study. Thus, the power calculation using G*Power 3.158 was based on this one effect size of f = 0.70 with two measurements (reward vs. control), a zero correlation between these two (r = 0.00, which is the most demanding case), a significance level of α = 0.05, and the statistical power 1-β = 0.95.

All participants had normal or corrected-to-normal vision, no history of neurological or psychiatric diseases, and were not taking any medication. The study was approved by the ethics committee of the TU Dresden (EK 55022017) under the Declaration of Helsinki and performed following the relevant guidelines and regulations. All participants gave informed written consent before the investigation. After testing, they received 15 Euro for their participation plus the bonus they had earned during the incentivized non-symbolic dot comparison task (prizes with a value of 9.12 Euro on average).

Experimental paradigm

We developed an incentivized non-symbolic dot comparison task (see Fig. 1a), in which numerosities of two quantities in different ratios were presented. Reward was manipulated to explore the effects of incentive motivation on the precision of the number sense. In this task, we instructed the participants to decide which of two arrays has more dots by pressing the left or the right control key on a keyboard. Each trial started with an incentive cue – a pink or blue fixation cross (luminance: 1.17 cd/m²) – displayed in the centre of a computer screen for 1,500 ms, followed by the presentation of the two arrays of dots flanking a grey fixation cross (luminance: M = 0.97 cd/m²). Participants were asked to make their decision as quickly and accurately as possible. The dot arrays were presented for 1,200 ms and the participants’ responses were allowed until 3,000 ms after stimulus onset. The response was followed by emoticon-based accuracy feedback (smiley vs. sad emoticon; luminance: 1.17 cd/m²) for a period of 1,500 ms. Besides, numbers indicating points earned (or lost) on that trial were shown below the feedback symbol. The two incentive conditions (reward vs. control) were signalled by the colour of the cue at the beginning of each trial. In trials of the reward condition, each correct or erroneous response resulted in gaining or losing, respectively, three points. In trials of the control condition, correct or erroneous responses did not result in points gained or lost, thus the value below the feedback symbol was zero. The allocation of the colour of the cue to one of the two conditions was counterbalanced across participants. Trial types (reward vs. control) were randomized within a block. Each block consisted of 24 trials and the task included 32 blocks, with a short 10-second break between blocks. In the first 5 seconds of each break, the thus far accumulated points from reward trials were shown along with the current bonus level obtained and the distance to the next level (see Fig. 1b). In total, there were 15 levels; higher levels were associated with a higher bonus level, which correspond to one of five possible win options at the end of the experiment: a pen (1) or a voucher for a local shopping mall worth 10 Euro (2), 15 Euro (3), 20 Euro (4), or 25 Euro (5). All instructions of the task were presented in white letters on a black background. The dot arrays and the feedback at the end of each trial were displayed in grey on a black background as well. The maximum field area of the dot arrays encompassed 7.5° visual angles in diameter. The number of dots in each array varied between 12 and 32, with a ratio between the two arrays of 4:3 (3:4), 5:4 (4:5), 8:7 (7:8) or 10:9 (9:10). For further details on stimulus generation and procedures of experiment controls, see Supplementary Methods. The task took about 50 min to complete. RTs, error rates and PD during the task were recorded as dependent variables (see Supplementary Methods for more details on data acquisition).

Data analyses

The behavioural data (RTs, accuracy) were analysed with the statistical software packages SPSS Statistics for Windows, Version 25.0 (IBM Corp., Armonk, NY, USA) and R (Version 3.4.3)39 in R Studio 1.1.414 (RStudio, Inc.). First, an outlier analysis was conducted: correct trials for which RTs were 3.5 standard deviations (SDs) above or below the individuals’ mean, as well as items for which the RTs were 3.5 SDs above or below the sample mean of the respective condition (reward vs. control for the different ratios), were removed. Using these criteria only 0.89% of the trials were eliminated. By and large, condition did not affect the number of outliers, except for significantly more outliers in the ratio condition of 10:9 compared to 8:7 in rewarded trials or in the ratio condition of 10:9 in unrewarded trials. Afterwards, the responses were averaged for each condition and participant. To further characterize the perceptual decision process during numerosity discrimination, we applied the EZ-diffusion model36 to our data separately for each condition and participant. It estimates three parameters, i.e., drift rate (v), boundary separation (a) and non-decision time (tER), based on the individual’s decision accuracy as well as the mean and variance of RTs of the correct responses. Following recommendations by Ratcliff and McKoon28, trials with RTs under 250 ms or above 1,500 ms were excluded. Thus, another 1.66% of the trials were eliminated for the model-based analysis. The suitability of the data for the application of the EZ-diffusion model was checked36, which indicated that the drift rate might be underestimated in all conditions but one (i.e., unrewarded trials with a ratio of 4:3 between the two arrays). Since this concerned most conditions, the comparisons of effects across conditions would not be affected. Nevertheless, we considered this point when interpreting the results (see also Supplementary Methods for more details).

For the processing of the pupillary data, Matlab 9.3, R2017B (The MathWorks, Inc., MA, USA), SPSS 25 and R packages in R Studio 1.1.414 were used. Before the statistical data analysis, pupillary data (average pupil diameter across the left and right eye) was cleaned following standard procedures59,60: trials with excessive blinking were discarded. There were no systematic differences in the distribution of pupillary artefacts across the experimental conditions. Small blinks were replaced by cubical interpolations. After discarding outliers and artefacts, 72.96% of all trials remained for the separate analyses of the three different phases of trials (reward anticipation, numerosity discrimination, feedback). For each condition and participant, we computed a stimulus-locked pupillary response for the reward anticipation and the feedback phase (duration: 1500 ms after cue or feedback presentation) and a response-locked pupillary response for the numerosity discrimination phase (duration: 1500 ms until 200 ms after button press). Pupillary responses were smoothed by an unweighted 5-point moving-average filter and baseline corrected for each trial subtracting the average pupil diameter of a 200 ms period before phase onset. On average, pupillary responses were calculated from 70 trials per condition per participant with a minimum of 10, which was assumed to constitute a reliable measurement with sufficiently reduced noise for the statistical analyses on the peak PD of each phase. Due to the missing inter-trial-interval and the ongoing recovery of the pupil at the beginning of a trial, baseline correction resulted in negative values during the cue phase. Therefore, the dilation relative to the minimum of the pupil diameter was chosen to define the peak in this phase (cf. Fig. 4a).

Linear mixed-effects models with maximum-likelihood estimation and participants as random intercepts were conducted using the lme function from the nlme package in R61. These models considered within-subject effects of the factors Incentive (i.e., reward vs. control condition) and Ratio (i.e., the four different ratios between the dot arrays) on (i) performance measures (RTs, accuracy), (ii) the parameter estimates of the EZ-diffusion model (v, a, tER) and (iii) the peak PD separately for the three different trial phases (cue, stimulus, feedback). Post-hoc multiple comparisons were carried out using pairwise t-tests (Holm-correction for multiple testing62). Effect sizes are reported using partial eta squared (ηp²) following the approach and recommendations by Fern and Monroe63 and Maxwell et al.64. In case the Saphiro-Wilk-test or the visual inspection using Q-Q-plots revealed that the models’ residuals were not normally distributed, permutation tests using the lmer function from the lme4 package65 and permanova from the predictmeans package in R66 were performed. Since the analyses showed comparable results for the permutated models, we only report results from analyses using the linear mixed-effects models. We also analysed correlations between incentive modulation of pupil response and a behavioural measure of the overall performance on the rewarded trials. For this, we calculated Spearman’s rank correlation coefficient for the reward-related peak PD modulation in the three different trial phases and the bonus winning level at the end of the experiment (achieved win option 1 to 5; Holm-correction for multiple testing). The reward-related peak PD modulation was defined as the relative change in peak PD according to the formula (peakPDrewardpeakPDcontrol)/[(peakPDreward+peakPDcontrol)/2]. For all analyses, a significance criterion of p ≤ 0.05 (two-tailed) was chosen (one-tailed only for tests with clear directional hypotheses based on findings from prior studies). The datasets generated and analysed in the present study (i.e., anonymous behavioural and pupillometric data) will be made available for research purposes by the corresponding author upon request.

Supplementary information

Supplementary Material. (380.9KB, pdf)

Acknowledgements

We thank all participants for taking part in the study. We would also like to express our gratitude to Sven Breitmeyer and Julian Seuffert for helping with data acquisition and to Nico Frasson, Grace Klosterman, Julian Seuffert, and Max Tettenborn for the efforts they spent on pre-processing the pupillometry data. We also thank Julia Delius for copyediting the manuscript. Publication of this work was financed by Open Access Funding by the Publication Fund of the TU Dresden.

Author contributions

S.C.L., A.D. conceptualized the study; A.D., S.C.L. designed the task; A.D. conducted the experiment; A.D., S.C.L. planned the analyses; A.D. analysed the data; A.D. drafted the manuscript; A.D., S.C.L. revised the manuscript. The study was funded by the budget and project overheads of the Chair of Lifespan Developmental Neuroscience, TU Dresden. During the phase of manuscript preparation, A.D. and S.C.L. were also partially funded by the Excellence Strategy of the DFG (EXC 2050/1-Project ID 390696704) – Cluster of Excellence “Centre for Tactile Internet with Human-in-the-Loop”.

Competing interests

The authors declare no competing interests.

Footnotes

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

is available for this paper at 10.1038/s41598-020-59415-3.

References

  • 1.Dehaene, S. The number sense: how the mind creates mathematics. (Oxford University Press, 1997).
  • 2.Piazza M. Neurocognitive start-up tools for symbolic number representations. Trends in Cognitive Sciences. 2010;14:542–551. doi: 10.1016/j.tics.2010.09.008. [DOI] [PubMed] [Google Scholar]
  • 3.Halberda J, Ly R, Wilmer JB, Naiman DQ, Germine L. Number sense across the lifespan as revealed by a massive Internet-based sample. Proceedings of the National Academy of Sciences of the United States of America. 2012;109:11116–11120. doi: 10.1073/pnas.1200196109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Halberda J, Mazzocco MM, Feigenson L. Individual differences in non-verbal number acuity correlate with maths achievement. Nature. 2008;455:665–668. doi: 10.1038/nature07246. [DOI] [PubMed] [Google Scholar]
  • 5.Park J, Brannon EM. Training the approximate number system improves math proficiency. Psychol Sci. 2013;24:2013–2019. doi: 10.1177/0956797613482944. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Park J, Bermudez V, Roberts RC, Brannon EM. Non-symbolic approximate arithmetic training improves math performance in preschoolers. Journal of experimental child psychology. 2016;152:278–293. doi: 10.1016/j.jecp.2016.07.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.DeWind NK, Brannon EM. Malleability of the approximate number system: effects of feedback and training. Frontiers in human neuroscience. 2012;6:68. doi: 10.3389/fnhum.2012.00068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lindskog M, Winman A, Juslin P. Are there rapid feedback effects on Approximate Number System acuity? Frontiers in human neuroscience. 2013;7:270. doi: 10.3389/fnhum.2013.00270. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Berridge KC. Reward learning: Reinforcement, incentives, and expectations. Psychology of Learning and Motivation. 2000;40:223–278. doi: 10.1016/S0079-7421(00)80022-5. [DOI] [Google Scholar]
  • 10.Pessoa, L. & Engelmann, J. B. Embedding reward signals into perception and cognition. Frontiers in neuroscience4, 10.3389/fnins.2010.00017 (2010). [DOI] [PMC free article] [PubMed]
  • 11.Rangel A, Camerer C, Montague PRA. framework for studying the neurobiology of value-based decision making. Nature reviews. Neuroscience. 2008;9:545–556. doi: 10.1038/nrn2357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Berridge KC. The debate over dopamine’s role in reward: the case for incentive salience. Psychopharmacology. 2007;191:391–431. doi: 10.1007/s00213-006-0578-x. [DOI] [PubMed] [Google Scholar]
  • 13.Berridge KC, Robinson TE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain research reviews. 1998;28:309–369. doi: 10.1016/S0165-0173(98)00019-8. [DOI] [PubMed] [Google Scholar]
  • 14.Dixon ML, Christoff K. The lateral prefrontal cortex and complex value-based learning and decision making. Neuroscience and biobehavioral reviews. 2014;45:9–18. doi: 10.1016/j.neubiorev.2014.04.011. [DOI] [PubMed] [Google Scholar]
  • 15.Puglisi-Allegra S, Ventura R. Prefrontal/accumbal catecholamine system processes high motivational salience. Front Behav Neurosci. 2012;6:31. doi: 10.3389/fnbeh.2012.00031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Schultz W. Updating dopamine reward signals. Current opinion in neurobiology. 2013;23:229–238. doi: 10.1016/j.conb.2012.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Hickey C, Chelazzi L, Theeuwes J. Reward changes salience in human vision via the anterior cingulate. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2010;30:11096–11103. doi: 10.1523/JNEUROSCI.1026-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Maunsell JH. Neuronal representations of cognitive state: reward or attention? Trends Cogn Sci. 2004;8:261–265. doi: 10.1016/j.tics.2004.04.003. [DOI] [PubMed] [Google Scholar]
  • 19.Awh E, Belopolsky AV, Theeuwes J. Top-down versus bottom-up attentional control: a failed theoretical dichotomy. Trends Cogn Sci. 2012;16:437–443. doi: 10.1016/j.tics.2012.06.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Anderson BA. The attention habit: how reward learning shapes attentional selection. Annals of the New York Academy of Sciences. 2016;1369:24–39. doi: 10.1111/nyas.12957. [DOI] [PubMed] [Google Scholar]
  • 21.Chelazzi L, Perlato A, Santandrea E, Della Libera C. Rewards teach visual selective attention. Vision Res. 2013;85:58–72. doi: 10.1016/j.visres.2012.12.005. [DOI] [PubMed] [Google Scholar]
  • 22.Schneider, M. Simultaneous Pupillometry and Functional Magnetic Resonance Imaging (fMRI) for the Detection of Stress-Related Endophenotypes, Ludwig‐Maximilians‐Universität München, (2018).
  • 23.Schneider M, Leuchs L, Czisch M, Samann PG, Spoormaker VI. Disentangling reward anticipation with simultaneous pupillometry/fMRI. NeuroImage. 2018;178:11–22. doi: 10.1016/j.neuroimage.2018.04.078. [DOI] [PubMed] [Google Scholar]
  • 24.Eckstein Maria K., Guerra-Carrillo Belén, Miller Singley Alison T., Bunge Silvia A. Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? Developmental Cognitive Neuroscience. 2017;25:69–91. doi: 10.1016/j.dcn.2016.11.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Sirois S, Brisson J. Pupillometry. Wiley Interdiscip Rev. Cogn Sci. 2014;5:679–692. doi: 10.1002/wcs.1323. [DOI] [PubMed] [Google Scholar]
  • 26.Aston-Jones G, Cohen JD. An Integrative Theory of Locus Coeruleus-Norepinephrine Function: Adaptive Gain and Optimal Performance. Annu Rev Neurosci. 2005;28:403–450. doi: 10.1146/annurev.neuro.28.061604.135709. [DOI] [PubMed] [Google Scholar]
  • 27.Manohar SG, Husain M. Reduced pupillary reward sensitivity in Parkinson’s disease. npj Parkinson’s Disease. 2015;1:15026. doi: 10.1038/npjparkd.2015.26. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ratcliff R, McKoon G. The diffusion decision model: theory and data for two-choice decision tasks. Neural Computation. 2008;20:873–922. doi: 10.1162/neco.2008.12-06-420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Park J, Starns JJ. The Approximate Number System Acuity Redefined: A Diffusion Model Approach. Frontiers in psychology. 2015;6:1955. doi: 10.3389/fpsyg.2015.01955. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Spaniol J, Voss A, Bowen HJ, Grady CL. Motivational incentives modulate age differences in visual perception. Psychology and aging. 2011;26:932–939. doi: 10.1037/a0023297. [DOI] [PubMed] [Google Scholar]
  • 31.Starns JJ, Ratcliff R. The effects of aging on the speed-accuracy compromise: Boundary optimality in the diffusion model. Psychology and aging. 2010;25:377–390. doi: 10.1037/a0018022. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Bogacz R. Optimal decision-making theories: linking neurobiology with behaviour. Trends Cogn Sci. 2007;11:118–125. doi: 10.1016/j.tics.2006.12.006. [DOI] [PubMed] [Google Scholar]
  • 33.Fontanesi L, Gluth S, Spektor MS, Rieskamp J. A reinforcement learning diffusion decision model for value-based decisions. Psychon Bull Rev. 2019 doi: 10.3758/s13423-018-1554-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Cavanagh JF, Wiecki TV, Kochar A, Frank MJ. Eye Tracking and Pupillometry Are Indicators of Dissociable Latent Decision Processes. Journal of Experimental Psychology: General. 2014;143:1476–1488. doi: 10.1037/a0035813. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Mulder MJ, van Maanen L, Forstmann BU. Perceptual decision neurosciences - a model-based review. Neuroscience. 2014;277:872–884. doi: 10.1016/j.neuroscience.2014.07.031. [DOI] [PubMed] [Google Scholar]
  • 36.Wagenmakers E, Van Der Maas HLJ, Grasman RPPP. An EZ-diffusion model for response time and accuracy. Psychon Bull Rev. 2007;14:3–22. doi: 10.3758/BF03194023. [DOI] [PubMed] [Google Scholar]
  • 37.Zhang M, Siegle GJ, McNeil MR, Pratt SR, Palmer C. The role of reward and task demand in value-based strategic allocation of auditory comprehension effort. Hear Res. 2019;381:107775. doi: 10.1016/j.heares.2019.107775. [DOI] [PubMed] [Google Scholar]
  • 38.Weil RS, et al. Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex. Journal of neurophysiology. 2010;104:1746–1757. doi: 10.1152/jn.00870.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing. (2012).
  • 40.Dehaene S, Changeux J-P. Development of Elementary Numerical Abilities: A Neuronal Model. J Cogn Neurosci. 1993;5:390–407. doi: 10.1162/jocn.1993.5.4.390. [DOI] [PubMed] [Google Scholar]
  • 41.Krajbich I, Rangel A. Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:13852–13857. doi: 10.1073/pnas.1101328108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Botvinick MM, Cohen JD, Carter CS. Conflict monitoring and anterior cingulate cortex: an update. Trends Cogn Sci. 2004;8:539–546. doi: 10.1016/j.tics.2004.10.003. [DOI] [PubMed] [Google Scholar]
  • 43.Menon V, Uddin LQ. Saliency, switching, attention and control: a network model of insula function. Brain Struct Funct. 2010;214:655–667. doi: 10.1007/s00429-010-0262-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Chiew KS, Braver TS. Temporal dynamics of motivation-cognitive control interactions revealed by high-resolution pupillometry. Frontiers in psychology. 2013;4:15. doi: 10.3389/fpsyg.2013.00015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Heekeren HR, Marrett S, Ungerleider LG. The neural systems that mediate human perceptual decision making. Nature reviews. Neuroscience. 2008;9:467–479. doi: 10.1038/nrn2374. [DOI] [PubMed] [Google Scholar]
  • 46.Lavin C, San Martin R, Rosales Jubal E. Pupil dilation signals uncertainty and surprise in a learning gambling task. Front Behav Neurosci. 2013;7:218. doi: 10.3389/fnbeh.2013.00218. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Ratcliff R, Frank MJ. Reinforcement-Based Decision Making in Corticostriatal Circuits:Mutual Constraints by Neurocomputational and Diffusion Models. Neural Computation. 2012;24:1186–1229. doi: 10.1162/NECO_a_00270. [DOI] [PubMed] [Google Scholar]
  • 48.Starns JJ, Ratcliff R. Age-related differences in diffusion model boundary optimality with both trial-limited and time-limited tasks. Psychon Bull Rev. 2012;19:139–145. doi: 10.3758/s13423-011-0189-3. [DOI] [PubMed] [Google Scholar]
  • 49.Pedersen ML, Frank MJ, Biele G. The drift diffusion model as the choice rule in reinforcement learning. Psychon Bull Rev. 2017;24:1234–1251. doi: 10.3758/s13423-016-1199-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Manohar SG, et al. Reward Pays the Cost of Noise Reduction in Motor and Cognitive Control. Curr Biol. 2015;25:1707–1716. doi: 10.1016/j.cub.2015.05.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Hochman G, Yechiam E. Loss aversion in the eye and in the heart: The autonomic nervous system’s responses to losses. Journal of Behavioral Decision Making. 2011;24:140–156. doi: 10.1002/bdm.692. [DOI] [Google Scholar]
  • 52.Mather M, Schoeke A. Positive outcomes enhance incidental learning for both younger and older adults. Frontiers in neuroscience. 2011;5:129. doi: 10.3389/fnins.2011.00129. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Jucaite A, Forssberg H, Karlsson P, Halldin C, Farde L. Age-related reduction in dopamine D1 receptors in the human brain: from late childhood to adulthood, a positron emission tomography study. Neuroscience. 2010;167:104–110. doi: 10.1016/j.neuroscience.2010.01.034. [DOI] [PubMed] [Google Scholar]
  • 54.Bijleveld E, Custers R, Aarts H. The Unconscious Eye Opener - Pupil Dilation Reveals Strategic Recruitment of Resources Upon Presentation of Subliminal Reward Cues. Psychol Sci. 2009;20:1313–1315. doi: 10.1111/j.1467-9280.2009.02443.x. [DOI] [PubMed] [Google Scholar]
  • 55.Van Slooten JC, Jahfari S, Knapen T, Theeuwes J. How pupil responses track value-based decision-making during and after reinforcement learning. PLoS Comput Biol. 2018;14:e1006632. doi: 10.1371/journal.pcbi.1006632. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.O’Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ. Temporal Difference Models and Reward-Related Learning in the Human Brain. Neuron. 2003;28:329–337. doi: 10.1016/S0896-6273(03)00169-7. [DOI] [PubMed] [Google Scholar]
  • 57.Bray S, Rangel A, Shimojo S, Balleine B, O’Doherty JP. The neural mechanisms underlying the influence of pavlovian cues on human decision making. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2008;28:5861–5866. doi: 10.1523/JNEUROSCI.0897-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
  • 59.Beatty, J. & Lucero-Wagoner, B. In Handbook of psychophysiology (eds J. T. Cacioppo, L. G. Tassinary, & G. G. Berntson) 142–162 (Cambridge University Press, 2000).
  • 60.Granholm E, Asarnow RF, Sarkin AJ, Dykes KL. Pupillary responses index cognitive resource limitations. Psychophysiology. 1996;33:457–461. doi: 10.1111/j.1469-8986.1996.tb01071.x. [DOI] [PubMed] [Google Scholar]
  • 61.Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D. R. & R Core Team, V. nlme: Linear and Nonlinear Mixed Effects Models, https://CRAN.R-project.org/package=nlme (2019).
  • 62.Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics. 1979;6:65–70. doi: 10.2307/4615733. [DOI] [Google Scholar]
  • 63.Fern EF, Monroe KB. Effect-Size Estimates: Issues and Problems in Interpretation. Journal of Consumer Research. 1996;23:89–105. doi: 10.1086/209469. [DOI] [Google Scholar]
  • 64.Maxwell SE, Cole DA. Bias in cross-sectional analyses of longitudinal mediation. Psychol Methods. 2007;12:23–44. doi: 10.1037/1082-989X.12.1.23. [DOI] [PubMed] [Google Scholar]
  • 65.Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting Linear Mixed-Effects Models Usinglme4. Journal of Statistical Software67, 10.18637/jss.v067.i01 (2015).
  • 66.Luo, D., Ganesh, S. & Koolaard, J. Calculate predicted means for linear models, https://cran.r-project.org/package=predictmeans (2018).

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material. (380.9KB, pdf)

Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES