Abstract
Serotonin is implicated in the valuation of aversive costs, such as delay or physical effort. However, its role in governing sensitivity to cognitive effort, for example, deliberation costs during information gathering, is unclear. We show that treatment with a serotonergic antidepressant in healthy human individuals of either sex enhances a willingness to gather information when trying to maximize reward. Using computational modeling, we show this arises from a diminished sensitivity to subjective deliberation costs during the sampling process. This result is consistent with the notion that serotonin alleviates sensitivity to aversive costs in a domain-general fashion, with implications for its potential contribution to a positive impact on motivational deficits in psychiatric disorders.
SIGNIFICANCE STATEMENT Gathering information about the world is essential for successfully navigating it. However, sampling information is costly, and we need to balance between gathering too little and too much information. The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. In this study, we show that week-long daily treatment with a serotonergic antidepressant enhances a willingness to gather information when trying to maximize reward. Computational modeling indicates this arises from a reduced perception of aversive costs, rendering information gathering less cognitively effortful. This finding points to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in a range of mental illnesses.
Keywords: cognitive effort, computational modeling, information gathering, serotonin
Introduction
Harvesting information about the world is essential for successfully navigating it. However, gathering information is costly and we need to balance between gathering too little and too much information (Gottlieb et al., 2013). Excess information gathering for a simple or irrelevant decision, such as repetitively checking whether the door is lock, or the oven switched off, may lead to unnecessary costs, including the time and energy spent exploring, such as in patients suffering from obsessive-compulsive disorder (OCD; Hauser et al., 2017a; Strauss et al., 2020). Alternatively, expending too little resources on information gathering, e.g., because of an aversion to allocate cognitive resources in patients suffering from depression, may increase the risk of jumping to conclusions, resulting in unwarranted assumptions and poor decisions (Taylor Tavares et al., 2007; Sastre-Buades et al., 2021).
This challenge in information gathering can be reformulated as an arbitration between the value of novel information and the cognitive costs incurred. Humans struggle with solving this arbitration optimally, often showing excessive or insufficient information gathering (Bogacz et al., 2010; Hauser et al., 2017b). Interestingly, suboptimalities in information gathering are a feature in a range of psychiatric disorders (Clark et al., 2006; Taylor Tavares et al., 2007; Moutoussis et al., 2011; Hauser et al., 2017a, b; Ermakova et al., 2019).
The neurocomputational mechanisms underlying this arbitration between a putative gain, such as reward, and the associated costs, such as allocation of cognitive resources, remain unclear. It is hypothesized that the neurotransmitter serotonin may play a role in this process (Husain and Roiser, 2018). Although the exact impact of serotonin on decision-making remains somewhat elusive (Cools et al., 2011; Dayan, 2012), it has been suggested as signaling a cost related to action, such as physical effort (Meyniel et al., 2016) or action inhibition (Crockett et al., 2009; Guitart-Masip et al., 2014).
Meyniel et al. (2016) demonstrated that boosting serotonin by selective serotonin reuptake inhibitors (SSRIs) reduces a perception of physical effort by lowering a sensitivity to its associated aversive costs. Likewise, it has been hypothesized that serotonin's impact on intertemporal choice may reflect a reduced cost perception for delay-induced costs (Schweighofer et al., 2008; Miyazaki et al., 2014; Fonseca et al., 2015). However, it remains uncertain whether serotonin signals a cost beyond mere physical effort, for example, the cost of cognitive effort critical for deliberation and information gathering (Froböse and Cools, 2018; Petitet et al., 2021).
In this study, we tested whether serotonin alleviates cognitive cost sensitivity in information gathering. Using a double-blind, placebo-controlled, between-subjects design, we assessed the impact of week-long daily treatment with the SSRI citalopram on decision-making during an established sequential information gathering task (Hauser et al., 2017a,b). We find SSRI treatment boosts information gathering in a manner indicative of subjects being more willing to exert cognitive effort to obtain reward. Computational modeling revealed this serotonergic effect is specifically driven by a reduction in the aversive cost of deliberation. The findings are consistent with serotonin playing a domain-general role in encoding ongoing both physical and cognitive costs, a mechanism that might be relevant for therapeutic approaches to motivational deficits in psychiatric disorders.
Materials and Methods
Subjects
A total of 66 healthy volunteers (age range 20–38 years; SSRI, 20 females, 13 males, mean age: 24.5 ± 4.0; placebo, 20 females, 13 males, mean age: 24.8 ± 3.9, p = 0.757) participated in this double-blind, placebo-controlled study. All subjects underwent an electrocardiogram to exclude QT interval prolongation and a thorough medical screening interview to exclude any neurologic or psychiatric disorder, any other medical condition, or medication intake. The experimental protocol was approved by the University College London (UCL) local research ethics committee, with informed consent obtained from all participants. Data from different tasks of the same participants were already published elsewhere (Michely et al., 2020, 2022).
Pharmacological procedure
Participants were randomly allocated to receive a daily oral dose of the SSRI citalopram (20 mg) or placebo, over a period of 7 consecutive days. All subjects performed two laboratory testing sessions. The first session was on day 1 of treatment, approximately 3 h after single dose administration, as citalopram reaches its highest plasma levels after this interval (Noble and Benfield, 1997). On the following days, subjects were asked to take their daily medication dose at a similar time of day, either at home or at the study location. The second session was on day 7 of treatment, with the tablet being taken approximately 3 h before the experiment.
Experimental task
We examined sequential information gathering using a modified version of an information sampling task (Clark et al., 2006; Hauser et al., 2017a,b). On each game, subjects saw 25 covered cards (Fig. 1A, gray squares) and had to decide whether the majority of cards was of color 1 or color 2 (e.g., yellow or blue, colors varied across games). Using a computer mouse, subjects were allowed to sample as many cards as they wished before committing to one of the two colors.
Figure 1.
Increased information gathering after SSRI administration. A, Subjects were randomly allocated to a daily dose of 20-mg citalopram or placebo for 7 consecutive days. Subjects performed the information gathering task on two sessions: session 1 took place on day 1 after a single-dose administration, session 2 took place on day 7 after a week-long drug treatment. For each game, subjects started with a fully covered deck of 25 gray cards. They were allowed to open as many cards as they wished before declaring a decision about whether they believed the majority of cards was yellow or blue (colors varied across games). In the “fixed” condition, no external costs for sampling applied, but in a “decreasing” condition a potential total win of 250 points reduced by 10 points per uncovered card. In both conditions, subjects lost 100 points on making an incorrect decision. B, SSRIs led to a general increase in the number of draws needed before declaring a decision (shown here collapsed across both timepoints as there were no interactions with time). This was evident across both conditions. C, Information gathering (number of draws) shows a high test-retest reliability, demonstrating that the task is capable of reliably detecting individual differences in information gathering. D–F, There were no significant drug effects on further task metrics, such as choice accuracy, response times or task earnings. *p < 0.028. Error bars indicate SEM. See Extended Data Figure 1-1 for self-report questionnaire data. ms = milliseconds, N draws = number of draws.
The first 15 games were part of a “fixed” condition, in which gathering additional information was not costly. Specifically, subjects received 100 points for correct decisions and lost 100 points for incorrect decisions, regardless of the number of cards opened or the time spent on task before decision. In the “decreasing” condition, information gathering incurred external costs resulting in a reduction of potential gains. Specifically, starting from a maximum potential gain of 250 points, opening each card led to a 10-point gain reduction (e.g., gain after seven opened cards: 250 − 7 × 10 = 180 points). Incorrect decisions resulted in a loss of 100 points, independent of the amount of prior sampling.
After each game, subjects were informed about their gains, and then proceeded to the next game. The game sequences were selected so that 10 games in each condition were relatively difficult with a generative probability close to 50% (similar to that in the original information sampling task; (Clark et al., 2006). An additional five sequences were easier with a clearer majority (generative probabilities of a binomial process p ∼ 0.7) to allow for a broader variability in information gathering. Order of sequences was randomized. Before the first game, subjects performed a practice game to familiarize themselves with the task.
Computational modeling
To investigate the computational mechanisms underlying information gathering, we used a computational model that we have previously developed for this task. Here, we reiterate the most relevant equations, but a detailed description of the model can be found in a previously published work (Hauser et al., 2017b) and subsequent papers (Hauser et al., 2017a, 2018; Bowler et al., 2021).
The computational model assumes that agents make inference about which color is more likely to form the majority of cards with MY being a majority of yellow, given the current amount of yellow cards (ny) out of a total of N sampled cards. P(MY) is calculated using the current number of cards, making inference about the generative probability that could have caused this distribution of cards (cf. Hauser et al., 2017b).
This belief is then used to calculate action for declaring for yellow and blue, weighting both potential gains and losses by the inferred likelihood of them taking place
with Rcor and Rinc being the potential wins and losses (set to +100/−100 here; for discussion, cf. Hauser et al., 2018).
A more challenging computation is the estimation of the action value for not deciding [Q(ND)]. This is computed as the sum of the value of the future states [V(s'), a weighted sum of the Q values in that state], weighted by how likely they will materialize [p(s'|ny,N), i.e., how likely will I end up in that state given the cards that I have opened so far]. In addition, a cost per step c incurs, which accounts for the subjective costs for sampling more information and thus spending more effort, time, and points (in the decreasing condition) on gathering information.
In accordance with previous studies, we found that subjective costs did not follow the explicit costs (i.e., 0 in the fixed, −10 points in the decreasing condition; “objective” model). Moreover, costs also did not increase linearly (“linear” model), but rather scaled in a nonlinear fashion during sampling (“nonlinear” model, modeled as a sigmoid). The best performing, nonlinear, model comprised two free parameters, a scaling parameter cs that determined how big the maximal costs could be, and an intercept p, which determined after how many samples (n) these costs started to escalate (Drugowitsch et al., 2012; Murphy et al., 2016).
Amending our earlier work (Hauser et al., 2017a,b), our recent modeling analyses on data from the same task (Hauser et al., 2018; Bowler et al., 2021) revealed that fixing the slope parameter (k) to 10, instead of having it as additional free parameter, leads to similar model fit, showing that this parsimonious model thus outperforms more complex models. Fixing the slope of our cost function means that a potential effect on the slope would likely be reflected in the cs or p parameter. However, we have little reason to believe that serotonin would affect the slope exclusively, or even that slope and costs would be consequences of distinct neurocognitive processes.
Lastly, the choice policy was determined using a softmax rule with decision temperature τ and an additional ε greedy element (ξ) that captures choices that were not adequately captured by the model. The policy was not only used for choice arbitration, but also in the planning process to inform state values und backward planning (for details, cf. Hauser et al., 2017b):
To determine the best-fitting model, we compared three distinct models with different forms of cost structures as described above: objective, linear, nonlinear. To compare their model fit, we applied out-of-sample prediction using a 5-fold cross-validation assessing the predictive likelihood, thereby finding an optimal balance between complexity and accuracy using the held-out data (Dubois et al., 2021). Specifically, we partitioned the data of each subject into five folds (subsamples). We then fitted the model using four folds and validated it on the remaining fold. We repeated this procedure five times so that each fold is used as a validation set once, and averaged the likelihood over held-out trials. We computed this for each model and subject and averaged across subjects. Model parameters were optimized using 'fmincon,' with multiple starting points to overcome local minima.
Thus, our methodological approach comprised two stages. First, we compared different types of models (objective, linear, nonlinear) to assess whether costs were represented as per explicit instruction or whether subjective costs accumulated in a linear, or nonlinear, fashion. Second, we assessed whether changes in information gathering, such as differences in the number of draws, can be mapped to distinct changes of certain parameters of the model, such as the sensitivity to sampling costs (cs parameter) or the indifference point that is governing after how many samples subjective costs start to escalate (p parameter).
Note that the main models included two τ and two p parameters (separate for each condition), and one cs parameter (shared across conditions), as our most recent work showed that such models provide the best fir for the data of this task (Hauser et al., 2017a, 2018; Bowler et al., 2021). Nevertheless, to further elucidate cost of sampling effects, we also computed an additional model that included two separate cs parameters, one per condition.
Statistical analysis
In this study, we tested whether SSRI treatment affects information gathering. The number of draws before a decision is a good indicator for the amount of information that a subject is willing to collect before committing to a decision (Hauser et al., 2017a,b). We analyzed this behavioral metric using repeated-measures ANOVAs with the between-subject factor drug (SSRI, placebo), and the within-subject factor condition (fixed, decreasing). To assess whether effects were different after single-dose administration, compared with one-week treatment, we added the within-subject factor time (session 1: acute; session 2: week-long). Significant effects were further assessed using independent-sample t tests (SSRI vs placebo). As secondary measures (Hauser et al., 2017a,b), we assessed whether drug treatment affected how many points subjects won, and how accurate subjects were in their decision-making (i.e., how often subjects correctly opted for the color with the current majority of cards), using the same statistical procedures. For comparison of computational model parameters, we applied Bonferroni correction for the number of model parameters.
Results
Serotonin increases information gathering
First, we assessed the number of draws a subject made before committing to a decision as a key indicator of information gathering in the task. This metric is a proxy for a subject's need to gather information, and has been found sensitive to individual differences including levels of psychopathology (Clark et al., 2006; Taylor Tavares et al., 2007; Moutoussis et al., 2011; Hauser et al., 2017a,b).
Here, we found a significant main effect of drug (F(1,64) = 5.0, p = 0.028; Fig. 1B), driven by an increase in number of draws in the SSRI compared with placebo subjects. Additionally, we found a significant effect of condition (F(1,64) = 202.3, p < 0.001), indicating that subjects gathered more information in the fixed compared with the decreasing condition. However, we found no interaction between drug and condition (F(1,64) = 0.07, p = 0.793), indicating that SSRIs increased information gathering per se, and drug effects were similar across conditions (SSRI vs placebo: decreasing: t(64) = 2.3, p = 0.025; fixed: t(64) = 1.8, p = 0.084). Further, the duration of drug administration (single-dose vs week-long) did not impact the drug's effect on information gathering (drug × time: F(1,64) = 0.9, p = 0.345), or the interaction with condition (drug × time × condition: F(1,64) = 0.3, p = 0.602). This means that the drug effects were similar for acute and prolonged treatment. Overall, these results show that (acute and week-long) serotonergic treatment enhanced a willingness to gather more information before declaring a choice.
Self-report questionnaire data. We found no impact of drug on any of self-report questionnaires. BDI–II = Beck's Depression Inventory II (Beck et al., 1996); SHAPS = Snaith-Hamilton Pleasure Scale (Snaith et al., 1995); STAI = State-Trait Anxiety Inventory (Spielberger, 1983); PANAS = Positive and Negative Affective Scale (Watson et al., 1988). Download Figure 1-1, DOCX file (20.7KB, docx) .
Serotonergic effects on further task metrics
Next, we assessed whether SSRIs affected other metrics, not directly related to information gathering. First, we examined subjects' accuracy, as measured by whether a subject chooses the color that is more plentiful at the time of decision. We did not find any pharmacological effect on accuracy, suggesting that SSRIs do not simply change motivation, attention or information processing in general (drug: F(1,64) = 0.1, p = 0.711; drug × time: F(1,64) = 0.7, p = 0.402; drug × condition: F(1,64) = 0.4, p = 0.537; drug × time × condition: F(1,64) = 0.5, p = 0.482; Fig. 1D).
Next, we analyzed choice response times. As expected, we found that subjects responded faster in the fixed as compared with the decreasing condition (F(1,64) = 151.3, p < 0.001). However, there was no pharmacological effect on response times (drug: F(1,64) = 0.6, p = 0.457, drug × condition: F(1,64) = 0.0, p = 0.99; drug × time: F(1,64) = 1.7, p = 0.202; drug × time × condition: F(1,64) = 0.5, p = 0.481; Fig. 1E).
Lastly, we investigated pharmacological effects on task earnings, i.e., how many points subjects won in the task. This measure is a conglomerate measure influenced by information gathering, accuracy, and luck. Note that an SSRI-induced increase in sampling across both conditions would be reflected in an increase in earnings in the fixed condition (where sampling is cost-free) and a reduction in earnings in the decreasing condition (where sampling is costly; Hauser et al., 2017b). Note, however, this drug by condition interaction did not reach statistical significance (F(1,64) = 3.6, p = 0.060). Further, we found this measure to be unaffected by treatment in the remaining comparisons (drug: F(1,64) = 0.04, p = 0.834; drug × time: F(1,64) = 0.01, p = 0.915; drug × time × condition: F(1,64) = 0.5, p = 0.478; Fig. 1F).
Emerging subjective costs reduce information gathering
To decipher the computational mechanisms that drive an increase in information gathering in SSRI-treated subjects, we fitted three different computational models to individual subjects' choices (see Materials and Methods). These previously developed and evaluated models cast information gathering as a trade-off between information gain of a new sample and the incurred costs in sampling information. In particular, they capture subjective information gathering costs in the context of Bayesian decision-making and characterize how these costs change as information gathering continues (Hauser et al., 2017a,b; Bowler et al., 2021).
In line with our previous findings (Hauser et al., 2017a,b; Bowler et al., 2021), the winning model revealed that the cost for gathering information is subjective and changes over the course of information gathering. Model comparison revealed that these costs were not represented as per explicit instruction (“objective” model, i.e., no costs for the fixed, and −10 for the decreasing condition), but that “subjective” costs accumulated as information gathering continued, meaning that it becomes subjectively more and more costly to gather further information as a function of cumulative information gathering. This effect was best captured by a model in which costs escalate in a “nonlinear,” rather than a “linear,” fashion (“nonlinear” vs “objective”: t(65) = 16.3, p < 0.001; “nonlinear” vs “linear”: t(65) = 8.6, p < 0.001; Fig. 2A), in accordance with previous studies which identified the same winning model (Hauser et al., 2017a,b, 2018; Bowler et al., 2021).
Figure 2.
Computational modeling, model comparison and parameter recovery. A, Model comparison predicting cross-validated hold-out data revealed that a nonlinear increase in subjective sampling costs fitted subjects' performance best. B, Confusion matrices of the winning model shows that the parameters could be recovered using 50,000 simulated agents. This was demonstrated by medium to large correlations of the fitted with the original parameters used for simulation. Please note that the “xi” parameter was not included in the model simulations but was kept as a free parameter in the model fitting. This means a trade-off would be expressed in lowered correlation values for our parameters of interest. 1: fixed condition; 2: decreasing condition. ***p < 0.001. Error bars indicate SEM.
When we investigated how serotonin impacted putative mechanisms underlying information gathering, using simulations, we found that model parameter estimates could be accurately recovered, demonstrated in a positive association between parameter estimates derived from fitting to real and simulated data (Fig. 2B).
Serotonin decreases subjective costs of information gathering
To better understand how serotonin impacted information gathering, we compared the model parameters between the two groups. We found only one model parameter that survived multiple comparison correction (Fig. 3). In particular, we found that SSRI treatment specifically affected the subjective cost parameter cs (F(1,64) = 7.8, p = 0.007, uncorrected; p = 0.042, Bonferroni-corrected; Fig. 3A). This parameter is less negative in the SSRI group, which means that SSRI treatment led to a reduction in the subjective costs of information gathering. In alignment with the behavioral findings, there was no effect of time (acute vs week-long treatment) on this parameter (drug × time interaction: F(1,64) = 0.056, p = 0.814), meaning that acute and week-long treatment had a similar effect. To elucidate the subjective effects of costs further, we computed an additional model that comprised two separate cs parameters, one per condition. This analysis revealed that parameter estimates were different between conditions (F(1,64) = 9.9, p = 0.002), with higher cost sensitivity in the “decreasing” (costly) as compared with the “fixed” (not costly) condition. Further – in line with our results in the main analysis – we found a significant effect of “drug” (F(1,64) = 4.9, p = 0.030). Additionally, there was a significant “drug” × “condition” interaction (F(1,64) = 4.7, p = 0.033), an effect driven by a significantly higher cost sensitivity in SSRI as compared to placebo subjects in the “decreasing” (t(64) = 2.9, p = 0.004), but not in the “fixed” condition (t(64) = 0.3, p = 0.765). In sum, this indicates that an increase in information gathering in SSRI-treated subjects arises as a consequence of a lowered sensitivity to the subjective cost of sampling after serotonergic intervention, and this effect is particularly prominent in the decreasing condition when sampling information is costly.
Figure 3.
Computational modeling, parameter estimates. A, SSRIs reduce subjective costs in information gathering, indicated by a lower subjective cost model parameter in citalopram as compared with placebo subjects (collapsed across both time points as there was no time effect on result). B–F, We found no effect of drug on any of the other model parameters. **p = 0.007, uncorrected; p = 0.042, Bonferroni-corrected. Error bars indicate SEM. au = arbitrary units.
Test-retest reliability
A potential limitation with task-based behavioral metrics, as with many other cognitive variables (Shahar et al., 2019), is that little is known about their psychometric properties, such as test-retest reliability. Good psychometric properties are particularly important when tasks are used to make inference across repeated measurements, or when used to differentiate between subjects (e.g., patient vs nonpatient groups, drug vs no-drug groups). Given that we assessed the same subjects twice, with a 7-day interval between measurements, we were in the unique position to assess the test-retest reliability. Here, we found excellent reliability for our main measure of interest, the number of draws [intraclass correlation (ICC) = 0.922, p < 0.001; Fig. 1C]. This means that our information gathering task is well-suited for studying individual differences. For the computational modeling parameters, we found significant effects across all model parameters (all p < 0.012), however, coefficients were overall lower than our main model-free measure (ICCs ranging from 0.429 to 0.756). More sophisticated modeling approaches (Shahar et al., 2019) could help improve the psychometric properties of these measures further.
No drug effects on self-report questionnaires
To examine putative treatment effects on subjective affective states over the course of the study, participants completed the Beck's Depression Inventory (BDI-II; Beck et al., 1996), Snaith-Hamilton Pleasure Scale (SHAPS; Snaith et al., 1995), State-Trait Anxiety Inventory (STAI; Spielberger et al., 1983), and the Positive and Negative Affective Scale (PANAS; Watson et al., 1988) on two different occasions: (1) predrug, day 1; (2) peak drug, day 7. We found no evidence for serotonergic effects on any of the self-report questionnaires (compare Extended Data Fig. 1-1). This is in line with previous studies showing week-long SSRI treatment does not impact on mood in healthy volunteer participants (Harmer, 2013).
Discussion
We show that boosting serotonin function pharmacologically leads to increased information gathering in a sequential information sampling task. Using computational modeling, we demonstrate this effect arises from a serotonin-induced reduction in subjective sampling costs.
Serotonin is an impactful neuromodulator, but its precise influence on cognition, motivation and behavior remains elusive (Dayan, 2012; Olivier, 2015). While early accounts proposed serotonin as an opponent to dopamine that is mainly involved in signaling aversive outcomes (Daw et al., 2002; Cools et al., 2011), recent evidence has drawn a more complex and nuanced picture. In particular, studies suggest serotonin plays a crucial role in signaling the costs that are associated with aversive experience. These costs encompass punishment or delay (Denk et al., 2005; Cools et al., 2008; Schweighofer et al., 2008; Tanaka et al., 2009; den Ouden et al., 2013; Miyazaki et al., 2014), and extend to costs associated with the exertion of physical effort (Meyniel et al., 2016). Our finding confirms and expands this theory by demonstrating that enhancing central serotonin also modifies a subjective perception of cognitive effort costs in the context of information gathering. Here, we found that serotonin increased information gathering per se, independent of reward maximization. Additionally, computational modeling revealed that SSRI subjects were willing to pay small, local costs for more information, and this effect was particularly prominent in the costly condition. Critically, SSRIs did not impact choice response times, and it is therefore unlikely that serotonin affected the subjective cost of time in the task.
Subjective costs sit right at the heart of information gathering. Over recent years, a growing literature spanning nonhuman animal neurophysiology and computational modeling of human behavior demonstrates the relevance of subjective costs in the context of sequential sampling tasks (Thura and Cisek, 2016; Hauser et al., 2017b). In essence, mounting subjective costs means that subjects become less willing to sample more information as they go along, and are drawn toward making a decision in the absence of clear evidence. Neurophysiologically, it has been suggested this process may be implemented by a neural signal that increases over time, often termed urgency signal (Cisek et al., 2009; Yau et al., 2020). This urgency signal is added to an accumulation of evidence in (pre)motor areas, thus promoting decisions before absolute evidence is being gathered (Thura and Cisek, 2016).
In our computational model, we capture this behavioral signature by means of subjective sampling costs that are imposed on the action value for nondeciding, thus making a continuation of gathering novel information less and less likely. Replicating previous findings, we show such cognitive costs are low in the beginning but escalate in a nonlinear manner as sampling continues over time. This nonlinear emergence of costs can help explain suboptimalities in human behavior, with an undersampling in cost-free and an oversampling in costly environments (Bogacz et al., 2010; Hauser et al., 2017b).
Note that, in prior work, we found that greater information gathering, as revealed by a greater number of draws, e.g., in patients with OCD (Hauser et al., 2017a,b), or after noradrenergic neuromodulation (Hauser et al., 2018) can arise through a change in the indifference, or impatience, parameter that is governing after how many samples subjective costs start to escalate, i.e., the p parameter in our model. In contrast, however, in the current study, we found that serotonin specifically increased information gathering through a reduced sensitivity to the scaling of costs, i.e., the cs parameter of our model. This result underlines the strength of using computational models to analyze behavior as they can deliver a better mechanistic insight into cognitive processes, revealing effects that may otherwise be hidden to the experimenter.
In this study, we show that serotonin specifically reduces the scaling of such costs, meaning that subjective costs are impacting a decision less, regardless of how much one has already sampled. This finding has putative clinical relevance. SSRIs constitute a first-line intervention in the treatment of depression (Cipriani et al., 2018), a disorder typically characterized by motivational deficits, such as lowered willingness to engage in effortful behavior (Der-Avakian et al., 2016). Critically, using similar laboratory tasks, studies have shown that a willingness to gather information is reduced in patients suffering from depression (Taylor Tavares et al., 2007), as well as healthy individuals with low levels of motivation (Roets et al., 2008). Our study suggests that SSRI treatment can counteract such motivational deficits, through an increase in information gathering that is mediated by reduced cost perception. This result nicely extends previous computational studies that revealed how SSRI intervention increases physical effort exertion via reduced perception of effort costs (Meyniel et al., 2016). Taken together, these findings suggest that serotonin is not only relevant in signaling the costs of physical, but also of mental effort, hinting at a domain-general role of serotonin in overcoming aversive costs. Overall, this mechanism may help explain how serotonergic treatment gives rise to an alleviation of motivational deficits in patients suffering from depression.
More speculative is a link between our current finding and another psychiatric disorder, obsessive-compulsive disorder (OCD), that has been linked to aberrant information processing (Volans, 1976; Fear and Healy, 1997; Pélissier and O'Connor, 2002). Studies show (Hauser et al., 2017b; Voon et al., 2017), although not consistently (Chamberlain et al., 2007; Jacobsen et al., 2012), excessive information gathering behavior in OCD patients. Our findings suggest that SSRIs, first-line agents for treatment of OCD, could further exacerbate information gathering, although previous studies did not find an association with medication status (Hauser et al., 2017b). It is possible, however, that baseline serotonin levels may play a critical role in modulating an impact of serotonergic medication on information gathering. For instance, the relationship between serotonin levels and information gathering may follow an inverted u-shape function, which could also explain why a reduction of serotonin levels by means of tryptophan depletion in a previous study induced a change in sampling in a similar direction as the SSRI effects revealed in the current study (Crockett et al., 2012).
Clinically, serotonergic agents typically alleviate symptoms, such as low mood in depression, or obsessions in OCD, only after prolonged treatment of multiple weeks (Taylor et al., 2006; Fineberg et al., 2012). Interestingly, however, our results show that SSRIs modulate cognitive processes already in the first days of treatment. Notably, this chimes with prior studies on the effects of antidepressants on, e.g., emotional processing, learning and decision-making (Harmer and Cowen, 2013; Scholl et al., 2017; Michely et al., 2020, 2022), where these early effects are linked to later clinical treatment response (Tranter et al., 2009; Shiroma et al., 2014; Godlewska et al., 2016). Similarly, it is worth speculating that changes in sampling of information, as in our study, can, over time, lead to changes in symptoms in depression or OCD. Here, future studies in clinical populations over multiple weeks of treatment are needed to establish a link between these early cognitive effects and later clinical improvement and unravel the precise trajectory of this relationship.
In conclusion, our findings demonstrate that SSRI administration enhances information gathering. Computational modeling indicated this arises from a reduced perception of subjective sampling costs, rendering information gathering less cognitively effortful. Our findings point to a candidate mechanism by which serotonergic treatment might help alleviate motivational deficits in the context of a range of mental illnesses.
Footnotes
J.M. was supported by the German Research Foundation Fellowship MI 2158/1-1 and is participant in the Berlin Institute of Health (BIH) Charité (Junior; Digital) Clinician Scientist Program funded by the Charité–Universitätsmedizin Berlin, and the BIH at Charité. R.J.D. holds the Wellcome Trust Investigator Award 098362/Z/12/Z. The Max Planck UCL Centre for Computational Psychiatry and Ageing Research is a joint initiative supported by the Max Planck Society and University College London. The Wellcome Centre for Human Neuroimaging is supported by core funding from the Wellcome Trust (203147/Z/16/Z). T.U.H. is supported by a Sir Henry Dale Fellowship (211155/Z/18/Z; 211155/Z/18/B; 224051/Z/21) from Wellcome & Royal Society; the Jacobs Foundation Grant 2017-1261-04; the Medical Research Foundation; the 2018 NARSAD Young Investigator Grant 27023 from the Brain & Behavior Research Foundation; and a Philip Leverhulme Prize from the Leverhulme Trust (PLP-2021-040). This project has received funding from the European Research Council (ERC) under the European Union's Horizon 2020 Research and Innovation Programme (Grant Agreement No. 946055). T.U.H. is also supported by the Carl-Zeiss-Stiftung.
T.U.H. consults for limbic Ltd. and holds shares in the company, which is unrelated to the current project. All other authors declare no competing financial interests.
References
- Beck AT, Steer RA, Brown GK (1996) Manual for the Beck Depression Inventory-II. San Antonio: Psychological Corporation. [Google Scholar]
- Bogacz R, Hu PT, Holmes PJ, Cohen JD (2010) Do humans produce the speed-accuracy trade-off that maximizes reward rate? Q J Exp Psychol (Hove) 63:863–891. 10.1080/17470210903091643 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bowler A, Habicht J, Moses-Payne ME, Steinbeis N, Moutoussis M, Hauser TU (2021) Children perform extensive information gathering when it is not costly. Cognition 208:104535. 10.1016/j.cognition.2020.104535 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chamberlain SR, Fineberg NA, Blackwell AD, Clark L, Robbins TW, Sahakian BJ (2007) A neuropsychological comparison of obsessive-compulsive disorder and trichotillomania. Neuropsychologia 45:654–662. 10.1016/j.neuropsychologia.2006.07.016 [DOI] [PubMed] [Google Scholar]
- Cipriani A, Furukawa TA, Salanti G, Chaimani A, Atkinson LZ, Ogawa Y, Leucht S, Ruhe HG, Turner EH, Higgins JPT, Egger M, Takeshima N, Hayasaka Y, Imai H, Shinohara K, Tajika A, Ioannidis JPA, Geddes JR (2018) Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: a systematic review and network meta-analysis. Lancet 391:1357–1366. 10.1016/S0140-6736(17)32802-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cisek P, Puskas GA, El-Murr S (2009) Decisions in changing conditions: the urgency-gating model. J Neurosci 29:11560–11571. 10.1523/JNEUROSCI.1844-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clark L, Robbins TW, Ersche KD, Sahakian BJ (2006) Reflection impulsivity in current and former substance users. Biol Psychiatry 60:515–522. 10.1016/j.biopsych.2005.11.007 [DOI] [PubMed] [Google Scholar]
- Cools R, Robinson OJ, Sahakian B (2008) Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction. Neuropsychopharmacology 33:2291–2299. 10.1038/sj.npp.1301598 [DOI] [PubMed] [Google Scholar]
- Cools R, Nakamura K, Daw ND (2011) Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36:98–113. 10.1038/npp.2010.121 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crockett MJ, Clark L, Robbins TW (2009) Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J Neurosci 29:11993–11999. 10.1523/JNEUROSCI.2513-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crockett MJ, Clark L, Smillie LD, Robbins TW (2012) The effects of acute tryptophan depletion on costly information sampling: impulsivity or aversive processing? Psychopharmacology (Berl) 219:587–597. 10.1007/s00213-011-2577-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Daw ND, Kakade S, Dayan P (2002) Opponent interactions between serotonin and dopamine. Neural Netw 15:603–616. 10.1016/s0893-6080(02)00052-7 [DOI] [PubMed] [Google Scholar]
- Dayan P (2012) Twenty-five lessons from computational neuromodulation. Neuron 76:240–256. 10.1016/j.neuron.2012.09.027 [DOI] [PubMed] [Google Scholar]
- Denk F, Walton ME, Jennings KA, Sharp T, Rushworth MF, Bannerman DM (2005) Differential involvement of serotonin and dopamine systems in cost-benefit decisions about delay or effort. Psychopharmacology (Berl) 179:587–596. 10.1007/s00213-004-2059-4 [DOI] [PubMed] [Google Scholar]
- den Ouden HE, Daw ND, Fernandez G, Elshout JA, Rijpkema M, Hoogman M, Franke B, Cools R (2013) Dissociable effects of dopamine and serotonin on reversal learning. Neuron 80:1090–1100. 10.1016/j.neuron.2013.08.030 [DOI] [PubMed] [Google Scholar]
- Der-Avakian A, Barnes SA, Markou A, Pizzagalli DA (2016) Translational assessment of reward and motivational deficits in psychiatric disorders. Curr Top Behav Neurosci 28:231–262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Drugowitsch J, Moreno-Bote R, Churchland AK, Shadlen MN, Pouget A (2012) The cost of accumulating evidence in perceptual decision making. J Neurosci 32:3612–3628. 10.1523/JNEUROSCI.4010-11.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dubois M, Habicht J, Michely J, Moran R, Dolan RJ, Hauser TU (2021) Human complex exploration strategies are enriched by noradrenaline-modulated heuristics. Elife 10:e59907. 10.7554/eLife.59907 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ermakova AO, Gileadi N, Knolle F, Justicia A, Anderson R, Fletcher PC, Moutoussis M, Murray GK (2019) Cost evaluation during decision-making in patients at early stages of psychosis. Comput Psychiatr 3:18–39. 10.1162/cpsy_a_00020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fear CF, Healy D (1997) Probabilistic reasoning in obsessive-compulsive and delusional disorders. Psychol Med 27:199–208. 10.1017/s0033291796004175 [DOI] [PubMed] [Google Scholar]
- Fineberg NA, Brown A, Reghunandanan S, Pampaloni I (2012) Evidence-based pharmacotherapy of obsessive-compulsive disorder. Int J Neuropsychopharmacol 15:1173–1191. 10.1017/S1461145711001829 [DOI] [PubMed] [Google Scholar]
- Fonseca MS, Murakami M, Mainen ZF (2015) Activation of dorsal raphe serotonergic neurons promotes waiting but is not reinforcing. Curr Biol 25:306–315. 10.1016/j.cub.2014.12.002 [DOI] [PubMed] [Google Scholar]
- Froböse MI, Cools R (2018) Chemical neuromodulation of cognitive control avoidance. Curr Opin Behav Sci 22:121–127. 10.1016/j.cobeha.2018.01.027 [DOI] [Google Scholar]
- Godlewska BR, Browning M, Norbury R, Cowen PJ, Harmer CJ (2016) Early changes in emotional processing as a marker of clinical response to SSRI treatment in depression. Transl Psychiatry 6:e957. 10.1038/tp.2016.130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gottlieb J, Oudeyer PY, Lopes M, Baranes A (2013) Information-seeking, curiosity, and attention: computational and neural mechanisms. Trends Cogn Sci 17:585–593. 10.1016/j.tics.2013.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Guitart-Masip M, Economides M, Huys QJ, Frank MJ, Chowdhury R, Duzel E, Dayan P, Dolan RJ (2014) Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment. Psychopharmacology (Berl) 231:955–966. 10.1007/s00213-013-3313-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harmer CJ (2013) Emotional processing and antidepressant action. Curr Top Behav Neurosci 14:209–222. 10.1007/7854_2012_210 [DOI] [PubMed] [Google Scholar]
- Harmer CJ, Cowen PJ (2013) 'It's the way that you look at it'–a cognitive neuropsychological account of SSRI action in depression. Philos Trans R Soc Lond B Biol Sci 368:20120407. 10.1098/rstb.2012.0407 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hauser TU, Moutoussis M; NSPN Consortium; Dayan P, Dolan RJ (2017a) Increased decision thresholds trigger extended information gathering across the compulsivity spectrum. Transl Psychiatry 7:1296. 10.1038/s41398-017-0040-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hauser TU, Moutoussis M, Iannaccone R, Brem S, Walitza S, Drechsler R, Dayan P, Dolan RJ (2017b) Increased decision thresholds enhance information gathering performance in juvenile obsessive-compulsive disorder (OCD). PLoS Comput Biol 13:e1005440. 10.1371/journal.pcbi.1005440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hauser TU, Moutoussis M, Purg N, Dayan P, Dolan RJ (2018) Beta-blocker propranolol modulates decision urgency during sequential information gathering. J Neurosci 38:7170–7178. 10.1523/JNEUROSCI.0192-18.2018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Husain M, Roiser JP (2018) Neuroscience of apathy and anhedonia: a transdiagnostic approach. Nat Rev Neurosci 19:470–484. 10.1038/s41583-018-0029-9 [DOI] [PubMed] [Google Scholar]
- Jacobsen P, Freeman D, Salkovskis P (2012) Reasoning bias and belief conviction in obsessive-compulsive disorder and delusions: jumping to conclusions across disorders? Br J Clin Psychol 51:84–99. 10.1111/j.2044-8260.2011.02014.x [DOI] [PubMed] [Google Scholar]
- Meyniel F, Goodwin GM, Deakin JW, Klinge C, MacFadyen C, Milligan H, Mullings E, Pessiglione M, Gaillard R (2016) A specific role for serotonin in overcoming effort cost. Elife 5:e17282. 10.7554/eLife.17282 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Michely J, Eldar E, Martin IM, Dolan RJ (2020) A mechanistic account of serotonin's impact on mood. Nat Commun 11:2335. 10.1038/s41467-020-16090-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Michely J, Eldar E, Erdman A, Martin IM, Dolan RJ (2022) Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers. Commun Biol 5:812. 10.1038/s42003-022-03690-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K (2014) Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Curr Biol 24:2033–2040. 10.1016/j.cub.2014.07.041 [DOI] [PubMed] [Google Scholar]
- Moutoussis M, Bentall RP, El-Deredy W, Dayan P (2011) Bayesian modelling of jumping-to-conclusions bias in delusional patients. Cogn Neuropsychiatry 16:422–447. 10.1080/13546805.2010.548678 [DOI] [PubMed] [Google Scholar]
- Murphy PR, Boonstra E, Nieuwenhuis S (2016) Global gain modulation generates time-dependent urgency during perceptual choice in humans. Nat Commun 7:13526. 10.1038/ncomms13526 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Noble S, Benfield P (1997) Citalopram. A review of its pharmacology, clinical efficacy and tolerability in the treatment of depression. CNS Drugs 8:410–431. 10.2165/00023210-199708050-00009 [DOI] [Google Scholar]
- Olivier B (2015) Serotonin: a never-ending story. Eur J Pharmacol 753:2–18. 10.1016/j.ejphar.2014.10.031 [DOI] [PubMed] [Google Scholar]
- Pélissier MC, O'Connor KP (2002) Deductive and inductive reasoning in obsessive-compulsive disorder. Br J Clin Psychol 41:15–27. 10.1348/014466502163769 [DOI] [PubMed] [Google Scholar]
- Petitet P, Attaallah B, Manohar SG, Husain M (2021) The computational cost of active information sampling before decision-making under uncertainty. Nat Hum Behav 5:935–946. 10.1038/s41562-021-01116-6 [DOI] [PubMed] [Google Scholar]
- Roets A, Van Hiel A, Cornelis I, Soetens B (2008) Determinants of task performance and invested effort: a need for closure by relative cognitive capacity interaction analysis. Pers Soc Psychol Bull 34:779–792. 10.1177/0146167208315554 [DOI] [PubMed] [Google Scholar]
- Sastre-Buades A, Ochoa S, Lorente-Rovira E, Barajas A, Grasa E, López-Carrilero R, Luengo A, Ruiz-Delgado I, Cid J, González-Higueras F, Sánchez-Alonso S, Baca-García E, Barrigón ML; Spanish Metacognition Study Group (2021) Jumping to conclusions and suicidal behavior in depression and psychosis. J Psychiatr Res 137:514–520. 10.1016/j.jpsychires.2021.03.024 [DOI] [PubMed] [Google Scholar]
- Scholl J, Kolling N, Nelissen N, Browning M, Rushworth MF, Harmer CJ (2017) Beyond negative valence: 2-week administration of a serotonergic antidepressant enhances both reward and effort learning signals. PLoS Biol 15:e2000756. 10.1371/journal.pbio.2000756 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S, Doya K (2008) Low-serotonin levels increase delayed reward discounting in humans. J Neurosci 28:4528–4532. 10.1523/JNEUROSCI.4982-07.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shahar N, Hauser TU, Moutoussis M, Moran R, Keramati M, consortium N; NSPN consortium; Dolan RJ (2019) Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling. PLoS Comput Biol 15:e1006803. 10.1371/journal.pcbi.1006803 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shiroma PR, Thuras P, Johns B, Lim KO (2014) Emotion recognition processing as early predictor of response to 8-week citalopram treatment in late-life depression. Int J Geriatr Psychiatry 29:1132–1139. 10.1002/gps.4104 [DOI] [PubMed] [Google Scholar]
- Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P (1995) A scale for the assessment of hedonic tone the Snaith-Hamilton Pleasure Scale. Br J Psychiatry 167:99–103. 10.1192/bjp.167.1.99 [DOI] [PubMed] [Google Scholar]
- Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA (1983) Manual for the State-Trait Anxiety Inventory. Palo Alto: Consulting Psychologists Press. [Google Scholar]
- Strauss AY, Fradkin I, McNally RJ, Linkovski O, Anholt GE, Huppert JD (2020) Why check? A meta-analysis of checking in obsessive-compulsive disorder: threat vs. distrust of senses. Clin Psychol Rev 75:101807. 10.1016/j.cpr.2019.101807 [DOI] [PubMed] [Google Scholar]
- Tanaka SC, Shishida K, Schweighofer N, Okamoto Y, Yamawaki S, Doya K (2009) Serotonin affects association of aversive outcomes to past actions. J Neurosci 29:15669–15674. 10.1523/JNEUROSCI.2799-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taylor MJ, Freemantle N, Geddes JR, Bhagwagar Z (2006) Early onset of selective serotonin reuptake inhibitor antidepressant action: systematic review and meta-analysis. Arch Gen Psychiatry 63:1217–1223. 10.1001/archpsyc.63.11.1217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Taylor Tavares JV, Clark L, Cannon DM, Erickson K, Drevets WC, Sahakian BJ (2007) Distinct profiles of neurocognitive function in unmedicated unipolar depression and bipolar II depression. Biol Psychiatry 62:917–924. 10.1016/j.biopsych.2007.05.034 [DOI] [PubMed] [Google Scholar]
- Thura D, Cisek P (2016) Modulation of premotor and primary motor cortical activity during volitional adjustments of speed-accuracy trade-offs. J Neurosci 36:938–956. 10.1523/JNEUROSCI.2230-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tranter R, Bell D, Gutting P, Harmer C, Healy D, Anderson IM (2009) The effect of serotonergic and noradrenergic antidepressants on face emotion processing in depressed patients. J Affect Disord 118:87–93. 10.1016/j.jad.2009.01.028 [DOI] [PubMed] [Google Scholar]
- Volans PJ (1976) Styles of decision-making and probability appraisal in selected obsessional and phobic patients. Br J Soc Clin Psychol 15:305–317. 10.1111/j.2044-8260.1976.tb00038.x [DOI] [PubMed] [Google Scholar]
- Voon V, Droux F, Morris L, Chabardes S, Bougerol T, David O, Krack P, Polosan M (2017) Decisional impulsivity and the associative-limbic subthalamic nucleus in obsessive-compulsive disorder: stimulation and connectivity. Brain 140:442–456. 10.1093/brain/aww309 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54:1063–1070. 10.1037//0022-3514.54.6.1063 [DOI] [PubMed] [Google Scholar]
- Yau Y, Dadar M, Taylor M, Zeighami Y, Fellows LK, Cisek P, Dagher A (2020) Neural correlates of evidence and urgency during human perceptual decision-making in dynamically changing conditions. Cereb Cortex 30:5471–5483. 10.1093/cercor/bhaa129 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Self-report questionnaire data. We found no impact of drug on any of self-report questionnaires. BDI–II = Beck's Depression Inventory II (Beck et al., 1996); SHAPS = Snaith-Hamilton Pleasure Scale (Snaith et al., 1995); STAI = State-Trait Anxiety Inventory (Spielberger, 1983); PANAS = Positive and Negative Affective Scale (Watson et al., 1988). Download Figure 1-1, DOCX file (20.7KB, docx) .