Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2022 May 9;18(5):e1010079. doi: 10.1371/journal.pcbi.1010079

Noradrenergic deficits contribute to apathy in Parkinson’s disease through the precision of expected outcomes

Frank H Hezemans 1,2,3,*, Noham Wolpe 4,5,6, Claire O’Callaghan 6,7, Rong Ye 2, Catarina Rua 2, P Simon Jones 2, Alexander G Murley 2, Negin Holland 2, Ralf Regenthal 8, Kamen A Tsvetanov 2,9, Roger A Barker 10,11, Caroline H Williams-Gray 10, Trevor W Robbins 9,12, Luca Passamonti 2,13, James B Rowe 1,2
Editor: Woo-Young Ahn14
PMCID: PMC9119485  PMID: 35533200

Abstract

Apathy is a debilitating feature of many neuropsychiatric diseases, that is typically described as a reduction of goal-directed behaviour. Despite its prevalence and prognostic importance, the mechanisms underlying apathy remain controversial. Degeneration of the locus coeruleus-noradrenaline system is known to contribute to motivational deficits, including apathy. In healthy people, noradrenaline has been implicated in signalling the uncertainty of expectations about the environment. We proposed that noradrenergic deficits contribute to apathy by modulating the relative weighting of prior beliefs about action outcomes. We tested this hypothesis in the clinical context of Parkinson’s disease, given its associations with apathy and noradrenergic dysfunction. Participants with mild-to-moderate Parkinson’s disease (N = 17) completed a randomised double-blind, placebo-controlled, crossover study with 40 mg of the noradrenaline reuptake inhibitor atomoxetine. Prior weighting was inferred from psychophysical analysis of performance in an effort-based visuomotor task, and was confirmed as negatively correlated with apathy. Locus coeruleus integrity was assessed in vivo using magnetisation transfer imaging at ultra-high field 7T. The effect of atomoxetine depended on locus coeruleus integrity: participants with a more degenerate locus coeruleus showed a greater increase in prior weighting on atomoxetine versus placebo. The results indicate a contribution of the noradrenergic system to apathy and potential benefit from noradrenergic treatment of people with Parkinson’s disease, subject to stratification according to locus coeruleus integrity. More broadly, these results reconcile emerging predictive processing accounts of the role of noradrenaline in goal-directed behaviour with the clinical symptom of apathy and its potential pharmacological treatment.

Author summary

Apathy is a common and harmful consequence of many neuropsychiatric diseases. Its underlying causes are not fully understood, which prevents the development of new treatments. We approach the problem in a new way, modelling human behaviour in terms of the continuously updated interaction between sensory information and brain-based predictions or ‘priors’ about the consequences of our actions. We have previously shown that apathy is related to a loss of precision of these ‘priors’. We proposed that the precision is controlled by noradrenaline (like adrenaline, but made in the brain). We tested whether the noradrenaline-enhancing drug called atomoxetine can restore the priors’ precision in apathetic people. We enrolled participants with Parkinson’s disease, which is associated with both apathy and noradrenaline loss. We used ultra-high field MRI to measure individual differences in the integrity of specialist region called the locus coeruleus–the brain’s source of noradrenaline. We found that the effect of treatment with atomoxetine on prior precision depended on locus coeruleus integrity: Participants with a degenerated locus coeruleus had a more positive change in prior precision. Our results highlight how individual differences in neuroanatomy can predict the potential benefit of noradrenaline treatments in people suffering from apathy.

Introduction

Apathy is a common and debilitating feature of many neuropsychiatric diseases, including Parkinson’s disease [13], and it occurs to varying degrees in the healthy population [4,5]. The reduction of goal-directed behaviour is typically attributed to dopamine-dependent loss of motivation [6,7], but it remains poorly understood. New treatments targeting apathy require mechanistic neurocognitive and psychopharmacological models [8].

Many psychopharmacological studies of apathy and Parkinson’s disease focus on dopamine [9], relating the striatal dopamine deficit in Parkinson’s disease [10] to the role of dopamine in reinforcement learning, along with value- and effort-based decision-making [11,12]. Apathetic individuals with Parkinson’s disease exert less effort for a given reward, and acute withdrawal studies demonstrate a dopaminergic modulation of this effect [1315].

However, the dopaminergic model of apathy has limitations. First, apathy is positively correlated with impulsivity, which has been attributed to hyper-dopaminergic states [5,1619]. Second, apathy is common in Parkinson’s disease patients despite dopamine replacement therapy, and may follow deep brain stimulation therapy [20]. There is no clear relationship between apathy severity and dopaminergic medication dose [1,19]. Third, evidence from animal models implicates non-dopaminergic neurotransmitter systems–in particular, noradrenaline–in motivation and effort-based decision-making [2123].

The locus coeruleus is the principal source of noradrenaline in the brain [24,25]. In Parkinson’s disease, it undergoes early and severe pathological changes [2628], and this has been associated with certain cognitive and motivational problems that are insensitive to dopamine medication [8,2932].

A growing body of work suggests that noradrenaline signals the uncertainty of an individual’s internal model of their environment. For example, phasic bursts of noradrenaline follow salient sensory inputs and promote behavioural adaptation [33,34], while tonic release of noradrenaline correlates with higher-order contextual features such as the volatility of the environment or utility of a task, controlling the gain and selectivity of neural networks [35,36]. Evidence from pharmacological manipulations and from pupillometry data (a surrogate marker of locus coeruleus activity [37]) suggests that noradrenergic signalling indicates the extent to which sensory input is used to update existing beliefs and uncertainty of internal models [3842]. The ability to flexibly update internal models permits adaptive engagement with the environment–supporting goal-directed, motivated behaviour. Disruption in this ability is directly relevant to apathy.

We previously proposed that apathy is a result of the dependence of motivated behaviour on the relative precision of prior beliefs about action outcomes [43]. With predictive processing, the brain optimises a probabilistic model of its environment, minimising ‘surprise’ or prediction error via action and perception [44,45]. The balance between active and passive (sensory) inference depends on the relative precision of prior beliefs and sensory evidence. When priors are held with high precision, they will be maintained despite conflicting (but imprecise) sensory evidence, and induce action to minimise the prediction error. That is, sensory evidence is changed by action to fulfil prior beliefs held with high precision [4648]. If precision on the priors is not sufficiently high, passive (sensory) inference occurs by adjusting perceptual priors, and no goal-directed action is necessary.

The implication for apathy is that the loss of prior precision relative to sensory evidence would lead to a failure of action, because imprecise priors that conflict with sensory evidence are passively revised rather than actively fulfilled [47,49]. There would be an apparent ‘acceptance’ of the state of the world, even if discordant with goals. In support of this hypothesis, trait apathy is negatively correlated with prior precision of outcomes: more apathetic individuals have less precise prior beliefs [43]. Crucially, precision weighting has been associated with neurotransmitter systems that include noradrenaline [5053].

This study tested the noradrenergic contributions to apathy in Parkinson’s disease. We hypothesised that apathy is associated with reduced weighting of prior beliefs about action outcomes, and that this prior weighting is modulated by noradrenaline. We predicted baseline dependency of drug effects, such that the behavioural effect of a noradrenergic intervention depends on structural integrity of the locus coeruleus, in line with the inverted U-shaped dose-response curve of noradrenaline and other catecholamines [35,5456]. We tested this hypothesis in Parkinson’s disease using an effortful goal-directed visuomotor task in combination with (i) modulation of noradrenaline using atomoxetine (a noradrenergic reuptake inhibitor) and (ii) measurement of structural integrity of the locus coeruleus via ultra-high field neuromelanin-sensitive magnetic resonance imaging. In view of the potential contribution of dopamine to apathy, control analyses included the levodopa equivalent daily dose and measurement of the substantia nigra contrast as covariates.

Results

Participants with mild-to-moderate idiopathic Parkinson’s disease (N = 17) completed a visuomotor task that involved effortful, goal-directed behaviour (Fig 1A). Their demographic and clinical details are outlined in Table 1. They completed this task twice in a double-blind, placebo-controlled, randomised within-subjects crossover design, receiving the selective noradrenaline reuptake inhibitor atomoxetine (40 mg oral dose) or placebo. A healthy control group (N = 20; age-, sex- and education-matched to the Parkinson’s disease group) undertook the task once, without the atomoxetine manipulation, to provide normative data. In view of baseline dependency of drug effects and the anticipated use of restorative pharmacology in patients but not healthy adults, the placebo-controlled drug intervention was restricted to those with Parkinson’s disease. All participants underwent 7T MR imaging of the locus coeruleus using a magnetisation transfer weighted sequence in a baseline session, with atlas-based localisation of the locus coeruleus and contrast quantification [57]. The participants with Parkinson’s disease were on their regular anti-parkinsonian medication throughout the study. Table 1 provides an overview of the participant demographics; further details about the study design and clinical characteristics of the Parkinson’s disease group are provided in the Materials and Methods and S1 Text.

Fig 1. Visuomotor task and Bayesian modelling approach.

Fig 1

A) Participants performed a sustained finger press to trigger a ballistic ball trajectory, aiming it at a target. For the majority of trials, an animation of the ball trajectory was shown, and participants sought to minimise their performance error–the distance of the final ball position from the target (top row). For the remaining trials, the ball trajectory was hidden and participants were asked to estimate where the ball would have finished. Participants were given 12 evenly spaced response options, one of which was pseudorandomly selected to be centred on the true final ball position (i.e., the veridical response option). The difference between the chosen and veridical response option constitutes the estimation error (bottom row). The pointing finger image was adapted from the Wikimedia Commons, available at https://commons.wikimedia.org/wiki/File:Index_finger_down.JPG under a CC BY-SA 3.0 license (https://creativecommons.org/licenses/by-sa/3.0/). B) Estimates of performance were modelled as a precision-weighted combination of a prior, centred on the target, and trial-wise sensory evidence, centred on the true final ball position. The relationship between estimation errors and performance errors is indicative of prior weighting–the precision of the prior relative to sensory evidence. C) Simulation demonstrating that prior weighting corresponds to the slope of the linear relationship between performance error and estimation error. For a given performance error and setting of prior weighting, the bold line represents the median predicted estimation error, and the increasingly transparent shaded areas represent the 25% and 50% quantile intervals of the predicted estimation error, respectively.

Table 1. Demographics and clinical characteristics of participants.

Parkinson’s disease Controls BF p
Age (years) 66.94 (7.29) 65.40 (5.97) 0.39 .492
Education (years) 14.24 (2.17) 14.30 (3.29) 0.32 .943
Male / Female 15 / 2 12 / 8 2.04 .120
Apathy Scale (max. 42) 12.68 (5.77) 10.58 (5.09) 0.58 .212
MMSE (max. 30) 29.47 (0.72) 29.80 (0.52) 0.87 .127
MoCA (max. 30) 28.00 (1.84) 28.35 (1.50) 0.37 .535
ACE-R Total Score (max. 100) 95.12 (3.72) 97.55 (3.46) 1.60 .049
Attention & Orientation (max. 18) 17.82 (0.39) 17.95 (0.22) 0.57 .251
Memory (max. 26) 23.76 (2.05) 25.05 (1.19) 2.68 .031
Fluency (max. 14) 12.18 (1.94) 12.85 (1.76) 0.51 .280
Language (max. 26) 25.82 (0.53) 25.90 (0.45) 0.35 .641
Visuospatial (max. 16) 15.65 (0.49) 15.80 (0.70) 0.40 .441
MDS-UPDRS I: Nonmotor experiences (max. 52) 8.41 (3.87)
II: Motor experiences (max. 52) 12.76 (4.49)
III: Motor Examination (max. 132) 27.94 (12.05)
IV: Motor Complications (max. 24) 0.35 (0.79)
Total Score (max. 260) 49.53 (17.55)
Hoehn and Yahr stage (max. 5) 2.24 (0.44)
Disease duration (years) 4.15 (1.72)
Levodopa equivalent daily dose (mg/day) 659.94 (514.90)

Note. Data are presented as mean (SD). Group comparisons were performed with independent samples t-tests or contingency tables as appropriate. The stated p-values are uncorrected; none survived p < .05 after correction for multiple comparisons. The participants with Parkinson’s disease were tested on their regular medications. Levodopa equivalent daily dose was calculated based on Tomlinson et al. [58]. Apathy Scale refers to the total score for the self-rated version of the Starkstein et al. [59] questionnaire. Abbreviations: BF, Bayes Factor for the alternative hypothesis over the null hypothesis, where > 3 would indicate positive evidence in favour of a group difference; MMSE, Mini Mental State Examination; MoCA, Montreal Cognitive Assessment; ACE-R, Addenbrooke’s Cognitive Examination—Revised; MDS-UPDRS, Movement Disorder Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale.

Visuomotor task

The visuomotor task involved effortful, goal-directed behaviour, and was designed to estimate prior weighting, i.e. the relative precision of prior beliefs and sensory evidence in the perception of action outcomes. Using their dominant hand, participants pressed a force sensor to trigger a ballistic ball movement on the screen, aiming for the ball to stop on a target. The force exerted on the sensor (relative to the participant’s maximum force, measured separately) determined the initial velocity of the ball. Since the deceleration of the ball was constant, the force response (i.e., initial velocity) directly determined the ball’s final position. The difference between the ball’s final position and the target constituted the performance error. For 40 out of the total 120 trials, the ball’s trajectory was not shown, and participants were asked to estimate where the ball would have stopped, indicating their response on a grid of 12 response options (Fig 1A; see Materials and Methods for details). The difference between the participant’s selected response option and the response option that was centred on the true final ball position constituted the estimation error. The linear relationship between estimation errors and performance errors was used to infer prior weighting (Fig 1B and 1C; see Materials and Methods for details).

We first tested for differences in basic task performance between drug conditions within the Parkinson’s disease group (atomoxetine vs. placebo). We also tested the effect of group (Parkinson’s disease on placebo vs. controls) noting the multiple differences between these groups, including the presence of Parkinson’s disease, the placebo effect, and repetition effects.

We examined to what extent the force exerted on the force sensor matched the force required to stop the ball on target (force error; see Materials and Methods for details). Among the Parkinson’s disease group there was no significant effect of atomoxetine on either the median force error (Δ drug: M = 0.64%, SD = 1.84%; t(16) = 1.44, p = .168; BF = 0.60) or the interquartile range of force error (Δ drug: M = -0.09%, SD = 2.59%; t(16) = -0.14, p = .892; BF = 0.25). We found no significant differences between the Parkinson’s disease and control groups, in terms of the median force error (controls: M = 0.69%, SD = 3.21%; PD placebo: M = -0.48%, SD = 2.78%; t(34.98) = 1.19, p = .242; BF = 0.55) and the interquartile range of force error (controls: M = 9.92%, SD = 3.73%; PD placebo: M = 9.19%, SD = 3.47%; t(34.69) = 0.62, p = .540; BF = 0.37).

Prior weighting and apathy

We next examined participants’ estimates of their own performance, to infer the relative weight afforded to prior beliefs in the perception of action outcomes. Following Bayes’ rule, participants are assumed to combine their prior belief, centred on the target, with trial-wise sensory evidence, centred on the (hidden) true final ball position, to estimate the ball’s final position (Fig 1B). Assuming that the prior and sensory evidence are represented as Gaussian distributions with unknown variances σprior2 and σevidence2, the posterior estimate for a given trial n(xestimate(n)) is a precision-weighted sum of the target position xtarget(n) and the true final ball position xball(n):

xestimate(n)=wpriorxtarget(n)+(1wprior)xball(n) (1)

where the prior weighting term wprior is given by:

wprior=σevidence2σevidence2+σprior2 (2)

By subtracting the true final ball position from both sides of Eq 1, we can express estimation errors as a function of performance errors:

xestimate(n)xball(n)estimationerror=wprior(xball(n)xtarget(n))performanceerror (3)

Thus, the regression coefficient of estimation errors by performance errors corresponds to the negative of the prior weighting term [60]. This is illustrated in Fig 1C using simulated data: higher values of prior weighting yield estimates that are strongly drawn towards the target and away from the true final ball position. When prior weighting approaches 1, the estimation errors overwhelm the performance errors, reflecting a disregard for sensory evidence of poor performance. When prior weighting approaches 0, the estimates are in line with the true performance. We used a linear mixed effects model to estimate the relationship between estimation error and performance error, allowing the slope (i.e., negative prior weighting) to vary for each testing session for each participant. Note that this model was only fit to the subset of trials where the ball’s visual trajectory was not shown (i.e., estimation trials, see Materials and Methods for details). Thus, the participants could not have used visual information to infer the ball’s final position.

We confirmed that prior weighting was negatively associated with apathy, as measured by the Apathy Scale (AS)[59]. Prior weighting estimates from the Parkinson’s disease group on placebo and the control group were regressed against apathy, group (Parkinson’s disease vs. controls) and their interaction. To avoid confounding individual differences in prior weighting with basic task performance, we included the interquartile range of performance error as a covariate of no interest. We found a negative association between prior weighting and apathy, controlling for effects of group and performance error variability (Fig 2B; β = -0.35, SE = 0.15, t(32) = -2.31, p = .028; BF = 2.30). This corroborates the negative relationship between prior weighting and trait apathy in healthy young adults [43]: more apathetic individuals show reduced prior weighting (S1 Fig). There was no group-wise difference in prior weighting between controls and patients on placebo (Fig 2A; controls: M = 0.48, SD = 0.21; PD placebo: M = 0.45, SD = 0.26; β = 0.03, SE = 0.15, t(32) = 0.20, p = .845; BF = 0.41), nor evidence for a group × apathy interaction effect (β = 0.17, SE = 0.15, t(32) = 1.08, p = .287; BF = 0.60).

Fig 2. Prior weighting and apathy.

Fig 2

A) Estimates of prior weighting, obtained through a linear mixed effects model of estimation errors against performance errors. For the Parkinson’s disease group, the grey lines indicate within-subject change in prior weighting from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations (all within 1.5 × interquartile range from the box limits). B) The relationship between apathy and prior weighting, adjusted for the effects of group and task performance variability (i.e., partial residuals). Note that observations with identical questionnaire scores were horizontally jittered to avoid overlaid dots.

Prior weighting and noradrenaline

Having established that prior weighting was associated with apathy, we tested whether atomoxetine affected prior weighting in the Parkinson’s disease group (Fig 3A). On average across the group, there was no difference in prior weighting between the atomoxetine and placebo sessions (Fig 2A; Δ drug: M = -8.50 × 10−4, SD = 0.27; t(16) = -0.01, p = .990; BF = 0.25). However, the between-subject variance in prior weighting was reduced on atomoxetine relative to placebo (Pitman’s test of equality of variance for paired data: t(15) = -2.24, p = .041; BF = 2.46), which suggests a baseline-dependent drug effect [61].

Fig 3. Baseline-dependent effects of noradrenaline on prior weighting.

Fig 3

A) Schematic overview of the noradrenergic drug study. The first session involved 7T MRI of the locus coeruleus, to estimate the mean contrast-to-noise ratio (CNR). The second and third sessions formed a double-blind randomised placebo-controlled crossover study, with 40 mg of oral atomoxetine of placebo. Two hours after drug administration, participants performed the visuomotor task that was designed to estimate prior weighting. B) Study-specific independent locus coeruleus atlas (red) and reference region in the central pons (blue). Image reused from O’Callaghan et al. [62] under a CC-BY 4.0 license (https://creativecommons.org/licenses/by/4.0/). C) Estimates of prior weighting for participants with Parkinson’s disease, plotted as a function of their locus coeruleus CNR and the drug condition. Within-subject change in prior weighting from placebo to atomoxetine is indicated by the grey arrows. D) The relationship between the drug-induced change in prior weighting (atomoxetine minus placebo) and locus coeruleus CNR.

We had predicted that the effect of atomoxetine depends on the structural integrity of the locus coeruleus, as indexed by its contrast to noise ratio (CNR; Fig 3B; see Materials and Methods for details). To test this, we entered prior weighting as the dependent variable in a linear mixed effects model with drug condition, locus coeruleus CNR and their interaction as fixed effects, the interquartile range of performance error as a covariate of no interest, and a random effect of participants on the intercept. We observed evidence for an interaction effect between the drug condition and locus coeruleus CNR (Fig 3C; β = -0.38, SE = 0.14, F(1, 15) = 7.91, p = .013; BF = 10.02), confirming that the effect of atomoxetine on prior weighting depended on locus coeruleus integrity. Specifically, the drug-induced change in prior weighting (atomoxetine vs. placebo) was negatively associated with locus coeruleus CNR, such that participants with lower locus coeruleus CNR tended to have a more positive change in prior weighting (Fig 3D; r(15) = -0.59, p = .013; BF = 5.13). There were no main effects of the drug condition (β = -2.06 × 10−3, SE = 0.13, F(1, 15) = 2.36 × 10−4, p = .988; BF = 0.29) or locus coeruleus CNR (β = -0.08, SE = 0.20, F(1, 14) = 0.16, p = .695; BF = 0.43) on prior weighting.

Supplementary analyses confirmed the robustness and specificity of the interaction effect between the drug condition and locus coeruleus CNR. First, using both frequentist and Bayesian model selection procedures, we found that this interaction persisted with additional covariates, including age, motor severity (UPDRS part III), levodopa equivalent daily dose, atomoxetine plasma level, and total intracranial volume (S2 Text). Second, we used a linear mixed effects model with CNR extracted from the substantia nigra, as a neuromelanin-rich control region [63]. There was no interaction effect between the drug condition and substantia nigra CNR on prior weighting (β = 0.16, SE = 0.16, F(1, 15) = 0.94, p = .349; BF = 0.71). Third, the interaction with locus coeruleus CNR remained significant when using an alternative calculation for locus coeruleus contrast (contrast ratio to mean instead of SD; β = -0.41, SE = 0.13, F(1, 15) = 9.79, p = .007; BF = 17.40), or when using the more conservative 25% probability mask to derive the locus coeruleus CNR (β = -0.42, SE = 0.13, F(1, 15) = 10.25, p = .006; BF = 20.22). Fourth, re-fitting the original linear mixed effects model using a robust estimation method yielded qualitatively similar results (β = -0.38, SE = 0.15, t(15) = -2.62, p = .019). Taken together, these findings underwrite the robustness and specificity of the drug × locus coeruleus CNR interaction.

Decomposition of noradrenergic effects on prior weighting

As prior weighting represents the precision of the prior relative to the sensory evidence (Eq 2), drug-induced changes in prior weighting could in principle be explained by changes in prior precision, sensory evidence precision, or both. We therefore fitted the Parkinson’s disease group data with a hierarchical Bayesian model that decomposed the drug effect on prior weighting into separate drug effects on the standard deviation of the prior and sensory evidence distributions (see Materials and Methods for details). The drug effect on the standard deviation of the prior was associated with the drug effect on prior weighting (Fig 4A; β = -0.66, SE = 0.19, t(15) = -3.41, p = .004; BF = 10.43). This relationship was negative, such that those participants who had reduced prior weighting on atomoxetine, tended to have greater standard deviation of the prior (i.e., reduced prior precision). In contrast, there was no significant relationship between the drug effect on the standard deviation of sensory evidence and the drug effect on prior weighting (Fig 4B; β = -0.04, SE = 0.26, t(15) = -0.15, p = .884; BF = 0.42).

Fig 4. Decomposition of noradrenergic effects on prior weighting.

Fig 4

A-B) The relationship between the drug effect on prior weighting and Bayesian model estimates of the drug effect on the standard deviation of the prior distribution (A) and the standard deviation of the sensory evidence distribution (B). C) Schematic illustration of how the effect of atomoxetine on prior precision (red) determines the extent to which (posterior) estimates of performance (blue) are drawn towards the prior, for a given sensory evidence (black). Lighter shades of red represent less precise priors. The effect of prior precision on the posterior is illustrated with corresponding shades of blue.

To directly test whether the drug effect on prior weighting was more strongly associated with the drug effect on prior precision than the drug effect on sensory evidence precision, we performed a repeated-measures ANCOVA with the drug effect on prior weighting as a between-subjects covariate, the precision term (prior vs. sensory evidence) as the within-subjects factor, and the estimated drug effects on prior and sensory evidence precision as the dependent variable. We found evidence for the interaction between the precision term and the drug effect on prior weighting (F(1, 15) = 8.34, p = .011; BF = 19.90), confirming that the relationships with the drug effects on prior and sensory evidence precision were significantly different from each other. We obtained similar results using a ‘plausible values’ analysis approach that accounts for uncertainty in the parameter estimates (S3 Text).

Overall, these results suggest that the atomoxetine-induced change in prior weighting was primarily explained by changes in prior precision, and not by changes in sensory evidence precision (Fig 4C).

Apathy moderates noradrenergic effects on prior weighting

Lastly, given the relationship between prior weighting and apathy (Fig 2A), we tested whether the effect of locus coeruleus integrity on the atomoxetine-induced change in prior weighting varied according to the observed apathy. We regressed the drug effect on prior weighting against locus coeruleus CNR, apathy, and their interaction. We observed a significant interaction effect between locus coeruleus CNR and apathy (β = -0.49, SE = 0.21, t(13) = -2.34, p = .036; BF = 2.54), such that greater apathy was associated with a stronger (i.e. more negative) relationship between locus coeruleus CNR and atomoxetine’s effect on prior weighting (Fig 5A). Specifically, the Johnson-Neyman procedure [64] indicated that the regression coefficient of locus coeruleus CNR was significant when the Apathy Scale score was above 12 (Fig 5B). This significance threshold approximates the commonly used threshold for clinically significant apathy (14 or higher)[59]. These results suggest that the baseline-dependent noradrenergic effects on prior weighting is more likely to be observed among those participants who were apathetic. However, we note that the Bayes Factor of the interaction effect was “anecdotal”.

Fig 5. Baseline-dependent noradrenergic effects on prior weighting are moderated by apathy.

Fig 5

A) The relationship between the drug effect on prior weighting and locus coeruleus CNR, plotted separately for above-average, average, and below-average scores on the Apathy Scale. Note that the Apathy Scale was treated as a continuous predictor in the reported statistical analyses, and is only discretised for visualisation purposes. B) Jonhson-Neyman interval plot, illustrating the range of scores on the Apathy Scale for which the regression coefficient of locus coeruleus CNR on the drug effect on prior weighting was statistically significant. The grey and blue shaded areas represent the 95% confidence interval for the predicted regression coefficient of locus coeruleus CNR, given the Apathy Scale score. The Apathy Scale scores (x-axis) were z-scored to facilitate interpretation of the regression coefficient (y-axis); the significance threshold of z = -0.02 (blue dashed line) corresponded to a score of 12.3.

Discussion

This study provides evidence that the locus coeruleus noradrenergic system regulates the balance between prior beliefs and sensory evidence for goal-directed behaviour, and its impairment contributes to apathy. Individual differences in the relative weight afforded to prior beliefs were negatively associated with apathy, such that more apathetic individuals had reduced prior weighting. Atomoxetine modulated this prior weighting in a baseline-dependent manner in people with Parkinson’s disease: people with reduced locus coeruleus integrity had a greater increase in prior weighting after atomoxetine, relative to a placebo. Using hierarchical Bayesian modelling, we demonstrated that this drug-induced change in prior weighting was primarily explained by changes in the precision of prior beliefs, and not by changes in the precision of sensory evidence. These results highlight the link between the noradrenergic locus coeruleus and the control of prior precision, during goal-directed behaviour. Given the early loss of noradrenergic cells in the locus coeruleus by Parkinson’s disease, this association suggests a contributory mechanism to apathy in Parkinson’s disease.

We propose that increased weighting of prior beliefs following atomoxetine may help alleviate apathy. According to Bayesian models of brain function, actions require prior beliefs about their outcomes to be held with relatively high precision [46,49]. In Parkinson’s disease, the relative precision of predictive signals is compromised [65,66], which underlies the poverty of action selection and increased reliance on external cues for the initiation and maintenance of movement [6769]. By restoring the precision of prior beliefs, atomoxetine may help attenuate disruptive sensory input [70] and minimise the unnecessary updating of prior beliefs in light of spurious prediction errors [71,72]. Thus, atomoxetine could confer a benefit to Parkinson’s disease patients with reduced noradrenergic capacity, by restoring the reliance on the predictive signals that are necessary for goal-directed behaviour.

Previous studies have emphasised that the effects of catecholaminergic drugs–including atomoxetine–depend on individual differences in the baseline levels of activity of the ascending neuromodulatory systems [35,5456]. However, without specific estimates of locus coeruleus integrity or noradrenergic capacity, heterogeneity in the response to atomoxetine is difficult to interpret [38,73]. Here, we used ultra-high field imaging to directly quantify the structural integrity of the locus coeruleus in individuals with Parkinson’s disease. Our results indicate that individuals with a more severely degenerated locus coeruleus had a stronger increase in prior weighting following a single dose of atomoxetine, whereas individuals with a relatively preserved locus coeruleus had no meaningful change or even a reduction in prior weighting. These results are consistent with an inverted-U shaped curve of neurotransmitter function, whereby intermediate levels of activity are associated with optimal performance, while hypo- or hyperactive levels lead to suboptimal behaviour [35,74,75].

The relationship between locus coeruleus integrity and the drug-induced change in prior weighting varied according to apathy levels. For less apathetic individuals, there was generally no meaningful effect of atomoxetine on prior weighting, and no clear relationship between locus coeruleus integrity and the drug’s effect. In contrast, among more apathetic individuals, we observed a clear baseline-dependent effect of atomoxetine on prior weighting. These results underwrite the multifactorial nature of catecholaminergic drug effects in Parkinson’s disease, with complex interactions between the baseline neuromodulatory state and behavioural symptoms [54,76]. They also highlight the importance of locus coeruleus imaging for informing noradrenergic therapy: among individuals with apathy, the cognitive effects of atomoxetine varied as a function of locus coeruleus integrity.

Our results inform theoretical models of noradrenergic function. According to the adaptive gain theory [35], dynamic shifts between predominantly phasic or tonic modes of locus coeruleus activity modulate the gain of task-relevant brain networks at different timescales, and thereby regulate the balance between task engagement and disengagement [77,78]. Phasic bursts of locus coeruleus activity, time-locked to task-relevant events, are proposed to induce an adaptive sampling bias, increasing the salience of prepotent representations while inhibiting weaker competing representations. In contrast, persistently elevated (tonic) locus coeruleus activity increases the salience of representations indiscriminately, encouraging task disengagement and exploration [35] (see also [36]). It is possible that individuals with reduced locus coeruleus integrity increase the phasic-to-tonic firing ratio following atomoxetine [79], whereas individuals with preserved locus coeruleus integrity were shifted into a predominantly tonic mode of firing. On this basis, an atomoxetine-induced increase in phasic locus coeruleus activity would cause inferences about task performance to be dominated by “optimistic” priors [60], neglecting sensory evidence for subtle deviations from this prior [80,81]. Although this interpretation of the atomoxetine-induced changes in prior weighting remains to be directly tested, it is supported by several lines of evidence. The anterior cingulate and dorsomedial frontal cortex are associated with mechanisms of belief updating [41,8284]. Reciprocal connections between these regions and the locus coeruleus [35,85] might therefore enable noradrenergic modulation of the reliance on internal models for action [86]. In Parkinson’s disease, locus coeruleus degeneration is accompanied by reduced noradrenaline levels in the forebrain [87,88]. Atomoxetine increases extracellular noradrenaline levels across the brain–including a three-fold increase in the prefrontal cortex–by inhibiting the presynaptic noradrenaline transporter [89,90]. Thus, for individuals with severe locus coeruleus degeneration, atomoxetine may help alleviate the dysfunctional modulation of prefrontal noradrenergic targets, and thereby help restore the precision of prefrontal representations of predictive signals.

This study has limitations. First, although we collected a comprehensive dataset for each individual participant, incorporating various demographic, behavioural, and neuropharmacological measures, the total number of participants is modest. Our study design was therefore not well-suited for data-driven analyses [91] or predictive modelling [92], and may have been prone to type II error for frequentist statistical inferences on small effects. We focused on the analyses of theory-driven models, with reporting of effect sizes and complementary Bayesian statistics. Second, the participants with Parkinson’s disease were not severely apathetic, as the group mean score on the Apathy Scale fell below conventional cut-off scores for clinically significant apathy [1,59], and there was no statistically significant difference in apathy between the Parkinson’s disease and control groups. We adopted a dimensional approach [17,93], focusing on individual differences rather than group contrasts in the mechanisms underlying apathy. Nevertheless, we recognise that it remains to be proven whether the current findings generalise to more severely apathetic cohorts. Third, we acknowledge the psychopharmacological complexity of medicated Parkinson’s disease patients and atomoxetine.

Due to the limited expression of dopamine transporters in the prefrontal cortex [94], a portion of dopamine reuptake is mediated by the noradrenaline transporter [95,96]. Thus, by blocking the noradrenaline transporter, atomoxetine can increase both noradrenaline and dopamine levels in the prefrontal cortex [89,97]. It can be challenging to disentangle the noradrenergic versus dopaminergic effects of atomoxetine. Noradrenaline and dopamine are closely related neuromodulators that are synthesised from a shared metabolic pathway. They can be co-released from the same noradrenergic terminals in the prefrontal cortex [98,99]. Furthermore, locus coeruleus activity can alter midbrain dopamine cell firing [100] and contribute to dopamine release in the hippocampus [101]. Thus, we cannot wholly exclude the possibility that atomoxetine-induced changes in prior weighting partially reflected dopaminergic effects. However, we note that the integrity of the substantia nigra yielded null results in the model, and including levodopa equivalent daily dose (LEDD) as a covariate did not change the interaction between the drug condition and locus coeruleus CNR on prior weighting. Previous studies similarly found no evidence that the effect of atomoxetine in Parkinson’s disease depends on individual differences in LEDD [102]. Future studies could opt for a crossover design with both noradrenergic and dopaminergic agents, to enhance the specificity of findings.

It is possible that the changes in prior weighting are related to atomoxetine-induced changes in arousal [103,104]. However, we note that atomoxetine did not affect self-reported levels of arousal [62], nor did it affect basic task performance in the current study or in a stop-signal task, either at the group-average level or in relation to individual differences in locus coeruleus CNR [62]. This argues against a simple effect via arousal.

We used Bayesian inference as a principled framework to model the computational goal of perceptual inference in the context of effortful, goal-directed behaviour. However, we cannot comment directly on the exact algorithmic underpinnings of Bayesian perceptual inference in our experiment [105]. Following hierarchical models of predictive coding, one could decompose behaviour in our experiment into predictions at multiple levels of abstraction, from low-level proprioceptive predictions for movement to high-level multi-modal, domain-general beliefs [46,106111]. Future work is needed to address how such a framework can accommodate the various stages of information processing that are thought to be involved in effort- and reward-based decision-making [112114], including the weighting of action policies [13,15,53], initiating and sustaining an action [115], and evaluating and learning from the action outcomes.

We designed this study to test a mechanistic hypothesis about the noradrenergic regulation of sensorimotor integration in Parkinson’s disease. It was not a clinical trial, and we did not focus on clinical outcomes. Further studies are needed to determine if atomoxetine can improve everyday functioning of people with Parkinson’s disease, incorporating patient-, carer- and clinician-rated assessments as well as experimental paradigms [16,17]. Our results suggest that patients with significant apathy may benefit from noradrenergic treatment, informing future stratified clinical trials.

In conclusion, this study provides preliminary evidence for a noradrenergic role in apathy in Parkinson’s disease, via the precision weighting of prior beliefs about action outcomes. We suggest that these results support a Bayesian account of apathy as a failure of active inference, resulting from impaired noradrenergic precision of priors for action. The noradrenergic modulation of prior precision may help explain dopamine-insensitive cognitive deficits in Parkinson’s disease, including apathy. Locus coeruleus imaging may offer a useful marker of noradrenergic function that can inform new stratified trials of noradrenergic therapies in selected patients with neurodegenerative disease.

Materials and methods

Ethics statement

The study was approved by the Health Research Authority East of England–Cambridge Central Research Ethics Committee (REC 10/H0308/34), and all participants provided written informed consent in accordance with the Declaration of Helsinki.

The current study was part of a broader project on the noradrenergic mechanisms of cognitive and motivational problems in Parkinson’s disease, including response inhibition deficits, as reported in O’Callaghan et al. [62]. Therefore, the following description of the participants, study procedure, and locus coeruleus imaging overlaps with the Methods section in O’Callaghan et al. [62].

Participants

Eighteen people with idiopathic Parkinson’s disease were recruited via the University of Cambridge Parkinson’s disease research clinic and through Parkinson’s UK volunteer panels. All participants met the United Kingdom Parkinson’s Disease Society Brain Bank criteria, were aged between 50–80 years, and had no contraindications to 7T MRI or atomoxetine. No participants had dementia, based on the Movement Disorder Society criteria for Parkinson’s disease dementia [116] and the mini-mental state examination (score > 26)[117]. None had current impulse control disorders, based on clinical impression and the Questionnaire for Impulsive-Compulsive Disorders in Parkinson’s Disease (QUIP-Current Short) screening tool [118]. Levodopa equivalent daily dose (LEDD) was calculated according to Tomlinson et al. [58].

Twenty-one age-, sex- and education-matched healthy controls were recruited from local volunteer panels, to provide normative data. They had no history of neurological or psychiatric disorders, and were not using psychoactive medications.

One control participant and one participant with Parkinson’s disease had excessive amounts of missing visuomotor task data (≥ 50% of trials) due to technical issues. After excluding these participants, the final sample consisted of 17 participants with Parkinson’s disease and 20 controls. Demographic details and clinical characteristics are provided in Table 1 and S1 Text.

Study procedure

Participants with Parkinson’s disease were tested across three sessions. The first session consisted of MRI scanning and clinical assessment, including the Movement Disorder Society Unified Parkinson’s Disease Rating Scale (MDS-UPDRS), mini-mental state examination (MMSE), Montreal cognitive assessment (MoCA) and the revised Addenbrooke’s cognitive examination (ACE-R).

The second and third sessions formed a double-blind randomised placebo-controlled crossover study, with 40 mg of oral atomoxetine or placebo. The 40 mg atomoxetine dose is widely used as a well-tolerated ‘starter dose’ [119,120] that is capable of modulating behaviour and brain function in Parkinson’s disease [29,102]. The drug order was pseudorandomly permuted in blocks of six successive participants, to ensure that the order was balanced across the group. This means that three participants were pseudorandomly assigned to the placebo-atomoxetine order and three to the atomoxetine-placebo order within each block of the 1st– 6th, 7th– 12th, and 13th– 18th participants. The sessions were scheduled at least 6 days apart (M = 7.29 days, SD = 1.76 days, range: 6–14 days) and at a similar time of day. For each session, blood samples were taken two hours after drug administration, to coincide with predicted peak plasma concentration of atomoxetine after a single oral dose [121]. Mean plasma concentration [122] was 264.07 ng/mL after atomoxetine (SD = 124.50 ng/mL, range: 90.92–595.11 ng/mL) and 0 ng/mL after placebo. After the blood sample, participants completed an experimental task battery that included a visuomotor task, which is the focus of the current manuscript. Participants were on their regular anti-parkinsonian medications throughout the study.

Control participants were tested in a single session that included MRI scanning and the same experimental task battery as the participants with Parkinson’s disease. The control group did not undergo the drug manipulation.

All participants completed a set of questionnaires that assessed mood and various behavioural symptoms. With the exception of the Apathy Scale [59], these questionnaires were primarily collected for demographic purposes, and are described in detail in S1 Text.

Visuomotor task

We administered a visuomotor task (adapted from Hezemans et al. [43]) that involved effortful, goal-directed behaviour, and required participants to estimate their own performance. For each trial, participants pressed on a force sensor for 3 seconds using the index finger of their dominant hand, to subsequently trigger a ballistic ball movement on the screen, aiming for the ball to stop on the target. The force response was defined as the mean force exerted from 1.5 to 2.5 seconds, divided by the participant’s maximum force (estimated separately, see below). The initial velocity of the ball increased monotonically with the force response. The deceleration of the ball was kept constant. Thus, the relative force exerted on the sensor (i.e., the initial velocity) directly determined the ball’s final position. As a measure of basic task performance, we calculated the force error, defined as the difference between the force response and the force required to stop the ball perfectly on target.

The task consisted of two types of trials: basic trials and estimation trials. For basic trials, participants viewed the outcome of their action–that is, the ball’s full trajectory to its final position on the screen. The difference between the ball’s final position and the target constituted the performance error, expressed in pixels.

Estimating task performance

For estimation trials, the ball’s trajectory was not shown, and participants were asked to estimate where the ball would have stopped. Participants were shown a grid of 12 evenly spaced response options (labelled with numbers 1 to 12), where one of the response options was centred on the true final ball position (i.e. the veridical response option). Participants verbally indicated their belief about the ball’s final location to the experimenter as a digit (“one” to “twelve”). The difference between the selected response option and the veridical response option constituted the estimation error. Note that the target was not shown during the estimation procedure, and participants did not receive feedback regarding the true final ball position on estimation trials.

For each estimation trial, the veridical response option was selected pseudorandomly from a uniform distribution between 3 and 10. This ensured that the absolute position of the estimation grid was not indicative of the true final ball position, and that there were sufficient response options both to the left and right of the true final ball position. The width of the estimation grid was 30% of the screen width. Note that in our previous work using an unconstrained (mouse cursor) estimation procedure [43], the standard deviation of estimation error was 6.80% of the screen width.

Task procedure

The task started with a practice block of 15 basic trials. In the last 5 of these practice trials, participants were asked to estimate their performance after observing the full ball trajectory, to introduce the estimation procedure. The experimenter verified that the participant understood the estimation procedure, and if necessary the practice block was repeated. The practice data was not analysed further. The subsequent test phase consisted of 4 blocks of 30 trials each. Each block consisted of 20 basic trials and 10 estimation trials. The trials within each block were pseudorandomly interleaved, with the constraints that the first 3 trials were always basic trials and that there could not be two consecutive estimation trials. In total, each testing session consisted of 120 trials, of which 40 were estimation trials. To minimise potential effects of fatigue on task performance, participants were given the opportunity to take a short break after each block.

For consistency with the original study design in Hezemans et al. [43], the task additionally featured experimental manipulations of effort and reward. Physical effort was manipulated by displaying the target either relatively close to or far from the ball’s starting position, corresponding to 35% or 65% of the participant’s maximum force. Reward was manipulated by either giving participants points (tallied at the top of the screen) in relation to their performance on basic trials, or not giving any points. We used a 2 × 2 factorial design (low effort vs. high effort; no reward vs. reward) with one block of 30 trials for each combination of effort and reward. Following the results of Hezemans et al. [43], showing minimal effects of effort and reward on prior weighting that were not associated with apathy, we report the effects of these conditions on behaviour in S4 Text.

Maximum force calibration

We established each participant’s maximum force at the start of the task, so that the relative level of force required could be fixed across participants. Participants pressed with the maximum force they could sustain for 10 seconds. The mean force within a 5 second window with the lowest variance was taken as the response. This procedure was repeated three times, and the highest value across iterations was taken as the participant’s maximum force.

Bayesian modelling of performance estimates

The estimation trials in our visuomotor task can be considered as a Bayesian inference problem [123,124], where for each trial n participants infer a hidden variable x(n) given noisy sensory evidence s(n):

p(x(n)|s(n))posteriorp(s(n)|x(n))likelihoodp(x(n))prior (4)

The sensory evidence s(n) is assumed to be the true value of the hidden variable x(n) corrupted by sensory noise, s(n) = x(n)+ϵ(n), where the noise ϵ(n) is sampled from a Gaussian distribution with zero mean and variance σs2, that is ϵ(n)N(0,σs2). Thus, the likelihood is assumed to follow a Gaussian distribution with mean x(n) and variance σs2. The prior on x(n) is assumed to follow a Gaussian distribution with mean x0(n) and variance σ02. Taken together, the posterior of x(n) is proportional to the product of two Gaussian distributions:

p(x(n)|s(n))N(s(n);x(n),σs2)N(x(n);x0(n),σ02) (5)

The optimal estimate of the hidden variable, x^(n), minimises the expected loss L(x^(n),x(n)) given the sensory evidence. Since the posterior distribution in Eq 5 is Gaussian, its mean, median, and mode have the same value. We can therefore assume without loss of generality that the optimal estimate equals the posterior mean [125], which is a precision-weighted sum of the sampled sensory evidence and the prior mean:

x^(n)=argminx^(n)E[L(x^(n),x(n))|s(n)]
=σ02σ02+σs2s(n)+σs2σs2+σ02x0(n) (6)

Estimating prior weighting

In the current study, we assume that the sensory evidence is centred on the true final ball position xball(n) with variance σevidence2, and the prior is centred on the target position xtarget(n) with variance σprior2. The observed estimate of performance xestimate(n) can then be modelled as the sum of xball(n) and xtarget(n), weighted by their inverse variances:

xestimate(n)=σprior2σprior2+σevidence2xball(n)+σevidence2σevidence2+σprior2xtarget(n) (1 restated)

The prior weighting term, wprior=σevidence2σevidence2+σprior2, can be estimated as the negative of the regression coefficient of estimation error on performance error [60]:

xestimate(n)xball(n)estimationerror=wprior(xball(n)xtarget(n))performanceerror (3 restated)

We used a linear mixed effects model to fit the linear relationship between estimation errors and performance errors, allowing the slope to vary for each of the 54 completed testing sessions (20 control participants plus 17 participants with Parkinson’s disease tested twice). Prior to model fitting, the estimation errors and performance errors were z-scored for each testing session, to bring these variables onto a common scale and to ensure that the intercept was zero, as assumed by the model (Eq 3). We performed a parameter recovery analysis to ensure that this analysis procedure could reliably identify data-generating parameter values, given our experimental design and model assumptions (S5 Text).

Hierarchical Bayesian modelling of estimation trials

The observed estimate of performance can alternatively be modelled probabilistically, as a sample from the full posterior distribution:

xestimate(n)N(x^(n),σx^2) (7)

where the posterior variance σx^2 is given by:

σx^2=σevidence2σprior2σevidence2+σprior2 (8)

By explicitly modelling the posterior variance, the prior and sensory evidence variances can be separately identified. For example, although an increase in prior variance or a decrease in sensory evidence variance could have the same effect on prior weighting (Eq 2), these changes would have dissociable effects on the posterior variance (Eq 8).

Potential drug effects on the prior and sensory evidence variances were modelled as atomoxetine-induced changes (Δ) in these parameters, relative to the placebo session. For example, the standard deviation of the prior for participant i in session j was defined as follows:

σprior(i,j)={σprior(i)ifj=placeboσprior(i)+Δprior(i)ifj=atomoxetine (9)

We additionally accounted for any consistent spatial shifts in the sensory evidence, xshift, to relax the assumption that the trial-wise sensory evidence distribution was centred on the true final ball position [43,60,126]:

xevidence(n)=xball(n)+xshift (10)

The model consisted of five free parameters in total: σprior, σevidence, Δprior, Δevidence, and xshift. We estimated these parameters hierarchically, such that parameters for a given participant i were sampled from corresponding group-level distributions:

σprior(i)N+(μσprior,(σσprior)2)
σevidence(i)N+(μσevidence,(σσevidence)2)
Δprior(i)N(μΔprior,(σΔprior)2)
Δevidence(i)N(μΔevidence,(σΔevidence)2)
xshift(i)N(μxshift,(σxshift)2) (11)

where N+ denotes a Gaussian distribution that is truncated to only allow positive values. We generally assigned relatively broad (“weakly informative”) prior distributions on the group-level means and variances of the model parameters. The priors on μΔprior,μΔevidence, and μxshift were all centred on zero–that is, we conservatively assumed a priori that on average there would be no drug effects or spatial shift. Further details about the model specification are provided in S2 Fig. Our primary interest was in the participant-level estimates of drug effects on the standard deviation of the prior and sensory evidence distributions.

We additionally fit three variants of this model, where the prior and / or sensory evidence standard deviation parameters were constrained to be fixed across the placebo and atomoxetine sessions. Specifically, one model variant only allowed for drug effects on the prior standard deviation, another model variant only allowed for drug effects on sensory evidence standard deviation, and a final model variant did not include any drug-induced change parameters. However, a comparison of each model’s estimated pointwise predictive accuracy [127] favoured the inclusion of drug effects on both the prior and sensory evidence standard deviations (S3 Fig), and we therefore focused on the parameter estimates from the ‘full’ model.

We used Markov Chain Monte Carlo (MCMC) sampling to estimate the posterior distributions of the model parameters. We used 8 chains with 4000 samples each, and discarded the first 2000 samples of each chain as the warm-up. Model convergence was confirmed by the potential scale reduction statistic R^ (< 1.004 for all parameters), and by visual inspection of the time-series plots of the MCMC samples. The model’s goodness of fit was assessed by visually comparing the observed data to simulated data generated from the model’s posterior predictive distribution (S4 and S5 Figs). For a given parameter of interest, we took the median of its posterior distribution as the optimal estimate.

MRI acquisition

The MR images were acquired with a 7T Magnetom Terra (Siemens, Erlangen, Germany), using a 32-channel head coil (Nova Medical, Wilmington, USA). The locus coeruleus was imaged using a 3D magnetisation transfer (MT) weighted sequence at high resolution [57,128]. The sequence included 112 oblique, axial slices oriented perpendicular to the long axis of the brainstem, to cover both the midbrain and the pontine regions. A train of 20 Gaussian-shaped RF pulses was applied at 6.72 ppm off resonance, 420° flip angle, followed by a turbo-flash readout (TE = 4.08 ms, TR = 1251 ms, flip-angle = 8°, voxel size = 0.4 x 0.4 x 0.5 mm3, 6/8 phase and slice partial Fourier, bandwidth = 140 Hz/px, no acceleration, 14.3%- oversampling, TA ~ 7 min). The transmit voltage was adjusted for each participant based on the average flip angle in the central area of the pons, which was obtained from a B1 pre-calibration scan. The MT scan was repeated twice and averaged offline to enhance the signal-to-noise ratio. An additional scan was acquired with the same parameters as above but without the off-resonance pulses. For anatomical coregistration, a high resolution T1-weighted structural image (0.7 mm isotropic) was acquired using the MP2RAGE sequence with the UK7T Network harmonised protocol: TE = 2.58 ms, TR = 3500 ms, BW = 300 Hz/px, voxel size = 0.7 x 0.7 x 0.7 mm3, FoV = 224 x 224 x 157 mm3, acceleration factor (A>>P) = 3, flip angles = 5/2° and inversion times (TI) = 725/2150 ms for the first/second images.

Image processing and locus coeruleus integrity

The image processing pipeline is described in detail in O’Callaghan et al. [62], which used an identical pipeline as the current study (based on Ye et al. [57]). The MT images were bias field corrected, and then entered into a T1-driven coregistration pipeline to warp the images to the isotropic 0.5 mm ICBM152 (International Consortium for Brain Mapping) T1-weighted asymmetric template [129].

The co-registered MT images were used to quantify the contrast with respect to a reference region, the central pontine tegmentum, generating contrast-to-noise ratio (CNR) maps. For each participant i and voxel j, the signal x(i,j) was contrasted with the mean reference signal μref(i), and then divided by the standard deviation of the reference signal σref(i):

CNR(i,j)=x(i,j)μref(i)σref(i) (12)

To ensure that the CNR values were localised to the locus coeruleus, we used an independent locus coeruleus atlas based on a separate sample of 29 age- and education-matched healthy controls [62]. For each axial slice on the rostrocaudal extent, the locations of the left and right locus coeruleus were determined using a semi-automated segmentation method [57]. The locus coeruleus voxels were segmented into binary images, and then averaged and thresholded at 5% to obtain a template (705 voxels, 88.125 mm3; see Supplementary Materials in O’Callaghan et al. [62]).

To estimate the locus coeruleus integrity, we applied the independent locus coeruleus atlas to each participant’s CNR map, and then calculated the mean CNR value across the whole structure. We also performed this calculation after applying a more stringent locus coeruleus atlas that was thresholded at 25% (274 voxels, 34.25 mm3). In addition, we performed an alternative calculation of locus coeruleus contrast that replaced the denominator in Eq 12 with the mean reference signal: CR(i,j)=(x(i,j)μref(i))/μref(i), yielding a contrast ratio rather than contrast-to-noise ratio. However, as described in the Results section, these alternative contrast methods did not meaningfully change the relationship between locus coeruleus integrity and the atomoxetine-induced change in prior weighting. Comparisons of locus coeruleus CNR between the Parkinson’s disease and control groups are reported in detail in O’Callaghan et al. [62].

We used an analogous approach to obtain CNR from the substantia nigra, as a neuromelanin-rich control region. This analysis pipeline is described in detail in the Supplementary Materials in O’Callaghan et al. [62] and in Rua et al. [63]. In brief, the MT images from the separate sample of 29 age- and education-matched healthy controls were used to create an independent probabilistic atlas of the substantia nigra, thresholded at 5%. This atlas was then applied to the current study sample to compute a CNR map (Eq 12), where the reference region was defined as the midbrain background (crus cerebri). The mean CNR value for each participant served as the estimate of substantia nigra CNR.

Statistical inference

We report both frequentist and Bayes factor (BF) analyses for hypothesis testing, with a significance threshold of p = .05 (two-sided) for frequentist analyses. We present the BF for the alternative hypothesis over the null hypothesis (i.e., BF10), such that BF > 3 indicates “positive evidence” for the alternative hypothesis. All BF analyses used the default ‘JZS’ prior on the effect size under the alternative hypothesis. To obtain BFs for specific effects in ANOVAs and linear (mixed) models, we used Bayesian model averaging to estimate the change from prior to posterior inclusion odds (“inclusion BF”). This BF indicates how much more likely the data are when a given effect is included in the model, compared to when the effect is excluded [130]. The p-values for fixed effects in linear mixed models were obtained using the Kenward-Roger approximation. Prior to analyses, we z-scored all continuous variables, and assigned sum-to-zero contrasts to categorical variables.

Software and equipment

The visuomotor task was implemented in Matlab R2018b using the Psychophysics Toolbox extensions version 3 [131], and was displayed on a 12.5-inch laptop screen (1920 × 1080 pixels). The force sensor had a sampling rate of 60 Hz and a measurement accuracy of ±9.8 mN. The magnetisation transfer images were processed using the Advanced Normalization Tools version 2.2.0 [132] and in-house Matlab scripts [57,62]. All statistical analyses were implemented in R version 3.6.1 [133]; detailed information about the specific R packages used for the analyses is provided in S6 Text. The hierarchical Bayesian modelling was implemented in Stan [134].

Supporting information

S1 Fig. Relationship between prior weighting and apathy in young adults.

Data from Hezemans et al. [43], demonstrating the relationship between trait apathy (measured using the Apathy Motivation Index) and prior weighting, adjusted for task performance variability (i.e., partial residuals). Note that observations with identical questionnaire scores were horizontally jittered to avoid overlaid dots. Full statistics for the regression coefficient of apathy: β = -0.42, SE = 0.14, t(44) = -3.02, p = .004; BF = 11.63.

(PDF)

S2 Fig. Plate notation and sampling statements for the hierarchical Bayesian model.

Participant-level parameters were sampled from latent group-level distributions. We allowed for atomoxetine-induced changes in the standard deviations of the prior and sensory evidence distributions. Session-level parameters were then used to obtain trial-level posterior distributions of the final ball position. The observed estimates of performance were modelled as samples from the trial-level posterior distributions. The model is represented in plate notation: shaded nodes represent observed data whereas white nodes represent latent variables; rectangular nodes represent discrete or fixed variables whereas circular nodes represent continuous variables; and double-bordered white nodes represent deterministic variables whereas single-bordered white nodes represent stochastic variables.

(PDF)

S3 Fig. Information criteria for variants of the hierarchical Bayesian model.

In addition to the model presented in the manuscript, we fit three variants of the model with restrictions on the number of drug-induced change parameters. For each model variant, we computed the leave-one-out information criterion (LOOIC) and the widely applicable information criterion (WAIC) as estimates of the model’s expected predictive accuracy. For both measures, the ‘full’ model which included drug-induced change parameters for both the prior and sensory evidence standard deviations was strongly preferred over the three more restricted model variants.

(PDF)

S4 Fig. Posterior predictive check: response distributions.

Each panel compares the observed responses (light-coloured density plot and histogram) to distributions of simulated responses drawn from the model’s posterior predictive distribution (dark-coloured density traces).

(PDF)

S5 Fig. Posterior predictive check: predictive error.

Each panel illustrates the distribution of the mean predictive error of the model–that is, the observed responses minus simulated responses drawn from the model’s posterior predictive distribution, averaged across Markov Chain Monte Carlo samples. These histograms can therefore be interpreted as the distributions of residuals.

(PDF)

S1 Text. Mood and behaviour questionnaires.

Table A. Descriptive statistics and group comparisons of questionnaires. Data are presented as mean (SD). Group comparisons were performed with independent samples t-tests. The stated p-values are uncorrected; none survived p < .05 after correction for multiple comparisons. Abbreviations: BF, Bayes Factor for the alternative hypothesis over the null hypothesis, where > 3 would indicate positive evidence in favour of a group difference; BIS, Barratt Impulsiveness Scale; HADS, Hospital Anxiety and Depression Scale; MEI, Motivation and Energy Inventory; CAARS, Conners’ Adult ADHD Rating Scale; RBDSQ, REM sleep Behaviour Disorder Screening Questionnaire; CBI-R, Cambridge Behavioural Inventory–Revised. Fig A. Density plots of questionnaire scores for participants with Parkinson’s disease (blue) and controls (orange). The questionnaire scores were z-scored to bring the different questionnaires onto a common scale (note that this transformation does not affect group comparisons for a given questionnaire outcome). Tick marks reflect individual data points. Abbreviations: BIS, Barratt Impulsiveness Scale; MEI, Motivation and Energy Inventory; HADS, Hospital Anxiety and Depression Scale; CAARS, Conners’ Adult ADHD Rating Scale.

(DOCX)

S2 Text. Role of covariates in the drug × LC CNR interaction on prior weighting.

Table A. Backward elimination of fixed effects in the linear mixed effects model predicting prior weighting. Values for predictors are standardised regression coefficients (ß). *p < .05. Drug, atomoxetine vs. placebo condition; LC CNR, Locus Coeruleus Contrast to Noise Ratio; ICV, total intracranial volume; Ato plasma, atomoxetine plasma concentration; LEDD, Levodopa Equivalent Daily Dose; Session, first vs. second session; UPDRS III, Unified Parkinson’s Disease Rating Scale, motor examination; AIC, Akaike Information Criterion; BIC, Bayesian Information Criterion; Δ AIC / BIC, difference in AIC / BIC with respect to the lowest AIC / BIC value. All models included a fixed effect of the interquartile range of performance error as a covariate of no interest, and a random effect of participants on the intercept. Total intracranial volume was estimated from the T1-weighted MP2RAGE images using the mri_segstats–etiv-only procedure in FreeSurfer v6.0.0. Table B. Bayes Factors for the inclusion of fixed effects in the linear mixed effects model predicting prior weighting. P(incl): prior inclusion probability, i.e. the summed prior probability of models that include the predictor. A priori, all possible restrictions of the full model were deemed to be equally likely (i.e., a uniform prior was assigned to the model space). Thus, P(incl) reflects the proportion of alternative models that included the predictor. P(incl|data): posterior inclusion probability, i.e. the summed posterior probability of models that include the predictor. P(excl|data): posterior exclusion probability, i.e. the summed posterior probability of models that exclude the predictor. BFinclusion: Inclusion Bayes Factor, i.e. the change from prior to posterior inclusion odds. This indicates how much more likely the data are under models that include the predictor, compared to models that exclude the predictor. This analysis was performed using “matched” models, which means that (i) models were not permitted to include an interaction effect without its constituent main effects, and (ii) inclusion probabilities for an interaction effect were based only on the subset of models that contained (at least) the constituent main effects of the interaction. All models included a fixed effect of the interquartile range of performance error as a covariate of no interest, and a random effect of participants on the intercept.

(DOCX)

S3 Text. Decomposing drug effects on prior weighting: Plausible values analysis.

Fig A. Decomposing the noradrenergic effects on prior weighting using a plausible values analysis approach. (A-B) Distributions of plausible correlations between the drug effect on prior weighting and the estimated drug effect on the standard deviation of the prior (A) or sensory evidence (B). (C) Distribution of the difference between the plausible correlations.

(DOCX)

S4 Text. Effects of effort and reward on task performance and prior weighting.

Fig A. Task accuracy (median force error) plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in median force error from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Fig B. Task variability (interquartile range of force error) plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in the interquartile range of force error from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Fig C. Prior weighting plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in prior weighting from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Table A. Estimated marginal means of median force error by group, effort, and reward. Table B. Estimated marginal means of median force error by drug, effort, and reward. Table C. Estimated marginal means of interquartile range of force error by group, effort, and reward. Table D. Estimated marginal means of interquartile range of force error by drug, effort, and reward. Table E. Estimated marginal means of prior weighting by group, effort, and reward. Table F. Estimated marginal means of prior weighting by drug, effort, and reward.

(DOCX)

S5 Text. Parameter recovery of prior weighting.

Fig A. Parameter recovery of prior weighting. (A) Data-generating prior weighting plotted against the estimated (i.e., recovered) prior weighting. The diagonal (identity) line represents perfect parameter recovery. For a given data-generating prior weighting value, the dot represents the median of the prior weighting estimates across 2000 simulations of estimation errors; the vertical error bars represent the 95% quantile intervals of the prior weighting estimates. The inset histogram illustrates the distribution of the difference between the median estimated prior weighting and data-generating prior weighting. (B, C) Examples of data simulations for a relatively low data-generating value of prior weighting (B; orange dot and error bar in A) and a relatively high data-generating value of prior weighting (C; green dot in A).

(DOCX)

S6 Text. Details of statistical software.

(DOCX)

Acknowledgments

We thank the volunteers for their participation, staff at the Wolfson Brain Imaging Centre and National Institute for Health and Care Research (NIHR) Cambridge Clinical Research Facility for their help with data collection, and members of the Cambridge Centre for Frontotemporal Dementia and Related Disorders for valuable suggestions and discussions.

The views expressed are those of the authors and not necessarily those of the National Institute for Health and Care Research or the Department of Health and Social Care.

Data Availability

Code and de-identified behavioural data and summary imaging metrics to reproduce statistical analyses, computational modelling and manuscript figures are freely available through the Open Science Framework: https://osf.io/mry4f/.

Funding Statement

The study was primarily supported by the Cambridge Centre for Parkinson-Plus to JBR, RAB and CWG (RG95450), with additional support from a Parkinson's UK research grant to JBR and CO (K-1702; https://www.parkinsons.org.uk/), a James S. McDonnell Foundation 21st Century Science Initiative Scholar Award in Understanding Human Cognition, to JBR (https://www.jsmf.org/) and an Investigator Award from the Wellcome Trust to JBR (220258; https://wellcome.org/). FHH was supported by a Cambridge Trust Vice-Chancellor's Award and Fitzwilliam College scholarship (https://www.cambridgetrust.org/). NW was supported by an Academic Clinical Fellowship (ACF-2019-14-013) from the National Institute for Health and Care Research (https://www.nihr.ac.uk/). CO was supported by a Neil Hamilton Fairley Fellowship from the Australian National Health and Medical Research Council (GNT1091310; https://www.nhmrc.gov.au/). AGM was supported by the Holt Fellowship (RG86564). NH was supported by the Association of British Neurologists, Patrick Berthoud Charitable Trust (RG99368; https://www.theabn.org/). KAT was supported by the British Academy (PF160048; https://www.thebritishacademy.ac.uk/) and the Guarantors of Brain (101149; https://guarantorsofbrain.org/). CHW-G was supported by an RCUK/UKRI Research Innovation Fellowship awarded by the UK Medical Research Council (MR/R007446/1; https://mrc.ukri.org/). JBR was supported by intramural funding (SUAG/051 G101400) and a research grant (MR/P01271X/1) from the UK Medical Research Council (https://mrc.ukri.org/). This research was supported by the NIHR Cambridge Biomedical Research Centre (BRC-1215-20014; https://cambridgebrc.nihr.ac.uk/). For the purpose of open access, the authors have applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.den Brok MGHE, van Dalen JW, van Gool WA, van Charante EPM, de Bie RMA, Richard E. Apathy in Parkinson’s disease: A systematic review and meta-analysis. Mov Disord. 2015;30: 759–769. doi: 10.1002/mds.26208 [DOI] [PubMed] [Google Scholar]
  • 2.Lanctôt KL, Agüera-Ortiz L, Brodaty H, Francis PT, Geda YE, Ismail Z, et al. Apathy associated with neurocognitive disorders: Recent progress and future directions. Alzheimers Dement. 2017;13: 84–100. doi: 10.1016/j.jalz.2016.05.008 [DOI] [PubMed] [Google Scholar]
  • 3.Lansdall CJ, Coyle-Gilchrist ITS, Vázquez Rodríguez P, Wilcox A, Wehmann E, Robbins TW, et al. Prognostic importance of apathy in syndromes associated with frontotemporal lobar degeneration. Neurology. 2019;92: e1547–e1557. doi: 10.1212/WNL.0000000000007249 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Ang Y-S, Lockwood P, Apps MAJ, Muhammed K, Husain M. Distinct Subtypes of Apathy Revealed by the Apathy Motivation Index. Gulinello M, editor. PLOS ONE. 2017;12: e0169938. doi: 10.1371/journal.pone.0169938 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Petitet P, Scholl J, Attaallah B, Drew D, Manohar S, Husain M. The relationship between apathy and impulsivity in large population samples. Sci Rep. 2021;11: 4830. doi: 10.1038/s41598-021-84364-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Levy R, Dubois B. Apathy and the Functional Anatomy of the Prefrontal Cortex–Basal Ganglia Circuits. Cereb Cortex. 2005;16: 916–928. doi: 10.1093/cercor/bhj043 [DOI] [PubMed] [Google Scholar]
  • 7.Marin RS. Apathy: a neuropsychiatric syndrome. J Neuropsychiatry Clin Neurosci. 1991;3: 243–254. doi: 10.1176/jnp.3.3.243 [DOI] [PubMed] [Google Scholar]
  • 8.Passamonti L, Lansdall CJ, Rowe JB. The neuroanatomical and neurochemical basis of apathy and impulsivity in frontotemporal lobar degeneration. Curr Opin Behav Sci. 2018;22: 14–20. doi: 10.1016/j.cobeha.2017.12.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chong TT-J, Husain M. Chapter 17—The role of dopamine in the pathophysiology and treatment of apathy. In: Studer B, Knecht S, editors. Progress in Brain Research. Elsevier; 2016. pp. 389–426. doi: 10.1016/bs.pbr.2016.05.007 [DOI] [PubMed] [Google Scholar]
  • 10.Poewe W, Seppi K, Tanner CM, Halliday GM, Brundin P, Volkmann J, et al. Parkinson disease. Nat Rev Dis Primer. 2017;3: 1–21. doi: 10.1038/nrdp.2017.13 [DOI] [PubMed] [Google Scholar]
  • 11.Niv Y, Daw ND, Joel D, Dayan P. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl). 2007;191: 507–520. doi: 10.1007/s00213-006-0502-4 [DOI] [PubMed] [Google Scholar]
  • 12.Schultz W, Dayan P, Montague PR. A Neural Substrate of Prediction and Reward. Science. 1997;275: 1593–1599. doi: 10.1126/science.275.5306.1593 [DOI] [PubMed] [Google Scholar]
  • 13.Chong TT-J, Bonnelle V, Manohar S, Veromann K-R, Muhammed K, Tofaris GK, et al. Dopamine enhances willingness to exert effort for reward in Parkinson’s disease. Cortex. 2015;69: 40–46. doi: 10.1016/j.cortex.2015.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Le Bouc R, Rigoux L, Schmidt L, Degos B, Welter M-L, Vidailhet M, et al. Computational Dissection of Dopamine Motor and Motivational Functions in Humans. J Neurosci. 2016;36: 6623–6633. doi: 10.1523/JNEUROSCI.3078-15.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Muhammed K, Manohar S, Yehuda MB, Chong TT-J, Tofaris G, Lennox G, et al. Reward sensitivity deficits modulated by dopamine are associated with apathy in Parkinson’s disease. Brain. 2016;139: 2706–2721. doi: 10.1093/brain/aww188 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Lansdall CJ, Coyle-Gilchrist ITS, Jones PS, Rodríguez PV, Wilcox A, Wehmann E, et al. Apathy and impulsivity in frontotemporal lobar degeneration syndromes. Brain. 2017;140: 1792–1807. doi: 10.1093/brain/awx101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Murley AG, Coyle-Gilchrist I, Rouse MA, Jones PS, Li W, Wiggins J, et al. Redefining the multidimensional clinical phenotypes of frontotemporal lobar degeneration syndromes. Brain. 2020;143: 1555–1571. doi: 10.1093/brain/awaa097 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Scott BM, Eisinger RS, Burns MR, Lopes J, Okun MS, Gunduz A, et al. Co-occurrence of apathy and impulse control disorders in Parkinson disease. Neurology. 2020;95: e2769–e2780. doi: 10.1212/WNL.0000000000010965 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Sinha N, Manohar S, Husain M. Impulsivity and apathy in Parkinson’s disease. J Neuropsychol. 2013;7: 255–283. doi: 10.1111/jnp.12013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Zoon TJC, Rooijen G, Balm GMFC, Bergfeld IO, Daams JG, Krack P, et al. Apathy Induced by Subthalamic Nucleus Deep Brain Stimulation in Parkinson’s Disease: A Meta-Analysis. Mov Disord. 2021;36: 317–326. doi: 10.1002/mds.28390 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Bouret S, Richmond BJ. Sensitivity of Locus Ceruleus Neurons to Reward Value for Goal-Directed Actions. J Neurosci. 2015;35: 4005–4014. doi: 10.1523/JNEUROSCI.4553-14.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Jahn CI, Varazzani C, Sallet J, Walton ME, Bouret S. Noradrenergic But Not Dopaminergic Neurons Signal Task State Changes and Predict Reengagement After a Failure. Cereb Cortex. 2020. [cited 17 May 2020]. doi: 10.1093/cercor/bhaa089 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Varazzani C, San-Galli A, Gilardeau S, Bouret S. Noradrenaline and Dopamine Neurons in the Reward/Effort Trade-Off: A Direct Electrophysiological Comparison in Behaving Monkeys. J Neurosci. 2015;35: 7866–7877. doi: 10.1523/JNEUROSCI.0454-15.2015 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Moore RY, Bloom FE. Central Catecholamine Neuron Systems: Anatomy and Physiology of the Norepinephrine and Epinephrine Systems. Annu Rev Neurosci. 1979;2: 113–168. doi: 10.1146/annurev.ne.02.030179.000553 [DOI] [PubMed] [Google Scholar]
  • 25.Szabadi E. Functional neuroanatomy of the central noradrenergic system. J Psychopharmacol (Oxf). 2013;27: 659–693. doi: 10.1177/0269881113490326 [DOI] [PubMed] [Google Scholar]
  • 26.Hawkes CH, Del Tredici K, Braak H. A timeline for Parkinson’s disease. Parkinsonism Relat Disord. 2010;16: 79–84. doi: 10.1016/j.parkreldis.2009.08.007 [DOI] [PubMed] [Google Scholar]
  • 27.Surmeier DJ, Obeso JA, Halliday GM. Selective neuronal vulnerability in Parkinson disease. Nat Rev Neurosci. 2017;18: 101–113. doi: 10.1038/nrn.2016.178 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zarow C, Lyness SA, Mortimer JA, Chui HC. Neuronal Loss Is Greater in the Locus Coeruleus Than Nucleus Basalis and Substantia Nigra in Alzheimer and Parkinson Diseases. Arch Neurol. 2003;60: 337–341. doi: 10.1001/archneur.60.3.337 [DOI] [PubMed] [Google Scholar]
  • 29.Kehagia AA, Housden CR, Regenthal R, Barker RA, Müller U, Rowe J, et al. Targeting impulsivity in Parkinson’s disease using atomoxetine. Brain. 2014;137: 1986–1997. doi: 10.1093/brain/awu117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lewis SJG, Slabosz A, Robbins TW, Barker RA, Owen AM. Dopaminergic basis for deficits in working memory but not attentional set-shifting in Parkinson’s disease. Neuropsychologia. 2005;43: 823–832. doi: 10.1016/j.neuropsychologia.2004.10.001 [DOI] [PubMed] [Google Scholar]
  • 31.Loued-Khenissi L, Preuschoff K. Apathy and noradrenaline: silent partners to mild cognitive impairment in Parkinsonʼs disease? Curr Opin Neurol. 2015;28: 344–350. doi: 10.1097/WCO.0000000000000218 [DOI] [PubMed] [Google Scholar]
  • 32.Tredici KD, Braak H. Dysfunction of the locus coeruleus–norepinephrine system and related circuitry in Parkinson’s disease-related dementia. J Neurol Neurosurg Psychiatry. 2013;84: 774–783. doi: 10.1136/jnnp-2011-301817 [DOI] [PubMed] [Google Scholar]
  • 33.Bouret S, Sara SJ. Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Trends Neurosci. 2005;28: 574–582. doi: 10.1016/j.tins.2005.09.002 [DOI] [PubMed] [Google Scholar]
  • 34.Dayan P, Yu AJ. Phasic norepinephrine: A neural interrupt signal for unexpected events. Netw Comput Neural Syst. 2006;17: 335–350. doi: 10.1080/09548980601004024 [DOI] [PubMed] [Google Scholar]
  • 35.Aston-Jones G, Cohen JD. An integrative theory of locus coeruleus-norepinephrine function: Adaptive Gain and Optimal Performance. Annu Rev Neurosci. 2005;28: 403–450. doi: 10.1146/annurev.neuro.28.061604.135709 [DOI] [PubMed] [Google Scholar]
  • 36.Yu AJ, Dayan P. Uncertainty, Neuromodulation, and Attention. Neuron. 2005;46: 681–692. doi: 10.1016/j.neuron.2005.04.026 [DOI] [PubMed] [Google Scholar]
  • 37.Joshi S, Li Y, Kalwani RM, Gold JI. Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex. Neuron. 2016;89: 221–234. doi: 10.1016/j.neuron.2015.11.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Jepma M, Murphy PR, Nassar MR, Rangel-Gomez M, Meeter M, Nieuwenhuis S. Catecholaminergic Regulation of Learning Rate in a Dynamic Environment. PLOS Comput Biol. 2016;12: e1005171. doi: 10.1371/journal.pcbi.1005171 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Krishnamurthy K, Nassar MR, Sarode S, Gold JI. Arousal-related adjustments of perceptual biases optimize perception in dynamic environments. Nat Hum Behav. 2017;1: 1–11. doi: 10.1038/s41562-017-0107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Lawson RP, Bisby J, Nord CL, Burgess N, Rees G. The Computational, Pharmacological, and Physiological Determinants of Sensory Learning under Uncertainty. Curr Biol. 2021;31: 163–172.e4. doi: 10.1016/j.cub.2020.10.043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Muller TH, Mars RB, Behrens TE, O’Reilly JX. Control of entropy in neural models of environmental state. Donner TH, Frank MJ, Gershman SJ, Meyniel F, editors. eLife. 2019;8: e39404. doi: 10.7554/eLife.39404 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Nassar MR, Rumsey KM, Wilson RC, Parikh K, Heasly B, Gold JI. Rational regulation of learning dynamics by pupil-linked arousal systems. Nat Neurosci. 2012;15: 1040–1046. doi: 10.1038/nn.3130 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hezemans FH, Wolpe N, Rowe JB. Apathy is associated with reduced precision of prior beliefs about action outcomes. J Exp Psychol Gen. 2020. [cited 17 May 2020]. doi: 10.1037/xge0000739 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Friston KJ. The free-energy principle: a unified brain theory? Nat Rev Neurosci. 2010;11: 127–138. doi: 10.1038/nrn2787 [DOI] [PubMed] [Google Scholar]
  • 45.Friston KJ, FitzGerald T, Rigoli F, Schwartenbeck P, Pezzulo G. Active Inference: A Process Theory. Neural Comput. 2016;29: 1–49. doi: 10.1162/NECO_a_00912 [DOI] [PubMed] [Google Scholar]
  • 46.Adams RA, Shipp S, Friston KJ. Predictions not commands: active inference in the motor system. Brain Struct Funct. 2013;218: 611–643. doi: 10.1007/s00429-012-0475-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Friston KJ, Daunizeau J, Kilner J, Kiebel SJ. Action and behavior: a free-energy formulation. Biol Cybern. 2010;102: 227–260. doi: 10.1007/s00422-010-0364-z [DOI] [PubMed] [Google Scholar]
  • 48.Wiese W. Action Is Enabled by Systematic Misrepresentations. Erkenntnis. 2017;82: 1233–1252. doi: 10.1007/s10670-016-9867-x [DOI] [Google Scholar]
  • 49.Friston KJ, Schwartenbeck P, FitzGerald T, Moutoussis M, Behrens T, Dolan RJ. The anatomy of choice: dopamine and decision-making. Philos Trans R Soc B Biol Sci. 2014;369: 20130481–20130481. doi: 10.1098/rstb.2013.0481 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Friston KJ, Shiner T, FitzGerald T, Galea JM, Adams RA, Brown HR, et al. Dopamine, Affordance and Active Inference. PLOS Comput Biol. 2012;8: e1002327. doi: 10.1371/journal.pcbi.1002327 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Parr T, Friston KJ. Uncertainty, epistemics and active inference. J R Soc Interface. 2017;14: 20170376. doi: 10.1098/rsif.2017.0376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Sales AC, Friston KJ, Jones MW, Pickering AE, Moran RJ. Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: An Active Inference model. Gershman SJ editor. PLOS Comput Biol. 2019;15: e1006267. doi: 10.1371/journal.pcbi.1006267 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Schwartenbeck P, FitzGerald THB, Mathys C, Dolan R, Friston K. The Dopaminergic Midbrain Encodes the Expected Certainty about Desired Outcomes. Cereb Cortex. 2015;25: 3434–3445. doi: 10.1093/cercor/bhu159 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Cools R. Chemistry of the Adaptive Mind: Lessons from Dopamine. Neuron. 2019;104: 113–131. doi: 10.1016/j.neuron.2019.09.035 [DOI] [PubMed] [Google Scholar]
  • 55.Holland N, Robbins TW, Rowe JB. The role of noradrenaline in cognition and cognitive disorders. Brain. 2021. [cited 11 Mar 2021]. doi: 10.1093/brain/awab111 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Robbins TW, Arnsten AFT. The Neuropsychopharmacology of Fronto-Executive Function: Monoaminergic Modulation. Annu Rev Neurosci. 2009;32: 267–287. doi: 10.1146/annurev.neuro.051508.135535 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Ye R, Rua C, O’Callaghan C, Jones PS, Hezemans FH, Kaalund SS, et al. An in vivo probabilistic atlas of the human locus coeruleus at ultra-high field. NeuroImage. 2021;225: 117487. doi: 10.1016/j.neuroimage.2020.117487 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Tomlinson CL, Stowe R, Patel S, Rick C, Gray R, Clarke CE. Systematic review of levodopa dose equivalency reporting in Parkinson’s disease. Mov Disord. 2010;25: 2649–2653. doi: 10.1002/mds.23429 [DOI] [PubMed] [Google Scholar]
  • 59.Starkstein SE, Mayberg HS, Preziosi TJ, Andrezejewski P, Leiguarda R, Robinson RG. Reliability, validity, and clinical correlates of apathy in Parkinson’s disease. J Neuropsychiatry Clin Neurosci. 1992;4: 134–139. doi: 10.1176/jnp.4.2.134 [DOI] [PubMed] [Google Scholar]
  • 60.Wolpe N, Wolpert DM, Rowe JB. Seeing what you want to see: priors for one’s own actions represent exaggerated expectations of success. Front Behav Neurosci. 2014;8. doi: 10.3389/fnbeh.2014.00008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Kelly C, Price TD. Correcting for Regression to the Mean in Behavior and Ecology. Am Nat. 2005;166: 700–707. doi: 10.1086/497402 [DOI] [PubMed] [Google Scholar]
  • 62.O’Callaghan C, Hezemans FH, Ye R, Rua C, Jones PS, Murley AG, et al. Locus coeruleus integrity and the effect of atomoxetine on response inhibition in Parkinson’s disease. Brain. 2021. doi: 10.1093/brain/awab142 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Rua C, O’Callaghan C, Ye R, Hezemans FH, Passamonti L, Jones PS, et al. Substantia nigra ferric overload and neuromelanin loss in Parkinson’s disease measured with 7T MRI. Neurology; 2021. Apr. doi: 10.1101/2021.04.13.21255416 [DOI] [Google Scholar]
  • 64.Bauer DJ, Curran PJ. Probing Interactions in Fixed and Multilevel Regression: Inferential and Graphical Techniques. Multivar Behav Res. 2005;40: 373–400. doi: 10.1207/s15327906mbr4003_5 [DOI] [PubMed] [Google Scholar]
  • 65.Macerollo A, Chen J-C, Korlipara P, Foltynie T, Rothwell J, Edwards MJ, et al. Dopaminergic treatment modulates sensory attenuation at the onset of the movement in Parkinson’s disease: A test of a new framework for bradykinesia. Mov Disord. 2016;31: 143–146. doi: 10.1002/mds.26493 [DOI] [PubMed] [Google Scholar]
  • 66.Wolpe N, Nombela C, Ingram JN, Wolpert DM, Cam-CAN, Rowe JB. Sensory attenuation in Parkinson’s disease is related to disease severity and dopamine dose. Sci Rep. 2018;8. doi: 10.1038/s41598-017-18329-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Azulay J-P, Mesure S, Amblard B, Blin O, Sangla I, Pouget J. Visual control of locomotion in Parkinson’s disease. Brain. 1999;122: 111–120. doi: 10.1093/brain/122.1.111 [DOI] [PubMed] [Google Scholar]
  • 68.Klockgether T, Dichgans J. Visual control of arm movement in Parkinson’s disease. Mov Disord. 1994;9: 48–56. doi: 10.1002/mds.870090108 [DOI] [PubMed] [Google Scholar]
  • 69.Thaut MH, McIntosh GC, Rice RR, Miller RA, Rathbun J, Brault JM. Rhythmic auditory stimulation in gait training for Parkinson’s disease patients. Mov Disord. 1996;11: 193–200. doi: 10.1002/mds.870110213 [DOI] [PubMed] [Google Scholar]
  • 70.Conte A, Khan N, Defazio G, Rothwell JC, Berardelli A. Pathophysiology of somatosensory abnormalities in Parkinson disease. Nat Rev Neurol. 2013;9: 687–697. doi: 10.1038/nrneurol.2013.224 [DOI] [PubMed] [Google Scholar]
  • 71.Moran RJ, Symmonds M, Dolan RJ, Friston KJ. The Brain Ages Optimally to Model Its Environment: Evidence from Sensory Learning over the Adult Lifespan. Sporns O, editor. PLoS Comput Biol. 2014;10: e1003422. doi: 10.1371/journal.pcbi.1003422 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Wolpe N, Ingram JN, Tsvetanov KA, Geerligs L, Kievit RA, Henson RN, et al. Ageing increases reliance on sensorimotor prediction through structural and functional differences in frontostriatal circuits. Nat Commun. 2016;7. doi: 10.1038/ncomms13034 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Ye Z, Rae CL, Nombela C, Ham T, Rittman T, Jones PS, et al. Predicting beneficial effects of atomoxetine and citalopram on response inhibition in Parkinson’s disease with clinical and neuroimaging measures: Predicting Treatment Response in PD. Hum Brain Mapp. 2016;37: 1026–1037. doi: 10.1002/hbm.23087 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Cools R D ’Esposito M. Inverted-U–Shaped Dopamine Actions on Human Working Memory and Cognitive Control. Biol Psychiatry. 2011;69: e113–e125. doi: 10.1016/j.biopsych.2011.03.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Robbins TW. Chemical neuromodulation of frontal-executive functions in humans and other animals. Exp Brain Res. 2000;133: 130–138. doi: 10.1007/s002210000407 [DOI] [PubMed] [Google Scholar]
  • 76.Meder D, Herz DM, Rowe JB, Lehéricy S, Siebner HR. The role of dopamine in the brain—lessons learned from Parkinson’s disease. NeuroImage. 2019;190: 79–93. doi: 10.1016/j.neuroimage.2018.11.021 [DOI] [PubMed] [Google Scholar]
  • 77.Gilzenrat MS, Nieuwenhuis S, Jepma M, Cohen JD. Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function. Cogn Affect Behav Neurosci. 2010;10: 252–269. doi: 10.3758/CABN.10.2.252 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Jepma M, Nieuwenhuis S. Pupil Diameter Predicts Changes in the Exploration–Exploitation Trade-off: Evidence for the Adaptive Gain Theory. J Cogn Neurosci. 2011;23: 1587–1596. doi: 10.1162/jocn.2010.21548 [DOI] [PubMed] [Google Scholar]
  • 79.Bari A, Aston-Jones G. Atomoxetine modulates spontaneous and sensory-evoked discharge of locus coeruleus noradrenergic neurons. Neuropharmacology. 2013;64: 53–64. doi: 10.1016/j.neuropharm.2012.07.020 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Eldar E, Cohen JD, Niv Y. The effects of neural gain on attention and learning. Nat Neurosci. 2013;16: 1146–1153. doi: 10.1038/nn.3428 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Hauser TU, Allen M, Purg N, Moutoussis M, Rees G, Dolan RJ. Noradrenaline blockade specifically enhances metacognitive performance. eLife. 2017;6: e24901. doi: 10.7554/eLife.24901 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Behrens TEJ, Woolrich MW, Walton ME, Rushworth MFS. Learning the value of information in an uncertain world. Nat Neurosci. 2007;10: 1214–1221. doi: 10.1038/nn1954 [DOI] [PubMed] [Google Scholar]
  • 83.McGuire JT, Nassar MR, Gold JI, Kable JW. Functionally Dissociable Influences on Learning Rate in a Dynamic Environment. Neuron. 2014;84: 870–881. doi: 10.1016/j.neuron.2014.10.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.O’Reilly JX, Schuffelgen U, Cuell SF, Behrens TEJ, Mars RB, Rushworth MFS. Dissociable effects of surprise and model update in parietal and anterior cingulate cortex. Proc Natl Acad Sci. 2013;110: E3660–E3669. doi: 10.1073/pnas.1305373110 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Arnsten AFT, Goldman-Rakic PS. Selective prefrontal cortical projections to the region of the locus coeruleus and raphe nuclei in the rhesus monkey. Brain Res. 1984;306: 9–18. doi: 10.1016/0006-8993(84)90351-2 [DOI] [PubMed] [Google Scholar]
  • 86.Tervo DGR, Proskurin M, Manakov M, Kabra M, Vollmer A, Branson K, et al. Behavioral Variability through Stochastic Choice and Its Gating by Anterior Cingulate Cortex. Cell. 2014;159: 21–32. doi: 10.1016/j.cell.2014.08.037 [DOI] [PubMed] [Google Scholar]
  • 87.Pifl C, Kish SJ, Hornykiewicz O. Thalamic noradrenaline in Parkinson’s disease: Deficits suggest role in motor and non-motor symptoms. Mov Disord. 2012;27: 1618–1624. doi: 10.1002/mds.25109 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Scatton B, Javoy-Agid F, Rouquier L, Dubois B, Agid Y. Reduction of cortical dopamine, noradrenaline, serotonin and their metabolites in Parkinson’s disease. Brain Res. 1983;275: 321–328. doi: 10.1016/0006-8993(83)90993-9 [DOI] [PubMed] [Google Scholar]
  • 89.Bymaster FP, Katner JS, Nelson DL, Hemrick-Luecke SK, Threlkeld PG, Heiligenstein JH, et al. Atomoxetine increases extracellular levels of norepinephrine and dopamine in prefrontal cortex of rat: a potential mechanism for efficacy in attention deficit/hyperactivity disorder. Neuropsychopharmacology. 2002;27: 699–711. doi: 10.1016/S0893-133X(02)00346-9 [DOI] [PubMed] [Google Scholar]
  • 90.Swanson CJ, Perry KW, Koch-Krueger S, Katner J, Svensson KA, Bymaster FP. Effect of the attention deficit/hyperactivity disorder drug atomoxetine on extracellular concentrations of norepinephrine and dopamine in several brain regions of the rat. Neuropharmacology. 2006;50: 755–760. doi: 10.1016/j.neuropharm.2005.11.022 [DOI] [PubMed] [Google Scholar]
  • 91.Huys QJM, Maia TV, Frank MJ. Computational psychiatry as a bridge from neuroscience to clinical applications. Nat Neurosci. 2016;19: 404–413. doi: 10.1038/nn.4238 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Yarkoni T, Westfall J. Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning. Perspect Psychol Sci. 2017;12: 1100–1122. doi: 10.1177/1745691617693393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Cuthbert BN, Insel TR. Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Med. 2013;11. doi: 10.1186/1741-7015-11-11 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 94.Sesack SR, Hawrylak VA, Matus C, Guido MA, Levey AI. Dopamine Axon Varicosities in the Prelimbic Division of the Rat Prefrontal Cortex Exhibit Sparse Immunoreactivity for the Dopamine Transporter. J Neurosci. 1998;18: 2697–2708. doi: 10.1523/JNEUROSCI.18-07-02697.1998 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Wayment HK, Schenk JO, Sorg BA. Characterization of Extracellular Dopamine Clearance in the Medial Prefrontal Cortex: Role of Monoamine Uptake and Monoamine Oxidase Inhibition. J Neurosci. 2001;21: 35–44. doi: 10.1523/JNEUROSCI.21-01-00035.2001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Seamans JK, Yang CR. The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog Neurobiol. 2004;74: 1–58. doi: 10.1016/j.pneurobio.2004.05.006 [DOI] [PubMed] [Google Scholar]
  • 97.Devoto P, Flore G. On the Origin of Cortical Dopamine: Is it a Co-Transmitter in Noradrenergic Neurons? Curr Neuropharmacol. 2006;4: 115–125. doi: 10.2174/157015906776359559 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Devoto P, Flore G, Pani L, Gessa GL. Evidence for co-release of noradrenaline and dopamine from noradrenergic neurons in the cerebral cortex. Mol Psychiatry. 2001;6: 657–664. doi: 10.1038/sj.mp.4000904 [DOI] [PubMed] [Google Scholar]
  • 99.Devoto P, Flore G, Saba P, Fa M, Gessa GL. Stimulation of the locus coeruleus elicits noradrenaline and dopamine release in the medial prefrontal and parietal cortex. J Neurochem. 2005;92: 368–374. doi: 10.1111/j.1471-4159.2004.02866.x [DOI] [PubMed] [Google Scholar]
  • 100.Mejias-Aponte CA. Specificity and impact of adrenergic projections to the midbrain dopamine system. Brain Res. 2016;1641: 258–273. doi: 10.1016/j.brainres.2016.01.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 101.Duszkiewicz AJ, McNamara CG, Takeuchi T, Genzel L. Novelty and Dopaminergic Modulation of Memory Persistence: A Tale of Two Systems. Trends Neurosci. 2019;42: 102–114. doi: 10.1016/j.tins.2018.10.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 102.Ye Z, Altena E, Nombela C, Housden CR, Maxwell H, Rittman T, et al. Improving Response Inhibition in Parkinson’s Disease with Atomoxetine. Biol Psychiatry. 2015;77: 740–748. doi: 10.1016/j.biopsych.2014.01.024 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 103.Berridge CW, Waterhouse BD. The locus coeruleus–noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Rev. 2003;42: 33–84. doi: 10.1016/s0165-0173(03)00143-7 [DOI] [PubMed] [Google Scholar]
  • 104.Toschi C, Hervig ME-S, Moazen P, Parker MG, Dalley JW, Gether U, et al. Adaptive aspects of impulsivity and interactions with effects of catecholaminergic agents in the 5-choice serial reaction time task: implications for ADHD. Psychopharmacology (Berl). 2021. [cited 23 Jun 2021]. doi: 10.1007/s00213-021-05883-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 105.Aitchison L, Lengyel M. With or without you: predictive coding and Bayesian inference in the brain. Curr Opin Neurobiol. 2017;46: 219–227. doi: 10.1016/j.conb.2017.08.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 106.Kocagoncu E, Klimovich-Gray A, Hughes LE, Rowe JB. Evidence and implications of abnormal predictive coding in dementia. Brain. 2021;144: 3311–3321. doi: 10.1093/brain/awab254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Pezzulo G, Rigoli F, Friston KJ. Hierarchical Active Inference: A Theory of Motivated Control. Trends Cogn Sci. 2018;22: 294–306. doi: 10.1016/j.tics.2018.01.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Badre D, D’Esposito M. Is the rostro-caudal axis of the frontal lobe hierarchical? Nat Rev Neurosci. 2009;10: 659–669. doi: 10.1038/nrn2667 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Hasson U, Yang E, Vallines I, Heeger DJ, Rubin N. A Hierarchy of Temporal Receptive Windows in Human Cortex. J Neurosci. 2008;28: 2539–2550. doi: 10.1523/JNEUROSCI.5487-07.2008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 110.Kiebel SJ, Daunizeau J, Friston KJ. A Hierarchy of Time-Scales and the Brain. Sporns O, editor. PLoS Comput Biol. 2008;4: e1000209. doi: 10.1371/journal.pcbi.1000209 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 111.Koechlin E. The Architecture of Cognitive Control in the Human Prefrontal Cortex. Science. 2003;302: 1181–1185. doi: 10.1126/science.1088545 [DOI] [PubMed] [Google Scholar]
  • 112.Chong TT-J, Bonnelle V, Husain M. Chapter 4—Quantifying motivation with effort-based decision-making paradigms in health and disease. In: Studer B, Knecht S, editors. Progress in Brain Research. Elsevier; 2016. pp. 71–100. doi: 10.1016/bs.pbr.2016.05.002 [DOI] [PubMed] [Google Scholar]
  • 113.Husain M, Roiser JP. Neuroscience of apathy and anhedonia: a transdiagnostic approach. Nat Rev Neurosci. 2018;19: 470–484. doi: 10.1038/s41583-018-0029-9 [DOI] [PubMed] [Google Scholar]
  • 114.Salamone JD, Correa M. The Mysterious Motivational Functions of Mesolimbic Dopamine. Neuron. 2012;76: 470–485. doi: 10.1016/j.neuron.2012.10.021 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Müller T, Klein-Flügge MC, Manohar SG, Husain M, Apps MAJ. Neural and computational mechanisms of momentary fatigue and persistence in effort-based choice. Nat Commun. 2021;12: 4593. doi: 10.1038/s41467-021-24927-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 116.Emre M, Aarsland D, Brown RG, Burn DJ, Duyckaerts C, Mizuno Y, et al. Clinical diagnostic criteria for dementia associated with Parkinson’s disease. Mov Disord. 2007;22: 1689–1707. doi: 10.1002/mds.21507 [DOI] [PubMed] [Google Scholar]
  • 117.Martinez-Martin P, Falup-Pecurariu C, Rodriguez-Blazquez C, Serrano-Dueñas M, Carod Artal FJ, Rojo Abuin JM, et al. Dementia associated with Parkinson’s disease: Applying the Movement Disorder Society Task Force criteria. Parkinsonism Relat Disord. 2011;17: 621–624. doi: 10.1016/j.parkreldis.2011.05.017 [DOI] [PubMed] [Google Scholar]
  • 118.Weintraub D, Hoops S, Shea JA, Lyons KE, Pahwa R, Driver-Dunckley ED, et al. Validation of the questionnaire for impulsive-compulsive disorders in Parkinson’s disease. Mov Disord. 2009;24: 1461–1467. doi: 10.1002/mds.22571 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 119.Hinson VK, Delambo A, Elm J, Turner T. A Randomized Clinical Trial of Atomoxetine for Mild Cognitive Impairment in Parkinson’s Disease. Mov Disord Clin Pract. 2017;4: 416–423. doi: 10.1002/mdc3.12455 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Weintraub D, Mavandadi S, Mamikonyan E, Siderowf AD, Duda JE, Hurtig HI, et al. Atomoxetine for depression and other neuropsychiatric symptoms in Parkinson disease. Neurology. 2010;75: 448–455. doi: 10.1212/WNL.0b013e3181ebdd79 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 121.Sauer J-M, Ring BJ, Witcher JW. Clinical pharmacokinetics of atomoxetine. Clin Pharmacokinet. 2005;44: 571–590. doi: 10.2165/00003088-200544060-00002 [DOI] [PubMed] [Google Scholar]
  • 122.Teichert J, Rowe JB, Ersche KD, Skandali N, Sacher J, Aigner A, et al. Determination of atomoxetine or escitalopram in human plasma by HPLC: Applications in neuroscience research studies. Int J Clin Pharmacol Ther. 2020;58: 426–438. doi: 10.5414/CP203705 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 123.Körding KP, Wolpert DM. Bayesian integration in sensorimotor learning. Nature. 2004;427: 244–247. doi: 10.1038/nature02169 [DOI] [PubMed] [Google Scholar]
  • 124.Pouget A, Beck JM, Ma WJ, Latham PE. Probabilistic brains: knowns and unknowns. Nat Neurosci. 2013;16: 1170–1178. doi: 10.1038/nn.3495 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 125.Xiang Y, Graeber T, Enke B, Gershman SJ. Confidence and central tendency in perceptual judgment. Atten Percept Psychophys. 2021. [cited 28 Apr 2021]. doi: 10.3758/s13414-021-02300-6 [DOI] [PubMed] [Google Scholar]
  • 126.Wolpe N, Nombela C, Rowe JB. Dopaminergic modulation of positive expectations for goal-directed action: evidence from Parkinson’s disease. Front Psychol. 2015;6. doi: 10.3389/fpsyg.2015.00006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 127.Vehtari A, Gelman A, Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput. 2017;27: 1413–1432. doi: 10.1007/s11222-016-9696-4 [DOI] [Google Scholar]
  • 128.Priovoulos N, Jacobs HIL, Ivanov D, Uludag K, Verhey FRJ, Poser BA. High-resolution in vivo imaging of human locus coeruleus by magnetization transfer MRI at 3T and 7T. NeuroImage. 2018;168: 427–436. doi: 10.1016/j.neuroimage.2017.07.045 [DOI] [PubMed] [Google Scholar]
  • 129.Fonov V, Evans AC, Botteron K, Almli CR, McKinstry RC, Collins DL. Unbiased average age-appropriate atlases for pediatric studies. NeuroImage. 2011;54: 313–327. doi: 10.1016/j.neuroimage.2010.07.033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 130.Hinne M, Gronau QF, van den Bergh D, Wagenmakers E-J. A Conceptual Introduction to Bayesian Model Averaging. Adv Methods Pract Psychol Sci. 2020; 2515245919898657. doi: 10.1177/2515245919898657 [DOI] [Google Scholar]
  • 131.Kleiner M, Brainard D, Pelli D. What’s new in Psychtoolbox-3? Arezzo, Italy: 30th European Conference on Visual Perception; 2007. [Google Scholar]
  • 132.Tustison NJ, Cook PA, Klein A, Song G, Das SR, Duda JT, et al. Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements. NeuroImage. 2014;99: 166–179. doi: 10.1016/j.neuroimage.2014.05.044 [DOI] [PubMed] [Google Scholar]
  • 133.R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2019. Available: https://www.R-project.org/ [Google Scholar]
  • 134.Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, et al. Stan: A Probabilistic Programming Language. J Stat Softw. 2017;76. doi: 10.18637/jss.v076.i01 [DOI] [PMC free article] [PubMed] [Google Scholar]
PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010079.r001

Decision Letter 0

Samuel J Gershman, Woo-Young Ahn

9 Dec 2021

Dear Dr. Hezemans,

Thank you very much for submitting your manuscript "Noradrenergic deficits contribute to apathy in Parkinson's disease through the precision of expected outcomes" for consideration at PLOS Computational Biology. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by three independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations.

Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Woo-Young Ahn

Associate Editor

PLOS Computational Biology

Samuel Gershman

Deputy Editor

PLOS Computational Biology

***********************

A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately:

[LINK]

Reviewer's Responses to Questions

Comments to the Authors:

Reviewer #1: This is an interesting study in which the authors use a clever task that allows them to distinguish subjects' precision of their prior expectations (about a target's movement) from the precision of the sensory likelihood (from the applied force to the target). They collect data from n=17 Parkinson's patients and controls; the former are also given Atomoxetine and placebo in a within-subject manipulation, and 7T imaging of their Locus Coereleus. The authors found a negative correlation between prior/likelihood weighting and apathy, and an interaction such that subjects with lower LC integrity showed a positive effect of ATO on this weighting (higher LC integrity resulted in a negative effect). They are careful to control for other factors, which do not affect the results.

Overall the topic is interesting and clinically important, and the methods are rigorous. There are some weaknesses: the main ones being that the sample size is fairly small (n=17), controls did not receive ATO or MRI scanning, Atomoxetine also has effects on DA as well as NA, and the PD patients were not any more apathetic than controls. This makes it difficult to draw firm conclusions about mechanisms of apathy in PD specifically. But the relationship of ATO effects on prior precision to LC integrity is certainly of interest. More detailed comments below:

p15 - The authors are careful to say that these findings "suggest" a contributory mechanism to apathy in PD, but I think they should also explicitly stress that these PD patients were not apathetic - their apathy scores were no different to controls'. So this makes it difficult to extrapolate the findings to pathological levels of apathy. I would therefore rephrase the subsequent conclusion "this study provides evidence for a noradrenergic role in apathy in Parkinson’s disease".

p3/16 - There seems to be a tension between some of the evidence about noradrenaline (NA). At the bottom of p3, lots of evidence is cited that NA relates to (phasic) unexpected uncertainty or (tonic) volatility in the environment, i.e. evidence that the model must be updated - hence priors should be weakened, in both cases. But how does this square with the finding that ATO increases the precision of priors, in those with a less intact LC? There is some rather intricate speculation in the Discussion about phasic/tonic LC firing ratios. But to me this indicates that the subjects with *intact* LC show the most intuitive result: that ATO *reduces* prior precision (as NA ought to if it encodes unexpected uncertainty). This makes me wonder whether the opposite ATO effects in those with less intact LC are in fact dopaminergic effects, unmasked by the impaired LC system? This makes more sense to me than positing an inverted-U or altered phasic/tonic relationships. Impossible to tell from this work of course, but I think this possibility should be mentioned a bit more clearly in line 430 or earlier.

p22 - Can the authors explain a bit more why the 2x2 effort/reward manipulation was included if it was not being used? They just state "we did not analyse these factors further,

following Hezemans et al. [43]" but this is a bit thin. E.g. why not check for an effect of Atomoxetine on these factors? Is there insufficient power with n=17 subjects?

Small points

p4 - I would frame the opposite of 'active' inference as perceptual inference, not 'passive' inference.

Reviewer #2: I am grateful for the opportunity to review this excellent paper. I very much enjoyed reading it, and think this is a great example of computational neurology. It is difficult to find much to improve on, but there are a few points that would benefit from clarification:

1. I thought the method for estimating the prior weighting based upon the slope between the two forms of error was very convincing in its simplicity. However, it would be useful to clarify whether this slope was calculated only for those trials in which the trajectory was not shown. I will assume this is the case in what follows. The reason this is important is that the sensory evidence is different between the conditions where the trajectory is and is not shown, and the performance error from those when it is cannot really be inserted into Equation 3, which computes the estimation error on the assumption of no visual trajectory data (the estimation will clear be different when visual data are available).

2. Following from the above, could the author's comment on the sensory modalities assumed to contribute to the evidence? If not visual, I presume this will largely be tactile and proprioceptive data associated with the finger press. If so, this might be something the authors could make more of. As their focus is on a neurological condition often characterised as a movement disorder, it seems a very good experimental design that focuses on sensory modalities that result from self-generated movements.

3. One difficulty is that the premise of this study is based upon apathy in Parkinson's disease, but it seems that the Parkinson's patients were no more apathetic than the controls. However, the authors highlight the association between locus coeruleus degeneration and apathy, and the interaction between prior weighting and the effect of pharmacological manipulations. Do the authors feel that this experiment could be practically adapted as a clinical test to identify potential responders to atomoxetine from a clinically heterogenous group?

4. In Equation 5 - presumably the authors mean N(x^(n),sigma_s^2), not N(s^(n),sigma_s^2) for the likelihood? The likelihood should be a function of the latent parameters (i.e., the parameters described by the prior and posterior).

Reviewer #3: Hezemans et al. present a study of 17 PD and 20 controls. The task was as per a previous study. Participants exerted a force to move a circle by a given distance on the screen, sometimes without feedback. When feedback is absent, they estimate how far they think they pushed the ball.

The study shows that motivated people were biased to perceive their exerted force as being closer to the target.

PD patients were given atomoxetine, which didn't change performance overall. However patients with MRI evidence of locus coeruleus degeneration showed stronger effects of drug on increasing the bias.

The result is timely and novel. Noradrenergic degeneration in PD is of great clinical and scientific interest. Although the sample size is not huge, it appears to be a very clean sample of PD patients, and the analyses are rigorous, Bayesian, and well controlled. An impressive range of control analyses are presented.

I had no major criticisms but I have a some comments on the interpretation.

1) Comparison with other models of motivation.

The framing of apathy in terms of active inference seems to make qualitatively different predictions to standard econometric theories. I think these should be highlighted, as many readers may not make the connections. In particular, the authors talk about "effort", but in their theory, there seems to be no asymmetry between exerting too much or too little force. Further, it seems a conceptual leap that a sensory prior that produces action, should translate to a prior over *perception* of action. Can the authors clarify why that should be? In general, I would appreciate more of an interface with existing theories of effort and apathy. Also, are the authors talking about physical or cognitive effort here?

Accordingly an important negative seems to be that PD patients did not exert less force than healthy people, and that noradrenaline did not increase force (and perhaps apathy did not correlate with force either?). Does this inform theories of apathy?

Further, the experimental design (effort x reward) was not analysed as such. Although this aligns with the previous paper, I believe that the reader would be genuinely interested in the effects of those manipulations, especially if they are null results. If the authors do not wish to report these, then are the data at least available?

2) Intro - NA is presented as definitively signalling uncertainty. While there are reasonable arguments for this, I think some caution is wise in some of the stronger statements eg L88.

3) I think "optimal" is used in an unusual way (page 8) - the authors write about the optimal integration, but this seems odd since the optimal prior actually has zero-weight (no precision). This is because the sensory input is not biased away from the target (I assume?) -- so it should always be "better" to use raw sensory information rather than integrate it with the target. People of course do mix the prior with evidence, but it is confusing to call this optimal.

4) I would prefer if some of the task details in Materials & Methods appeared up in the main text e.g. how the force determined the distance moved, the proportion of trials

L225: a healthy

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No: Did not see it in text - maybe I missed it.

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Sanjay Manohar

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

References:

Review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010079.r003

Decision Letter 1

Samuel J Gershman, Woo-Young Ahn

5 Apr 2022

Dear Dr. Hezemans,

We are pleased to inform you that your manuscript 'Noradrenergic deficits contribute to apathy in Parkinson's disease through the precision of expected outcomes' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Woo-Young Ahn

Associate Editor

PLOS Computational Biology

Samuel Gershman

Deputy Editor

PLOS Computational Biology

***********************************************************

Reviewer's Responses to Questions

Comments to the Authors:

Reviewer #1: The authors have addressed all my concerns and I have no further comments. Compliments to them!

Reviewer #2: I am grateful to the authors for their responses, and have no further edits to suggest. I am happy to endorse publication at this stage.

Reviewer #3: The authors have responded to ask my comments most thoroughly. They should be congratulated on an excellent paper.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: Sanjay Manohar

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1010079.r004

Acceptance letter

Samuel J Gershman, Woo-Young Ahn

4 May 2022

PCOMPBIOL-D-21-01786R1

Noradrenergic deficits contribute to apathy in Parkinson's disease through the precision of expected outcomes

Dear Dr Hezemans,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Olena Szabo

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Relationship between prior weighting and apathy in young adults.

    Data from Hezemans et al. [43], demonstrating the relationship between trait apathy (measured using the Apathy Motivation Index) and prior weighting, adjusted for task performance variability (i.e., partial residuals). Note that observations with identical questionnaire scores were horizontally jittered to avoid overlaid dots. Full statistics for the regression coefficient of apathy: β = -0.42, SE = 0.14, t(44) = -3.02, p = .004; BF = 11.63.

    (PDF)

    S2 Fig. Plate notation and sampling statements for the hierarchical Bayesian model.

    Participant-level parameters were sampled from latent group-level distributions. We allowed for atomoxetine-induced changes in the standard deviations of the prior and sensory evidence distributions. Session-level parameters were then used to obtain trial-level posterior distributions of the final ball position. The observed estimates of performance were modelled as samples from the trial-level posterior distributions. The model is represented in plate notation: shaded nodes represent observed data whereas white nodes represent latent variables; rectangular nodes represent discrete or fixed variables whereas circular nodes represent continuous variables; and double-bordered white nodes represent deterministic variables whereas single-bordered white nodes represent stochastic variables.

    (PDF)

    S3 Fig. Information criteria for variants of the hierarchical Bayesian model.

    In addition to the model presented in the manuscript, we fit three variants of the model with restrictions on the number of drug-induced change parameters. For each model variant, we computed the leave-one-out information criterion (LOOIC) and the widely applicable information criterion (WAIC) as estimates of the model’s expected predictive accuracy. For both measures, the ‘full’ model which included drug-induced change parameters for both the prior and sensory evidence standard deviations was strongly preferred over the three more restricted model variants.

    (PDF)

    S4 Fig. Posterior predictive check: response distributions.

    Each panel compares the observed responses (light-coloured density plot and histogram) to distributions of simulated responses drawn from the model’s posterior predictive distribution (dark-coloured density traces).

    (PDF)

    S5 Fig. Posterior predictive check: predictive error.

    Each panel illustrates the distribution of the mean predictive error of the model–that is, the observed responses minus simulated responses drawn from the model’s posterior predictive distribution, averaged across Markov Chain Monte Carlo samples. These histograms can therefore be interpreted as the distributions of residuals.

    (PDF)

    S1 Text. Mood and behaviour questionnaires.

    Table A. Descriptive statistics and group comparisons of questionnaires. Data are presented as mean (SD). Group comparisons were performed with independent samples t-tests. The stated p-values are uncorrected; none survived p < .05 after correction for multiple comparisons. Abbreviations: BF, Bayes Factor for the alternative hypothesis over the null hypothesis, where > 3 would indicate positive evidence in favour of a group difference; BIS, Barratt Impulsiveness Scale; HADS, Hospital Anxiety and Depression Scale; MEI, Motivation and Energy Inventory; CAARS, Conners’ Adult ADHD Rating Scale; RBDSQ, REM sleep Behaviour Disorder Screening Questionnaire; CBI-R, Cambridge Behavioural Inventory–Revised. Fig A. Density plots of questionnaire scores for participants with Parkinson’s disease (blue) and controls (orange). The questionnaire scores were z-scored to bring the different questionnaires onto a common scale (note that this transformation does not affect group comparisons for a given questionnaire outcome). Tick marks reflect individual data points. Abbreviations: BIS, Barratt Impulsiveness Scale; MEI, Motivation and Energy Inventory; HADS, Hospital Anxiety and Depression Scale; CAARS, Conners’ Adult ADHD Rating Scale.

    (DOCX)

    S2 Text. Role of covariates in the drug × LC CNR interaction on prior weighting.

    Table A. Backward elimination of fixed effects in the linear mixed effects model predicting prior weighting. Values for predictors are standardised regression coefficients (ß). *p < .05. Drug, atomoxetine vs. placebo condition; LC CNR, Locus Coeruleus Contrast to Noise Ratio; ICV, total intracranial volume; Ato plasma, atomoxetine plasma concentration; LEDD, Levodopa Equivalent Daily Dose; Session, first vs. second session; UPDRS III, Unified Parkinson’s Disease Rating Scale, motor examination; AIC, Akaike Information Criterion; BIC, Bayesian Information Criterion; Δ AIC / BIC, difference in AIC / BIC with respect to the lowest AIC / BIC value. All models included a fixed effect of the interquartile range of performance error as a covariate of no interest, and a random effect of participants on the intercept. Total intracranial volume was estimated from the T1-weighted MP2RAGE images using the mri_segstats–etiv-only procedure in FreeSurfer v6.0.0. Table B. Bayes Factors for the inclusion of fixed effects in the linear mixed effects model predicting prior weighting. P(incl): prior inclusion probability, i.e. the summed prior probability of models that include the predictor. A priori, all possible restrictions of the full model were deemed to be equally likely (i.e., a uniform prior was assigned to the model space). Thus, P(incl) reflects the proportion of alternative models that included the predictor. P(incl|data): posterior inclusion probability, i.e. the summed posterior probability of models that include the predictor. P(excl|data): posterior exclusion probability, i.e. the summed posterior probability of models that exclude the predictor. BFinclusion: Inclusion Bayes Factor, i.e. the change from prior to posterior inclusion odds. This indicates how much more likely the data are under models that include the predictor, compared to models that exclude the predictor. This analysis was performed using “matched” models, which means that (i) models were not permitted to include an interaction effect without its constituent main effects, and (ii) inclusion probabilities for an interaction effect were based only on the subset of models that contained (at least) the constituent main effects of the interaction. All models included a fixed effect of the interquartile range of performance error as a covariate of no interest, and a random effect of participants on the intercept.

    (DOCX)

    S3 Text. Decomposing drug effects on prior weighting: Plausible values analysis.

    Fig A. Decomposing the noradrenergic effects on prior weighting using a plausible values analysis approach. (A-B) Distributions of plausible correlations between the drug effect on prior weighting and the estimated drug effect on the standard deviation of the prior (A) or sensory evidence (B). (C) Distribution of the difference between the plausible correlations.

    (DOCX)

    S4 Text. Effects of effort and reward on task performance and prior weighting.

    Fig A. Task accuracy (median force error) plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in median force error from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Fig B. Task variability (interquartile range of force error) plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in the interquartile range of force error from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Fig C. Prior weighting plotted as a function of effort, reward, group, and drug. Dots represent individual participants, and boxplots represent the marginal distribution for a given condition. For the Parkinson’s disease group, the grey lines indicate within-subject change in prior weighting from placebo to atomoxetine. Box-plot elements: centre line, median; box limits, first and third quartiles; whiskers, most extreme observations within 1.5 × interquartile range from the box limits. Table A. Estimated marginal means of median force error by group, effort, and reward. Table B. Estimated marginal means of median force error by drug, effort, and reward. Table C. Estimated marginal means of interquartile range of force error by group, effort, and reward. Table D. Estimated marginal means of interquartile range of force error by drug, effort, and reward. Table E. Estimated marginal means of prior weighting by group, effort, and reward. Table F. Estimated marginal means of prior weighting by drug, effort, and reward.

    (DOCX)

    S5 Text. Parameter recovery of prior weighting.

    Fig A. Parameter recovery of prior weighting. (A) Data-generating prior weighting plotted against the estimated (i.e., recovered) prior weighting. The diagonal (identity) line represents perfect parameter recovery. For a given data-generating prior weighting value, the dot represents the median of the prior weighting estimates across 2000 simulations of estimation errors; the vertical error bars represent the 95% quantile intervals of the prior weighting estimates. The inset histogram illustrates the distribution of the difference between the median estimated prior weighting and data-generating prior weighting. (B, C) Examples of data simulations for a relatively low data-generating value of prior weighting (B; orange dot and error bar in A) and a relatively high data-generating value of prior weighting (C; green dot in A).

    (DOCX)

    S6 Text. Details of statistical software.

    (DOCX)

    Attachment

    Submitted filename: Hezemans_PLOS_CB_responseletter.docx

    Data Availability Statement

    Code and de-identified behavioural data and summary imaging metrics to reproduce statistical analyses, computational modelling and manuscript figures are freely available through the Open Science Framework: https://osf.io/mry4f/.


    Articles from PLoS Computational Biology are provided here courtesy of PLOS

    RESOURCES