Abstract
Impairments in metacognition, the ability to accurately report one’s performance, are common in patients with psychiatric disorders, where a putative neuromodulatory dysregulation provides the rationale for pharmacological interventions. Previously, we have shown how unexpected arousal modulates metacognition (Allen et al., 2016). Here, we report a double-blind, placebo-controlled, study that examined specific effects of noradrenaline and dopamine on both metacognition and perceptual decision making. Signal theoretic analysis of a global motion discrimination task with adaptive performance staircasing revealed that noradrenergic blockade (40 mg propranolol) significantly increased metacognitive performance (type-II area under the curve, AUROC2), but had no impact on perceptual decision making performance. Blockade of dopamine D2/3 receptors (400 mg amisulpride) had no effect on either metacognition or perceptual decision making. Our study is the first to show a pharmacological enhancement of metacognitive performance, in the absence of any effect on perceptual decision making. This enhancement points to a regulatory role for noradrenergic neurotransmission in perceptual metacognition.
DOI: http://dx.doi.org/10.7554/eLife.24901.001
Research Organism: Human
Making a decision is often accompanied by a conscious feeling of confidence (Flavell, 1979). Subjective confidence reports typically show a good correspondence to actual task performance, reflecting a metacognitive ability for accurate introspection (Fleming et al., 2010). Impairments in metacognition can compromise decision making and lead to misjudgements of actual performance, as found in several psychiatric dimensions, such as schizophrenia, attention-deficit/hyperactivity disorder or compulsivity (Frith, 1992; Knouse et al., 2005; Lysaker et al., 2010; Hauser et al., 2017).
The neurocognitive mechanisms from which confidence, and metacognitive ability in general, arise are ill understood. While classic accounts see confidence as a mere extension of a perceptual sampling process (Kiani and Shadlen, 2009; Pleskac and Busemeyer, 2010; Meyniel et al., 2015; Moran et al., 2015), other evidence points to a non-trivial relationship between decision making and confidence that invoke distinct decision making and metacognitive processes (Fleming et al., 2010; Fleming and Dolan, 2012; Allen et al., 2016; Allen et al., 2017). Metacognition can thus be understood as incorporating both decision-related and domain-general information (Fleming and Daw, 2017) and frontopolar and hippocampal brain structures, for example, have been shown to contribute specifically to metacognition but not to perceptual decision making (Fleming et al., 2010, 2012; Allen et al., 2017). In our previous study, we provided evidence that arousal can bias metacognition independently of decision accuracy (Allen et al., 2016), in accordance with other studies showing confidence-accuracy dissociations (Fleming et al., 2015; Spence et al., 2016) and suggested that these biases might be under neuromodulatory control via neural gain (Eldar et al., 2013; Hauser et al., 2016).
Two candidate neuromodulators likely to affect metacognition are the catecholamines noradrenaline and dopamine. These neurotransmitters have their origin in brainstem nuclei that project broadly to cortical and subcortical regions, including prefrontal cortex and hippocampus (Hauser et al., 2016). Both dopamine and noradrenaline contribute to the regulation of arousal and higher-order cognition (Usher et al., 1999; Aston-Jones and Cohen, 2005; Yu and Dayan, 2005; Pessiglione et al., 2006; De Martino et al., 2008; Chowdhury et al., 2013; Eldar et al., 2013; Rigoli et al., 2016), and their dysregulation is widely inferred to contribute to various manifestations of psychiatric illness (Yamamoto and Hornykiewicz, 2004; Laruelle, 2013; Hauser et al., 2016). However, whether and which of these neuromodulators influences metacognition is unknown.
Here we assessed whether noradrenaline or dopamine have a distinct influence on metacognition, independent of any effect on perceptual decision making. The latter consideration is important because differences in perceptual decision making can distort an assessment of metacognition (Fleming and Lau, 2014). Consequently, we used an approach where we kept perceptual decision making equivalent across subjects, using a staircase procedure. This, combined with a signal detection analysis (Green and Swets, 1966; Galvin et al., 2003), enabled us to measure drug effects on metacognition while controlling for potential effects on perceptual decision making. This overcomes a limitation of a previous study that assessed the impact of dopamine on confidence (Lou et al., 2011).
To examine the influence of noradrenaline and dopamine we employed two pharmacological manipulations. Many pharmacological agents have high affinity for both dopaminergic and noradrenergic receptors and synaptic function. On this basis, we selected drugs with selective high affinity, the β-adrenoceptor antagonist propranolol in the case of noradrenaline, and the D2/3 receptor antagonist amisulpride in the case of dopamine. In a double-blind, placebo-controlled design we demonstrate that the noradrenergic agent propranolol uniquely improves metacognition in the absence of an effect on perceptual performance, with no effect seen following administration of the dopamine antagonist amisulpride.
Results
Noradrenaline blockade modulates metacognition
To examine effects of noradrenaline and dopamine (versus placebo) on metacognition we performed a double-blind, between-subjects, placebo-controlled study. Each of the three groups consisted of 20 subjects matched for gender, age, affect (Watson et al., 1988), and intellectual abilities (Wechsler, 1999) (Table 1). Due to differences in their pharmacokinetic properties we administered active drugs orally at two different time points. The dopamine group received 400 mg of amisulpride (selective D2/3 antagonist) 110 min prior to a metacognition task and an additional placebo 30 min after the amisulpride administration (Figure 1A). The noradrenaline group received a placebo at 110 min prior to the task and then 40 mg of propranolol (non-selective β-adrenoceptor antagonist) 30 min after placebo administration. The placebo group received placebo at the both time points to match the administration schedules of the other groups. A post-experiment evaluation revealed that subjects were not aware of whether and which drug they received (χ2(4)=1.26, p=0.868; missing data from two subjects). There were no effects of drug on mood (PANAS; Watson et al., 1988) ratings (main effect of drug: F(2,57)=.16, p=0.852; time x drug: F(2,57)=.19, p=0.827; time x affect x drug: F(2,57)=2.17, p=0.124).
Table 1.
Placebo | Propranolol | Amisulpride | ||
---|---|---|---|---|
gender (f/m) | 10/10 | 10/10 | 10/10 | |
age | 24.50 ± 4.16 | 23.15 ± 4.31 | 22.35 ± 2.21 | F(2,57)=1.74, p=0.185 |
IQ | 112.45 ± 12.22 | 118.75 ± 8.55 | 114.60 ± 11.77 | F(2,57)=1.70, p=0.191 |
PANAS PA pre | 31.15 ± 10.08 | 27.70 ± 8.28 | 28.90 ± 6.60 | F(2,57)=0.86, p=0.428 |
PANAS NA pre | 11.70 ± 2.23 | 13.55 ± 5.48 | 13.10 ± 3.23 | F(2,57)=1.23, p=0.300 |
PANAS PA post | 29.22 ± 10.47 | 27.15 ± 7.75 | 27.80 ± 8.12 | F(2,57)=0.286, p=0.752 |
PANAS NA post | 11.45 ± 2.37 | 11.95 ± 4.87 | 11.25 ± 1.92 | F(2,57)=0.236, p=0.790 |
Eighty minutes after the second drug administration, subjects performed a visual global motion discrimination task that included confidence judgements (Figure 1B). Subjects decided whether the overall motion of a short burst of randomly moving dots was directed to the left or right of the vertex. Subsequently, and in the absence of feedback on whether they were correct or not, they indicated confidence in their decision on that trial using a sliding visual analogue scale. To control for potential drug effects on perceptual performance, we matched the subjects’ decision accuracy by continuously adapting the global motion orientation using a staircase procedure (Cornsweet, 1962).
To examine metacognitive abilities, we analysed type-II performance as derived from signal detection theory (Green and Swets, 1966; Galvin et al., 2003). This measures subjects’ awareness into their own performance by assessing how well their confidence ratings match their true accuracy (i.e., ‘how much more confident am I if I make a correct vs incorrect decision’). We calculated type-II area under the receiver-operating-characteristics curve (AUROC2) (Fleming et al., 2010, 2012; Weil et al., 2013; Allen et al., 2017) for each subject and then compared this metric between groups using an ANOVA with drug group as a between-subjects factor. The analysis revealed a significant effect of drug on AUROC2 (Figure 2, F(2,55)=5.192, p=0.009, η²=0.16), with follow up t-tests showing the propranolol group performed significantly better than a placebo group (t(38)=4.00, p<0.001, d = 1.26). The propranolol group also performed marginally better than an amisulpride group (t(36)=2.02, p=0.051, d = 0.65) with the latter having an equal performance as the placebo group (t(36)=.74, p=0.465, d = 0.23). To evaluate evidence for this null effect in the amisulpride group, we additionally performed a Bayesian two-sample t-test comparing the placebo and amisulpride groups (Rouder et al., 2009; Dienes, 2014). This analysis revealed a Bayes Factor of 3.31, corresponding to moderate evidence for the null hypothesis. These results indicate that inhibition of noradrenergic function improves metacognitive insight, in the absence of any effect of amisulpride.
Improved metacognition mainly driven by confidence on error trials
To further understand the noradrenaline-induced metacognitive enhancement, we compared median confidence ratings for correct and incorrect trials between the propranolol and placebo group. A significant group-by-correctness interaction (F(1,38)=8.66, p=0.006, η²=0.19) in the absence of a group main effect (F(1,38)=1.83, p=0.185, η²=0.05) suggests that a confidence rating difference between correct and incorrect trials underlies the observed group differences. Subsequent t-tests demonstrated that this effect was primarily driven by error trials (error trials: t(38)=2.17, p=0.036, d = 0.69, correct trials: t(38)=-.193, p=0.848, d = 0.06), suggesting that the propranolol group exhibited lower confidence for error trials.
Metacognitive differences are not explained by perceptual performance
Metacognitive measures, as used here, can be influenced by differences in perceptual performance (Fleming and Lau, 2014). We deliberately used a staircase procedure to keep performance equivalent between groups (mean accuracy: F(2,55)=1.60, p=0.212, η²=0.05, cf. Figure 2C). A signal-detection theoretic analysis confirmed these findings, revealing the absence of any significant differences in either perceptual sensitivity d’ (Figure 3C, F(2,55)=1.69, p=0.194, η²=0.07) or response bias c (F(2,55)=2.29, p=0.112, η²=0.08) (Green and Swets, 1966). To additionally ensure that differences in AUROC2 were not influenced by any of these measures, we also compared AUROC2 using an ANCOVA with d’, response bias c, and stimulus signal strength (mean orientation) as covariates, revealing the same group difference for AUROC2 after controlling for these potential biases (F(2,51)=4.99, p=0.010, η²=0.17).
No drug effect on perceptual decision making
To test whether perceptual decision making was affected by our drug interventions, we analysed whether stimulus strength, measured by mean stimulus motion orientation, differed between groups. There was no significant difference in stimulus strength (Figure 3A, F(2,55)=1.16, p=0.321, η²=0.04), indicating perceptual performance was not significantly affected by the drug manipulations. Likewise, there was no drug effect on reaction times (Figure 3B, F(2,55)=.87, p=0.424, η²=0.03). Lastly, to test whether there were baseline differences in how the groups were utilising the confidence scale, we examined the median confidence ratings, but found no difference (Figure 3D, F(2,55)=.38, p=0.684, η²=0.01), supporting the result that an enhanced metacognitive ability under propranolol is not due to a bias in use of the confidence rating scale.
Discussion
Confidence determines how much we trust our decisions and how strongly they influence future behaviour. A read out of confidence in a decision that fails to reflect actual performance will lead to poor decisions and long-term adverse outcomes. Impaired metacognition is reported in psychiatric disorders (Frith, 1992; Knouse et al., 2005; Lysaker et al., 2010; Wells, 2011; Hauser et al., 2017), and its pharmacological remediation could provide a target for treatment (Wells, 2011). Here we show that inhibition of central noradrenaline (by means of propranolol) function enhances perceptual metacognitive ability. A dopamine blockade (by means of amisulpride) had no impact on metacognition and neither drug manipulation had an impact on core perceptual performance.
Noradrenaline is known to impact arousal and higher-order cognition, but the precise mechanisms remain obscure. Influential accounts propose noradrenergic modulation of information processing, either through neural gain (Aston-Jones and Cohen, 2005; Eldar et al., 2013) or by signalling unexpected uncertainty (Yu and Dayan, 2005; Dayan et al., 2006). Our finding that blocking noradrenaline leads to improved metacognitive performance can be understood within both frameworks. Metacognition can be thought of as a higher-order process that follows a perceptual decision making stage and integrates perceptual and other sources of information, such as interoceptive states and general arousal (Allen et al., 2016), to form an overall confidence judgement. The neural gain hypothesis (Aston-Jones and Cohen, 2005; Eldar et al., 2013) proposes that noradrenaline amplifies strong and diminishes weak signals throughout the brain, with the effect of an increased ‘contrast’ between strong and weak signals. Due to a nonlinearity in this amplification it is likely to neglect subtle signal differences, and thus omit the breath and detail of information conveyed. This in turn means noradrenaline might render detailed stimulus properties unavailable to the metacognitive process, impairing the precision of a metacognitive judgement. The latter theory (Dayan et al., 2006) suggests phasic noradrenaline is elicited by unexpected uncertainty or arousal, such as when making an erroneous choice (Ullsperger et al., 2010). This phasic burst acts by interrupting ongoing processes and leads to a resetting and erasure of currently maintained information to enable an orienting response (Sokolov et al., 2002; Dayan et al., 2006). In the context of our paradigm, this suggests that following an incorrect response accumulated sensory information is reset and unavailable for confidence judgement, leading to poorer metacognitive performance. This is supported by our finding of a primary drug-effect on confidence in erroneous trials. On both accounts, a blockade of noradrenaline by propranolol hinders the noradrenaline-related loss of information to provide complete perceptual information to a confidence-related process. This is also in line with our previous findings showing that unexpected arousal biases metacognition (Allen et al., 2016), an effect possibly modulated by noradrenaline.
In our experiment, perceptual metacognition was solely influenced by manipulation of noradrenaline, and not by blocking dopamine D2/3 receptors. This is of interest as both neuromodulators are often ascribed similar functions including a role in exploration (Hauser et al., 2016), neural gain (Eldar et al., 2013; Fiore et al., 2016; Hauser et al., 2016), salience (Bromberg-Martin et al., 2010; Kahnt and Tobler, 2013), (prediction) error signalling (Holroyd and Coles, 2002; Hauser et al., 2014) and effort processing (Bouret et al., 2012). Likewise, neural recordings from dopaminergic and noradrenergic brainstem nuclei have revealed surprisingly similar neural response patterns (Bouret et al., 2012; Varazzani et al., 2015). Our finding of enhanced perceptual metacognition with noradrenaline blockade might reflect a rare sensitivity to the actions of one of these neuromodulators. Our findings also raise the possibility that a recent report of increased performance and confidence ratings following dopaminergic enhancement (Lou et al., 2011) may reflect a performance, but not a metacognitive, effect. This finding is akin to a previous report of specific testosterone effects, where there was an effect on perceptual performance but not metacognition (Wright et al., 2012).
An important caveat for comparing the amisulpride and propranolol groups directly is that little is known about the precise pharmacokinetics and how comparable the dosage effects are. We took great care in the design of the study to render the two drug conditions as comparable as possible. First, because of the slightly different absorption rates, we administered amisulpride 30 min before propranolol, in keeping with previous drug schedules (Peretti et al., 1997; Ramaekers et al., 1999; Strange et al., 2003; Silver et al., 2004; Strange and Dolan, 2004; Hurlemann et al., 2005; Alexander et al., 2007; Gibbs et al., 2007; De Martino et al., 2008; Kahnt et al., 2015; Kahnt and Tobler, 2017). Second, to render the cognitive effects of the drugs as similar as possible, we selected dosages that were commonly reported in previous studies of neurocognition (i.e. 40 mg propranolol, 400 mg amisulpride) (e.g., Ramaekers et al., 1999; Strange et al., 2003; Silver et al., 2004; Strange and Dolan, 2004; Hurlemann et al., 2005; Alexander et al., 2007; Gibbs et al., 2007; De Martino et al., 2008; Kahnt et al., 2015; Kahnt and Tobler, 2017). However, we know little about the magnitude of these drug effects on the brain. A previous study of sulpiride, which has a similar chemical formulation to amisulpride, but slightly different pharmacokinetics, suggests that a single-dose of 400 mg leads to a occupancy of ~28% of D2 receptors (Mehta et al., 2008). Unfortunately, there are no PET studies reporting on single-dose amisulpride, and there are no occupancy studies of propranolol, thus rendering it difficult to directly quantify and compare our dosage effects.
In this study, we show that noradrenaline specifically influences perceptual metacognition but not perceptual decision making. It is interesting to speculate whether our findings are generalizable to metacognition in non-perceptual domains. Recent studies show that a metacognitive ability is relatively stable across different perceptual decision making tasks (Song et al., 2011; McCurdy et al., 2013), even when probing different sensory modalities (de Gardelle et al., 2016; Garfinkel et al., 2016). However, it is unclear whether metacognition within different cognitive domains (e.g., perception vs memory) rely on the same processes, with evidence from neuroimaging suggesting that these functions utilise unique neural networks (Baird et al., 2013; Fleming et al., 2014). Given that noradrenaline modulates activity on a whole-brain level (Hauser et al., 2016), it is possible that noradrenergic metacognition effects can be observed in domains other than perception, an interesting area for future studies. Lastly, our previous findings of an embodied reflection of confidence by means of cardiac and pupil responses (Allen et al., 2016) raise the question as to whether the observed noradrenaline effects are purely a consequence of central changes, or whether peripheral effects of this drug influence metacognitive performance independently. A drug that exclusively targets peripheral, but not central, noradrenaline (cf. De Martino et al., 2008) could provide insight into the question of visceral contributions to metacognition as suggested in ideas on embodied cognition (Allen and Friston, 2016).
In conclusion, using a double-blind, placebo-controlled drug manipulation we show that noradrenaline has a controlling influence on metacognitive ability. Metacognition is enhanced following a blockade of noradrenergic β-adrenoceptors an observation suggesting potential remedial avenues for metacognitive insight deficits seen in psychiatric patients.
Materials and methods
Subjects
Sixty subjects participated in this double-blind, placebo-controlled, between-subjects study. Each subject was randomly allocated to one of three drug groups, controlling for an equal gender balance in all groups. Candidate subjects with a history of neurological or psychiatric disorders, current health issues, regular medications (except contraceptives), or prior allergic reactions to drugs were excluded from the study. Subjects had normal or corrected-to-normal vision. The groups were matched for age, mood (PANAS; before and after drug administration) (Watson et al., 1988) and intellectual abilities (WASI abbreviated version) (Wechsler, 1999) (Table 1). Subjects were reimbursed for their participation on an hourly basis. The study was approved by the UCL research ethics committee and all subjects gave written informed consent.
Drug manipulation and procedures
To attenuate noradrenergic function we administered 40 mg of propranolol, a non-selective β-adrenoceptor antagonist. To attenuate dopamine function we administered 400 mg of amisulpride, a selective D2/3 antagonist. These drugs were chosen because of their selective high affinity effects on either one or the other of these two neuromodulators, enabling a specific dissociation of their contribution to metacognitive ability. The dosage and timing of both propranolol and amisulpride were based on previous studies that have investigated their effects on cognition (e.g., Ramaekers et al., 1999; Strange et al., 2003; Silver et al., 2004; Strange and Dolan, 2004; Hurlemann et al., 2005; Alexander et al., 2007; Gibbs et al., 2007; De Martino et al., 2008; Kahnt et al., 2015; Kahnt and Tobler, 2017).
Prior to the task the drugs were administered at two different time points, based upon pharmacokinetic considerations (Figure 1A). The first drug was administered 110 min prior to the metacognition task. At that time, the dopamine group received amisulpride while the other groups received placebo. After 30 min, subjects consumed a second drug. This time, the noradrenaline group received propranolol, while the dopamine and placebo group consumed a placebo. A placebo group received placebo at both times. The task was performed 80 min after the second drug administration.
Experimental paradigm
To measure metacognitive ability we applied an adaptive visual global motion detection paradigm, similar to the version in our previous study (Allen et al., 2016), implemented using Psychtoolbox-3 (www.psychtoolbox.org) for MATLAB (R2010a). On every trial, subjects viewed a brief burst of motion (250 ms), followed by a forced choice to determine if the overall motion direction was to the left or right of vertical. Subjects then rated their subjective confidence using a continuous sliding scale marked at four equal intervals by horizontal lines. To prevent response preparation, the starting point of the confidence marker was jittered up to 12% to the left or right of scale midpoint on each trial. Subjects had up to 1500 ms to make their motion choice, and 2500 ms to report their confidence.
At the start of the experiment, each subject was instructed that the goal of the task was to measure their perceptual and metacognitive sensitivity. This was operationally defined as their ability to detect motion direction and how accurately their confidence ratings reflected their actual detection performance. Subjects first completed a short training session of 140 detection-only trials to establish motion thresholds. All subjects achieved staircase stabilization before continuing to the main experiment (the motion direction threshold reached in the final staircase of training was used as the starting point for main task). Subjects were encouraged to use the entire scale to report their subjective feeling of confidence, and to carefully reflect on each trial on the decision they had just made. Confidence reports were then binned into six equally sized bins for further analysis similar to previous reports (Fleming et al., 2010, 2012; Allen et al., 2017; Hauser et al., 2017).
On each trial subjects viewed a cloud of 1100 moving black dots of 0.08 degrees visual angle (DVA), presented for 250 ms within a 15.69 DVA circular array at random starting positions and advancing at a speed of 0.06 DVA per frame. Dots which moved beyond the stimulus aperture were replaced at the opposite edge to maintain constant dot density. To prevent fixation on local motion directions, all dots had a randomized limited lifetime of maximum 93% (14 frames). Each motion stimulus was defined by a global motion direction (‘orientation’) to the left or right of vertical. Following experiments investigating confidence with global motion stimuli, dot mean and variance were manipulated independently of one another (Allen et al., 2016; Spence et al., 2016). To this end, all dots were ‘signal’ dots and the standard deviation of the mean direction was adjusted across conditions. On each trial the motion signal was thus calculated using the formula:
To control task difficulty and thus ensure an unbiased estimate of metacognitive sensitivity (Fleming and Lau, 2014), the mean direction of motion was continuously adapted for each subject using a 2-up-1 down staircase, which converges at the limit on a 71% detection accuracy. To render the staircase opaque to subjects, and maximize confidence variability, we deployed two separate staircase conditions with a fixed motion variance equal to either 20 or 30 degrees standard deviation. Subjects completed a total of 144 trials (72 high variance, 72 low variance) divided evenly between four blocks.
Statistical analysis and metacognition modelling
The goal of our analyses were two-fold: First, we wanted to ensure all groups expressed equivalent perceptual decision making performance, as performance differences can influence estimates of metacognitive ability (Fleming and Lau, 2014). Second, we wanted to test for differences in metacognition using signal detection theory (SDT), examining the metacognitive detection performance using an area under the curve for a type-II receiver-operating-characteristics (ROC) (AUROC2) metric (Fleming et al., 2010, 2012).
To ensure homogeneous performance across all subjects, we excluded two outlier subjects who performed worse than the rest (as measured using boxplots; both subjects belonged to the amisulpride group). We omitted all trials from the first block to ensure staircase stabilisation, similar to previous studies (Fleming et al., 2010, 2012; Allen et al., 2017; Hauser et al., 2017). Trials with early (<100 ms), late (>1500 ms) or missing responses were excluded. We collapsed low and high variance trials, leaving a total of 108 trials per subject, per recommended procedures, for optimal estimation of SDT measures (Fleming and Lau, 2014). To compare perceptual abilities between groups, we assessed their performance in terms of accuracy and signal strength (mean stimulus orientation). We further assessed reaction times and the subjects’ average confidence ratings. We used ANOVAs with a between-subject factor group (placebo, propranolol, amisulpride) and post-hoc t-tests in SPSS (version 22, IBM). To evaluate the evidence for the null hypothesis that amisulpride had no effect on AUROC2, we performed a Bayesian two-sample t-test using version 0.9.8 of the BayesFactor package, computed using R version 3.3.2 (2016-10-31) on x86_64-w64-mingw32 (Rouder et al., 2009; Morey and Rouder, 2015). A unit-information Bayes Factor with r scale parameter = 1 was calculated for the Placebo vs Amisulpride contrast (Rouder et al., 2009). This Bayes factor expresses the continuous evidence for the null hypothesis of no drug effect, where Bayes Factors > 3 correspond to ‘moderate’ evidence (Rouder et al., 2009; Dienes, 2014).
To examine subjects’ metacognitive abilities, we assessed the type-II performance using SDT. In this framework, metacognition can be modelled as the sensitivity of subjective confidence to underlying ground truth discrimination performance. By defining metacognitive ‘hits’ (i.e., high confidence for correct detections) and ‘misses’ (high confidence for incorrect detections), metacognitive sensitivity can be expressed as the area under a type-II receiver-operating-characteristics curve (AUROC2). In contrast to classical measures of metacognition (e.g., the correlation of confidence and accuracy), AUROC2 is unbiased by a subject's overall level of confidence (or metacognitive bias/criterion) if detection performance is held constant across subjects (Fleming and Lau, 2014). Further, being nonparametric, AUROC2 is not susceptible to issues such as non-normal confidence distributions.
AUROC2 was calculated using the same metric as in Fleming et al. (2010), Kornbrot (2006):
(1.1) |
where i indicates the six confidence rating bins, h depicts the relative frequency of this rating for correct choices () and f describes the counterpart for incorrect responses ().
To ensure that the groups did not differ in their type-I detection performance (d‘) or response bias (c), we additionally examined these metrics (Green and Swets, 1966; Fleming et al., 2010):
(1.2) |
(1.3) |
where z describes the inverse of a cumulative normal distribution, H is the correct hits and FA the false alarms for two-alternative forced choice tasks.
Acknowledgements
RJD holds a Wellcome Trust Senior Investigator Award (098362/Z/12/Z). A Wellcome Trust Cambridge-UCL Mental Health and Neurosciences Network grant (095844/Z/11/Z) supported RJD and TUH. GR and MA were supported by a Wellcome Trust SRF grant (100227). The UCL-Max Planck Centre is a joint initiative supported by UCL and the Max Planck Society. The Wellcome Trust Centre for Neuroimaging is supported by core funding from the Wellcome Trust (091593/Z/10/Z). We thank Gita Prabhu for the support with the ethics application. We thank Robb Rutledge, Francesco Rigoli, Geert-Jan Will, and Eran Eldar for helpful inputs on the study design. We thank Steve Fleming for helpful comments on an earlier version of the manuscript. The authors declare no conflict of interest.
Funding Statement
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Funding Information
This paper was supported by the following grants:
Wellcome 095844/Z/11/Z to Tobias U Hauser, Michael Moutoussis, Raymond J Dolan.
Wellcome 100227 to Micah Allen, Geraint Rees.
UCLH Biomedical Research Council to Michael Moutoussis.
Wellcome 091593/Z/10/Z to Geraint Rees, Raymond J Dolan.
Wellcome 098362/Z/12/Z to Raymond J Dolan.
Max-Planck-Gesellschaft to Raymond J Dolan.
Additional information
Competing interests
The authors declare that no competing interests exist.
Author contributions
TUH, Conceptualization, Data curation, Formal analysis, Supervision, Visualization, Writing—original draft, Project administration, Writing—review and editing.
MA, Conceptualization, Software, Supervision, Methodology, Writing—original draft, Writing—review and editing.
NP, Investigation, Project administration, Writing—review and editing.
MM, Conceptualization, Supervision, Investigation, Methodology, Writing—review and editing.
GR, Conceptualization, Supervision, Writing—review and editing.
RJD, Conceptualization, Supervision, Funding acquisition, Writing—original draft, Writing—review and editing.
Ethics
Human subjects: The study was approved by the UCL research ethics committee and all subjects gave written informed consent.
References
- Alexander JK, Hillier A, Smith RM, Tivarus ME, Beversdorf DQ. Beta-adrenergic modulation of cognitive flexibility during stress. Journal of Cognitive Neuroscience. 2007;19:468–478. doi: 10.1162/jocn.2007.19.3.468. [DOI] [PubMed] [Google Scholar]
- Allen M, Frank D, Schwarzkopf DS, Fardo F, Winston JS, Hauser TU, Rees G. Unexpected arousal modulates the influence of sensory noise on confidence. eLife. 2016;5:e18103. doi: 10.7554/eLife.18103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Allen M, Friston KJ. From cognitivism to autopoiesis: towards a computational framework for the embodied mind. Synthese. 2016;371:1–24. doi: 10.1007/s11229-016-1288-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Allen M, Glen JC, Müllensiefen D, Schwarzkopf DS, Fardo F, Frank D, Callaghan MF, Rees G. Metacognitive ability correlates with hippocampal and prefrontal microstructure. NeuroImage. 2017;149:415–423. doi: 10.1016/j.neuroimage.2017.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aston-Jones G, Cohen JD. An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annual Review of Neuroscience. 2005;28:403–450. doi: 10.1146/annurev.neuro.28.061604.135709. [DOI] [PubMed] [Google Scholar]
- Baird B, Smallwood J, Gorgolewski KJ, Margulies DS. Medial and lateral networks in anterior prefrontal cortex support metacognitive ability for memory and perception. Journal of Neuroscience. 2013;33:16657–16665. doi: 10.1523/JNEUROSCI.0786-13.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouret S, Ravel S, Richmond BJ. Complementary neural correlates of motivation in dopaminergic and noradrenergic neurons of monkeys. Frontiers in Behavioral Neuroscience. 2012;6:40. doi: 10.3389/fnbeh.2012.00040. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bromberg-Martin ES, Matsumoto M, Hikosaka O. Dopamine in motivational control: rewarding, aversive, and alerting. Neuron. 2010;68:815–834. doi: 10.1016/j.neuron.2010.11.022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chowdhury R, Guitart-Masip M, Lambert C, Dayan P, Huys Q, Düzel E, Dolan RJ. Dopamine restores reward prediction errors in old age. Nature Neuroscience. 2013;16:648–653. doi: 10.1038/nn.3364. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cornsweet TN. The staircrase-method in psychophysics. The American Journal of Psychology. 1962;75:485–491. doi: 10.2307/1419876. [DOI] [PubMed] [Google Scholar]
- Dayan P, Yu AJ, Aj Y. Phasic norepinephrine: a neural interrupt signal for unexpected events. Network: Computation in Neural Systems. 2006;17:335–350. doi: 10.1080/09548980601004024. [DOI] [PubMed] [Google Scholar]
- de Gardelle V, Le Corre F, Mamassian P, de GV, Corre FL. Confidence as a common currency between Vision and Audition. PLoS One. 2016;11:e0147901. doi: 10.1371/journal.pone.0147901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- De Martino B, Strange BA, Dolan RJ. Noradrenergic neuromodulation of human attention for emotional and neutral stimuli. Psychopharmacology. 2008;197:127–136. doi: 10.1007/s00213-007-1015-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dienes Z. Using Bayes to get the most out of non-significant results. Frontiers in Psychology. 2014;5:781. doi: 10.3389/fpsyg.2014.00781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eldar E, Cohen JD, Niv Y. The effects of neural gain on attention and learning. Nature Neuroscience. 2013;16:1146–1153. doi: 10.1038/nn.3428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fiore VG, Rigoli F, Stenner MP, Zaehle T, Hirth F, Heinze HJ, Dolan RJ. Changing pattern in the basal ganglia: motor switching under reduced dopaminergic drive. Scientific Reports. 2016;6:23327. doi: 10.1038/srep23327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flavell JH. Metacognition and cognitive monitoring: a new area of cognitive-developmental inquiry. American Psychologist. 1979;34:906–911. doi: 10.1037/0003-066X.34.10.906. [DOI] [Google Scholar]
- Fleming SM, Daw ND. Self-evaluation of decision-making: a general bayesian framework for metacognitive computation. Psychological Review. 2017;124:91–114. doi: 10.1037/rev0000045. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Dolan RJ. The neural basis of metacognitive ability. Philosophical Transactions of the Royal Society B: Biological Sciences. 2012;367:1338–1349. doi: 10.1098/rstb.2011.0417. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Huijgen J, Dolan RJ. Prefrontal contributions to metacognition in perceptual decision making. Journal of Neuroscience. 2012;32:6117–6125. doi: 10.1523/JNEUROSCI.6489-11.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Lau HC. How to measure metacognition. Frontiers in Human Neuroscience. 2014;8:443. doi: 10.3389/fnhum.2014.00443. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Maniscalco B, Ko Y, Amendi N, Ro T, Lau H. Action-specific disruption of perceptual confidence. Psychological Science. 2015;26:89–98. doi: 10.1177/0956797614557697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Ryu J, Golfinos JG, Blackmon KE. Domain-specific impairment in metacognitive accuracy following anterior prefrontal lesions. Brain. 2014;137:2811–2822. doi: 10.1093/brain/awu221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Weil RS, Nagy Z, Dolan RJ, Rees G. Relating introspective accuracy to individual differences in brain structure. Science. 2010;329:1541–1543. doi: 10.1126/science.1191883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frith CD. The Cognitive Neuropsychology of Schizophrenia. Psychology Press; 1992. [Google Scholar]
- Galvin SJ, Podd JV, Drga V, Whitmore J. Type 2 tasks in the theory of signal detectability: discrimination between correct and incorrect decisions. Psychonomic Bulletin and Review. 2003;10:843–876. doi: 10.3758/BF03196546. [DOI] [PubMed] [Google Scholar]
- Garfinkel SN, Manassei MF, Hamilton-Fletcher G, In den Bosch Y, Critchley HD, Engels M. Interoceptive dimensions across cardiac and respiratory axes. Philosophical Transactions of the Royal Society B: Biological Sciences. 2016;371:0014. doi: 10.1098/rstb.2016.0014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gibbs AA, Naudts KH, Spencer EP, David AS. The role of dopamine in attentional and memory biases for emotional information. American Journal of Psychiatry. 2007;164:1603–1609. doi: 10.1176/appi.ajp.2007.06081241. [DOI] [PubMed] [Google Scholar]
- Green DM, Swets JA. Signal Detection Theory and Psychophysics. John Wiley and Sons; 1966. [Google Scholar]
- Hauser TU, Allen M, NSPN Consortium. Rees G, Dolan RJ. Metacognitive impairments extend perceptual decision making weaknesses in compulsivity. bioRxiv. 2017 doi: 10.1101/098277. [DOI] [PMC free article] [PubMed]
- Hauser TU, Fiore VG, Moutoussis M, Dolan RJ. Computational Psychiatry of ADHD: neural Gain impairments across Marrian levels of analysis. Trends in Neurosciences. 2016;39:63–73. doi: 10.1016/j.tins.2015.12.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hauser TU, Iannaccone R, Stämpfli P, Drechsler R, Brandeis D, Walitza S, Brem S. The feedback-related negativity (FRN) revisited: new insights into the localization, meaning and network organization. NeuroImage. 2014;84:159–168. doi: 10.1016/j.neuroimage.2013.08.028. [DOI] [PubMed] [Google Scholar]
- Holroyd CB, Coles MG. The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychological Review. 2002;109:679–709. doi: 10.1037/0033-295X.109.4.679. [DOI] [PubMed] [Google Scholar]
- Hurlemann R, Hawellek B, Matusch A, Kolsch H, Wollersen H, Madea B, Vogeley K, Maier W, Dolan RJ. Noradrenergic modulation of emotion-induced forgetting and remembering. Journal of Neuroscience. 2005;25:6343–6349. doi: 10.1523/JNEUROSCI.0228-05.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahnt T, Tobler PN. Salience signals in the right temporoparietal junction facilitate value-based decisions. Journal of Neuroscience. 2013;33:863–869. doi: 10.1523/JNEUROSCI.3531-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahnt T, Tobler PN. Dopamine modulates the Functional Organization of the Orbitofrontal Cortex. The Journal of Neuroscience. 2017;37:1493–1504. doi: 10.1523/JNEUROSCI.2827-16.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahnt T, Weber SC, Haker H, Robbins TW, Tobler PN. Dopamine D2-receptor blockade enhances decoding of prefrontal signals in humans. Journal of Neuroscience. 2015;35:4104–4111. doi: 10.1523/JNEUROSCI.4182-14.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiani R, Shadlen MN. Representation of confidence associated with a decision by neurons in the parietal cortex. Science. 2009;324:759–764. doi: 10.1126/science.1169405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knouse LE, Bagwell CL, Barkley RA, Murphy KR. Accuracy of self-evaluation in adults with ADHD: evidence from a driving study. Journal of Attention Disorders. 2005;8:221–234. doi: 10.1177/1087054705280159. [DOI] [PubMed] [Google Scholar]
- Kornbrot DE. Signal detection theory, the approach of choice: model-based and distribution-free measures and evaluation. Perception and Psychophysics. 2006;68:393–414. doi: 10.3758/BF03193685. [DOI] [PubMed] [Google Scholar]
- Laruelle M. The second revision of the dopamine theory of schizophrenia: implications for treatment and drug development. Biological Psychiatry. 2013;74:80–81. doi: 10.1016/j.biopsych.2013.05.016. [DOI] [PubMed] [Google Scholar]
- Lou HC, Skewes JC, Thomsen KR, Overgaard M, Lau HC, Mouridsen K, Roepstorff A. Dopaminergic stimulation enhances confidence and accuracy in seeing rapidly presented words. Journal of Vision. 2011;11:15. doi: 10.1167/11.2.15. [DOI] [PubMed] [Google Scholar]
- Lysaker PH, Dimaggio G, Carcione A, Procacci M, Buck KD, Davis LW, Nicolò G. Metacognition and schizophrenia: the capacity for self-reflectivity as a predictor for prospective assessments of work performance over six months. Schizophrenia Research. 2010;122:124–130. doi: 10.1016/j.schres.2009.04.024. [DOI] [PubMed] [Google Scholar]
- McCurdy LY, Maniscalco B, Metcalfe J, Liu KY, de Lange FP, Lau H. Anatomical coupling between distinct metacognitive systems for memory and visual perception. Journal of Neuroscience. 2013;33:1897–1906. doi: 10.1523/JNEUROSCI.1890-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mehta MA, Montgomery AJ, Kitamura Y, Grasby PM. Dopamine D2 receptor occupancy levels of acute sulpiride challenges that produce working memory and learning impairments in healthy volunteers. Psychopharmacology. 2008;196:157–165. doi: 10.1007/s00213-007-0947-0. [DOI] [PubMed] [Google Scholar]
- Meyniel F, Sigman M, Mainen ZF. Confidence as bayesian probability: from neural origins to Behavior. Neuron. 2015;88:78–92. doi: 10.1016/j.neuron.2015.09.039. [DOI] [PubMed] [Google Scholar]
- Moran R, Teodorescu AR, Usher M. Post choice information integration as a causal determinant of confidence: novel data and a computational account. Cognitive Psychology. 2015;78:99–147. doi: 10.1016/j.cogpsych.2015.01.002. [DOI] [PubMed] [Google Scholar]
- Morey RD, Rouder JN. BayesFactor. Version 0.9.11-32015
- Peretti CS, Danion JM, Kauffmann-Muller F, Grangé D, Patat A, Rosenzweig P. Effects of haloperidol and amisulpride on motor and cognitive skill learning in healthy volunteers. Psychopharmacology. 1997;131:329–338. doi: 10.1007/s002130050300. [DOI] [PubMed] [Google Scholar]
- Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442:1042–1045. doi: 10.1038/nature05051. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pleskac TJ, Busemeyer JR. Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. Psychological Review. 2010;117:864–901. doi: 10.1037/a0019737. [DOI] [PubMed] [Google Scholar]
- Ramaekers JG, Louwerens JW, Muntjewerff ND, Milius H, de Bie A, Rosenzweig P, Patat A, O'Hanlon JF. Psychomotor, Cognitive, extrapyramidal, and affective functions of healthy volunteers during treatment with an atypical (amisulpride) and a classic (haloperidol) antipsychotic. Journal of Clinical Psychopharmacology. 1999;19:209–221. doi: 10.1097/00004714-199906000-00003. [DOI] [PubMed] [Google Scholar]
- Rigoli F, Rutledge RB, Chew B, Ousdal OT, Dayan P, Dolan RJ. Dopamine increases a Value-Independent gambling propensity. Neuropsychopharmacology. 2016;41:2658–2667. doi: 10.1038/npp.2016.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review. 2009;16:225–237. doi: 10.3758/PBR.16.2.225. [DOI] [PubMed] [Google Scholar]
- Silver JA, Hughes JD, Bornstein RA, Beversdorf DQ. Effect of anxiolytics on cognitive flexibility in problem solving. Cognitive and Behavioral Neurology. 2004;17:93–97. doi: 10.1097/01.wnn.0000119240.65522.d9. [DOI] [PubMed] [Google Scholar]
- Sokolov EN, Spinks JA, Näätänen R, Lyytinen H. The Orienting Response in Information Processing. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers; 2002. [Google Scholar]
- Song C, Kanai R, Fleming SM, Weil RS, Schwarzkopf DS, Rees G. Relating inter-individual differences in metacognitive performance on different perceptual tasks. Consciousness and Cognition. 2011;20:1787–1792. doi: 10.1016/j.concog.2010.12.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Spence ML, Dux PE, Arnold DH. Computations underlying confidence in visual perception. Journal of Experimental Psychology: Human Perception and Performance. 2016;42:671–682. doi: 10.1037/xhp0000179. [DOI] [PubMed] [Google Scholar]
- Strange BA, Dolan RJ. Beta-adrenergic modulation of emotional memory-evoked human amygdala and hippocampal responses. PNAS. 2004;101:11454–11458. doi: 10.1073/pnas.0404282101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Strange BA, Hurlemann R, Dolan RJ. An emotion-induced retrograde amnesia in humans is amygdala- and beta-adrenergic-dependent. PNAS. 2003;100:13626–13631. doi: 10.1073/pnas.1635116100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ullsperger M, Harsay HA, Wessel JR, Ridderinkhof KR. Conscious perception of errors and its relation to the anterior insula. Brain Structure and Function. 2010;214:629–643. doi: 10.1007/s00429-010-0261-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Usher M, Cohen JD, Servan-Schreiber D, Rajkowski J, Aston-Jones G. The role of locus coeruleus in the regulation of cognitive performance. Science. 1999;283:549–554. doi: 10.1126/science.283.5401.549. [DOI] [PubMed] [Google Scholar]
- Varazzani C, San-Galli A, Gilardeau S, Bouret S. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. Journal of Neuroscience. 2015;35:7866–7877. doi: 10.1523/JNEUROSCI.0454-15.2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology. 1988;54:1063–1070. doi: 10.1037/0022-3514.54.6.1063. [DOI] [PubMed] [Google Scholar]
- Wechsler D. Wechsler Abbreviated Scale of Intelligence. New York: The Psychological Corporation: Harcourt Brace and Company; 1999. [Google Scholar]
- Weil LG, Fleming SM, Dumontheil I, Kilford EJ, Weil RS, Rees G, Dolan RJ, Blakemore SJ. The development of metacognitive ability in adolescence. Consciousness and Cognition. 2013;22:264–271. doi: 10.1016/j.concog.2013.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wells A. Metacognitive Therapy for Anxiety and Depression, Reprint Edition. New York, NY: Guilford Press; 2011. [Google Scholar]
- Wright ND, Edwards T, Fleming SM, Dolan RJ. Testosterone induces off-line perceptual learning. Psychopharmacology. 2012;224:451–457. doi: 10.1007/s00213-012-2769-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yamamoto K, Hornykiewicz O. Proposal for a noradrenaline hypothesis of schizophrenia. Progress in Neuro-Psychopharmacology and Biological Psychiatry. 2004;28:913–922. doi: 10.1016/j.pnpbp.2004.05.033. [DOI] [PubMed] [Google Scholar]
- Yu AJ, Dayan P. Uncertainty, neuromodulation, and attention. Neuron. 2005;46:681–692. doi: 10.1016/j.neuron.2005.04.026. [DOI] [PubMed] [Google Scholar]