Abstract
Neuroscience has made considerable progress in understanding the neural substrates supporting cognitive performance in a number of domains, including memory, perception and decision-making. In contrast, how the human brain generates metacognitive awareness of task performance remains unclear. Here, we address this question by asking participants to perform perceptual decisions while providing concurrent metacognitive reports, during fMRI scanning. We show that activity in right rostrolateral prefrontal cortex (rlPFC) satisfies three constraints for a role in metacognitive aspects of decision-making. Right rlPFC showed greater activity during self-report compared to a matched control condition; activity in this region correlated with reported confidence; and the strength of the relationship between activity and confidence predicted metacognitive ability across individuals. In addition, functional connectivity between right rlPFC and both contralateral PFC and visual cortex increased during metacognitive reports. We discuss these findings in a theoretical framework where rlPFC re-represents object-level decision uncertainty to facilitate metacognitive report.
INTRODUCTION
Accounting for the presence, or absence, of self-knowledge in simple cognitive tasks is a conundrum in cognitive science (Wilson and Dunn, 2004). In several areas of inquiry metacognition of performance is a central object of study: subjects often know when they have made an error (Rabbitt and Rodgers, 1977), appropriately scale confidence to reflect performance (Harvey, 1997) and exploit awareness of performance through advantageous wagering (Kunimoto, 2001; Persaud et al., 2007). However, these assessments vary in their accuracy, such that errors can be committed in the absence of awareness (Nieuwenhuis et al., 2001), and external manipulations of choice sometimes go unnoticed (Logan et al., 2010; Johansson et al., 2005). An influential model of metacognition postulates a dissociation between the “object” level cognition, and the “meta” level, conceptualised as monitoring and controlling the object level (Nelson & Narens, 1990). Neuropsychological cases reveal dissociations between these levels (see Fleming & Dolan, in press, for a review), raising the question as to the neural mechanisms underlying metacognition in healthy individuals.
In healthy individuals, performance on a particular cognitive task, and metacognition of performance, are usually tightly coupled. For instance, knowing the answer to a question will tend to be accompanied by knowing that one knows the answer. Such a close relationship requires careful control over task performance in order to isolate a metacognitive component of behaviour. Recently, by employing such a level of control, several studies have found that, during perceptual decision-making, rostrolateral and dorsolateral prefrontal cortex (PFC) are key brain areas mediating individual differences in metacognitive accuracy. The extent to which confidence tracks performance in a visual detection task is correlated both with greater grey matter volume in anterior PFC (lateral BA10) and greater white-matter callosal density in tracts that connect to this region (Fleming et al., 2010a). In a related study employing functional brain imaging (fMRI), activation in right posterior-lateral BA10 correlated with metacognitive accuracy across individuals (Yokoyama et al., 2010). Furthermore, disrupting dorsolateral PFC using TMS decreases metacognitive ability without impacting on task performance (Rounis et al., 2010), indicating a causal role for anterior PFC in metacognitive accuracy. However, the function of candidate prefrontal regions in metacognitive judgments of decision-making is unknown.
Here we propose three criteria to triangulate brain region(s) functionally involved in metacognitive reports. First, activity should increase during metacognitive ratings compared to a matched control condition (Yokoyama et al., 2010). Second, this activity should correlate with subjective confidence. Based on previous studies of confidence in recognition memory (Henson et al., 2000; Fleck et al., 2006) and the link between rostrolateral PFC recruitment and uncertainty of judgment in reasoning tasks (Christoff & Gabrielli, 2000), we expected this correlation to be negative. Third, the relationship between activity and confidence should relate to metacognitive ability (how closely confidence tracks decision performance) across individuals. Here, we implement such an approach and in so doing show that activity in right rostrolateral PFC satisfies each of these constraints.
METHODS
Subjects
Subjects were recruited by advertisement on Gumtree and from the University College London online subject pool. 26 subjects (12 males; age 19-52 years; mean age 28.3 years) gave written informed consent to take part in the experiment. We excluded 3 subjects from further analysis due to type 1 d’ scores greater than 2 standard deviations from the group mean. 23 subjects were included in the remaining analyses (10 males; age 19-48 years; mean age 26.5 years). All subjects had normal or corrected-to-normal vision and no history of neurological or psychiatric illness. The study was approved by the Institute of Neurology (University College London) Research Ethics Committee.
Stimuli
Stimuli were adapted from methods and image sets documented previously (Fleming et al., 2010b). We used a set of 10 neutral faces (5 male, 5 female) taken from the Karolinska Directed Emotional Faces set and 10 houses (photographed by SMF). The stimuli were cropped to be of equal size and converted to grayscale. Fourier transforms of each image were computed, producing 20 magnitude and 20 phase matrices, and the average magnitude matrix of all stimuli was stored. On each trial, the phase matrix of a single face or house image plus a variable proportion of white noise (P(noise)) was then recombined with the average magnitude matrix, such that P(image) = 1-P(noise).
Face and house stimuli appeared in a random sequence, and the difficulty of each trial was controlled through use of a one-up two-down staircase procedure as used previously (Fleming et al., 2010a). After two consecutive correct responses, the amount of noise added to the image was increased by one step; after one incorrect response, the amount of noise was decreased by one step. P(noise) was adjusted in stepsizes of 0.01.
Independent staircases were maintained for face and house images. The aim of the staircase procedure was to equate objective performance across individuals, thus rendering metacognitive accuracy unconfounded by variation in task performance.
Task and procedure
Prior to entering the scanner, participants were familiarised with the task and confidence rating scale. Instructions emphasised that confidence ratings should reflect relative confidence, as due to the difficult nature of the task they were unlikely to be absolutely certain of their decision. During the structural scan at the start of the experiment, participants carried out 200 trials of face/house judgments (without confidence ratings) to allow the staircase parameter to stabilise. The main experiment consisted of four scanner runs, each containing 75 trials. These 75 trials were further subdivided into mini-blocks where subjects either reported their decision confidence (report condition, 10 trials) or placed the confidence cursor in the zone indicated by the computer (follow condition, 5 trials). Each run began with the report condition.
Each trial consisted of the following events in sequence (see Fig. 1). A fixation cross was presented for 500ms, followed by a face or house image for 100ms. The participant then had 1500 ms to indicate whether the stimulus was a face or house by pressing one of two buttons with their right hand. A square red frame appeared for 500 ms around their selected choice. No feedback was given as to whether the perceptual decision was correct or incorrect. In the report condition, participants then indicated their decision confidence on a sliding scale, using the same two response buttons to move the cursor up or down the scale. Arbitrary scale values of 1-6 were marked on the scale at equal spacings. The confidence scale accepted participants’ input for 3500 ms, followed by a change in cursor colour from white to red to confirm the rating (500 ms). The final cursor position was recorded as a continuous variable on each trial. The initial cursor position on each trial was randomly jittered around the midpoint of the scale (±12% of scale length) to discourage advance motor preparation of the confidence response.
Fig. 1.
Perceptual decision task. On each trial, participants were asked to categorise a noisy image as either a face or a house by pressing one of two buttons held in their right hand. In the report condition, post-decision confidence was indicated using a sliding scale. In the follow condition, participants were instructed to slide the cursor into the zone indicated by the two vertical lines. After 3.5 s, the cursor changed colour to indicate the participant’s selected rating.
Fig. 2.
Behavioural results. A) Performance split according to reported confidence (calculated from subject-specific tertiles). B) Perceptual task performance (d’) as a function of metacognition task condition. Error bars in (A) and (B) reflect the standard error of the mean. C) Plot of the relationship between metacognitive accuracy (Aroc) and percent correct on report trials, with participants ordered such that Aroc increases from left to right.
Fig. 3.
fMRI results. A) Activation in the contrasts report > follow (hot colours) and follow > report (cool colours) displayed at P < 0.001, uncorrected. Significant clusters corrected for multiple comparisons at P < 0.05 are listed in Table 1.
In the follow condition, participants were asked to place the cursor in the zone indicated by the computer, specified by two vertical blue lines, instead of rating their decision confidence. The follow condition was yoked to the report condition such that half of the previous 10 report ratings were randomly selected to specify the current block of follow target positions.
After the main experiment, subjects passively viewed clear images of faces and houses as a localiser for category-specific extrastriate visual regions. As our initial whole-brain analyses did not find effects in visual cortex, we do not analyse these data further here.
Additional behavioural measures
Following scanning, participants completed the short version of the Wechsler Abbreviated Intelligence Scale (WASI; Wechsler, 1999) and the Beck Cognitive Insight Scale (BCIS; Beck et al., 2004). The short version of the WASI consists of the Vocabulary and Matrix Reasoning subscales. Here we focus on the matrix subscale, a non-verbal measure of fluid intelligence (g) that is hypothesised to be prefrontal-dependent (e.g. Roca et al., 2010), and assess the correlation between matrix score and metacognitive accuracy. One outlying subject (WASI score more than 2 SD below the mean) was excluded from this analysis.
The BCIS was originally developed for use with individuals with psychotic disorders but recent studies suggest it is a valid measure of degree of insight in healthy populations (Riggs et al., 2010). The self-reflectiveness subscale measures willingness to acknowledge fallibility, whereas the self-certainty subscale measures certainty about one’s beliefs and judgments. A composite cognitive insight score is derived by subtracting the self-certainty score from the self-reflectiveness score (Riggs et al., 2010). Here we report the correlation between the composite cognitive insight score and metacognitive accuracy.
fMRI acquisition
Brain images were acquired using a 3T Allegra scanner (Siemens, Erlangen, Germany). BOLD-sensitive functional images were acquired using a gradient-echo EPI sequence (48 transverse slices; TR, 2.88 s; TE, 30 ms; 3 × 3mm in-plane resolution; 2mm slice thickness; 1mm gap between adjacent slices; z-shim, −0.4mT/m*ms; positive phase encoding direction; slice tilt, −30°) optimized for detecting changes in the amygdala and OFC (Weiskopf et al., 2006). The main experiment consisted of four runs of 202 volumes, and the localizer task consisted of a single run of 81 volumes. We also collected a T1-weighted anatomical scan and local field maps for each subject.
Behavioural data analysis
Perceptual performance was assessed using type 1 signal detection theory (SDT; Green and Swets, 1966). We calculated sensitivity (d’) and bias (c) as follows:
where z indicates the inverse of the cumulative normal distribution, and H = p(response = face | stimulus = face) and FA = P(response = face | stimulus = house).
Metacognitive ability (Aroc) was calculated as documented previously (Fleming et al., 2010a) by calculating the area under the type 2 receiver operating characteristic (ROC) using nonparametric methods (Kornbrot, 2006). Continuous confidence ratings were first binned into six quantiles. To plot the ROC, hi = p(confidence = i|correct) and fi = p(confidence = i|incorrect) were calculated for all i, transformed into cumulative probabilities and plotted against each other. ROC curves were anchored at [0,0]. An ROC curve that bows sharply upwards indicates that the probability of being correct rises rapidly with confidence; conversely, a flat ROC function indicates a weak link between confidence and accuracy. We note that type 2 ROC area is also affected by type 1 d’ and criterion (Galvin et al., 2003; Maniscalco & Lau, 2011). Here, use of a 2-alternative forced choice (2AFC) design and a continuous staircase permitted tight control over these factors, dissociating metacognitive ability from type 1 performance. The fit of the type 2 SDT model was assessed via the following linear regression model (Macmillan and Creelman, 2005):
Behavioural data analysis was carried out using SPSS 17.0. Statistical tests employed are indicated at the appropriate place in Results.
fMRI preprocessing and analysis
All imaging analysis was carried out using SPM8 (Statistical Parametric Mapping; www.fil.ion.ucl.ac.uk/spm). The first five volumes of each run were discarded to allow for T1 equilibration. Functional images were realigned and unwarped using collected field maps (Andersson et al., 2001). Each participant’s structural image was segmented into grey matter, white matter and cerebral spinal fluid images using a nonlinear deformation field to map it onto template tissue probability maps (Ashburner and Friston, 2005). This mapping was applied to both structural and functional images to create spatially normalised images. Normalisation is to Montreal Neurological Institute (MNI) space. Normalised images were spatially smoothed using a Gaussian kernel with full-width at half-maximum of 8 mm.
fMRI timeseries were regressed onto a General Linear Model (GLM) containing stick (delta) functions representing the onset of the stimulus, and boxcar functions spanning the time of the confidence rating. Separate regressors aligned to stimulus onset modelled face and house trials, each parametrically modulated by P(image). The confidence rating boxcar was separated into three regressors: report following a “face” response, report following a “house” response, and follow; each was parametrically modulated by the selected confidence rating, plus its quadratic expansion (Model 1). Regressors were convolved with a canonical hemodynamic response function (HRF). Motion correction parameters estimated from the realignment procedure were entered as covariates of no interest. Low frequency drifts were excluded with a high-pass filter (128s cutoff).
We specified two additional GLMs to assess alternative explanations of confidence-related activity. Model 2 separated the confidence-rating regressor into correct and incorrect trials, each parametrically modulated by reported confidence. Model 3 added type 1 RT as a parametric modulator of the confidence-rating regressors of Model 1, such that confidence ratings were orthogonalised with respect to reaction time.
Statistical inference
Single-subject contrast images were entered into a second-level random effects analysis using one-sample t-tests against zero to assess group-level significance. All reported activations survive P < 0.05, corrected at the cluster level for multiple comparisons using a cluster-defining threshold of P < 0.001, uncorrected. Follow-up region of interest (ROI) analyses were carried out to document patterns of activation across conditions. Between-subjects correlations between brain activity and behaviour were carried out by calculating the Pearson product-moment correlation between the average confidence beta on report trials for each PFC ROI (see below) and each individual’s Aroc. Activations are displayed at the cluster-defining threshold of P < 0.001, uncorrected, using MRIcro (http://www.cabiatl.com/mricro/mricro/index.html) and Caret (Van Essen et al., 2001; http://www.nitrc.org/projects/caret/) software.
Region of interest analysis
Regions of interest (ROIs) were specified in right and left rlPFC and right PPC using the clusters shown in Fig. 4A (negative confidence on report trials masked by report > follow, at P < 0.001, uncorrected). These clusters were transformed into binary mask images using MarsBar (http://marsbar.sourceforge.net). The dorsal anterior cingulate (dACC) cluster extended into dorsal premotor cortex, thus to maintain anatomical specificity here we defined a region of interest as a 6mm-radius sphere centered on the peak voxel in dACC [−9 17 46]. Parameter estimates and timecourses averaged across all voxels in each mask were extracted using the rfxplot 2nd-level analysis toolbox (http://rfxplot.sourceforge.net; Gläscher, 2009).
Fig. 4.
fMRI results. A) Activation correlating negatively with confidence on report trials, inclusively masked by report > follow. All clusters are significant at P < 0.05, corrected for multiple comparisons; images are displayed at P < 0.001, uncorrected. B) Parameter estimates for the correlation between confidence and activity in each region of interest (ROI), split according to condition. Grey bars (report condition) are displayed only to indicate effects of equal magnitude on face and house trials, significance having been previously established in the SPM from part (A). No correlation with confidence was seen in these ROIs on follow trials (white bars; one-sample t-test against zero, P > 0.1). Error bars reflect the standard error of the mean. C) Timecourses from each ROI are shown separated as a function of confidence and condition, illustrating dual effects in these regions (greater activity during report, and response to confidence during report). Shaded areas reflect the standard error of the mean.
Connectivity analysis
To explore regional changes in connectivity between right rlPFC and other brain regions during metacognitive report we carried out a psychophysiological interaction (PPI) analysis (Friston et al., 1997). PPI is a measure of context-dependent connectivity, explaining the regional activity of other brain regions in terms of the interaction between responses in a seed region (here, right rlPFC) and a cognitive or sensory process. A new design matrix was constructed that modelled the task as a block design, with separate regressors encoding report and follow blocks. To simplify the PPI model we concatenated across sessions, modelling session effects with the manual entry of constant terms. We carried out PPI analysis using the Generalised PPI toolbox (gPPI; http://www.nitrc.org/projects/gppi). gPPI creates a new GLM in which the deconvolved activity of the seed region is assigned to separate regressors dependent on the status of the original psychological variable (report or follow), and reconvolved with the haemodynamic response function (HRF). Regional timecourses were extracted from the right rlPFC ROI as defined above. The main effects of report and follow, the seed region timecourse and motion parameters were included as regressors of no interest. The PPI contrast compares report*rlPFC (+1) with follow*rlPFC (-1). The resultant activation map reflects activity that is systematically increased in connectivity with rlPFC during report compared to follow trials (Fig. 5)
Fig. 5.
Individual difference and connectivity analyses. The top panel illustrates the significant correlation between confidence-related activity in right rlPFC and metacognitive accuracy across subjects. The bottom panel depicts results of an exploratory psychophysiological interaction (PPI) analysis (displayed at P < 0.001, uncorrected), revealing whole-brain corrected (P < 0.05) increases in connectivity between right rlPFC and visual cortex (lingual gyrus), and between right rlPFC and left dorsolateral prefrontal cortex (dlPFC), in report compared to follow trials.
RESULTS
We scanned 23 participants while they carried out a perceptual decision task followed by ratings of decision confidence (see Fig. 1). We used a psychophysical staircase procedure coupled with post-decision confidence ratings to dissociate metacognitive assessments of performance – type 2 sensitivity - from performance itself, or type 1 sensitivity (Fleming et al., 2010a). We carried out three nested fMRI analyses: first, we identified brain regions increasing in activity for report compared to follow trials; second, we analysed the activity of these regions for a correlation with confidence on report trials; finally, we examined the relationship between confidence-related activity and metacognitive ability across individuals. After isolating a region of rostrolateral PFC that satisfies these 3 criteria, we go on to carry out an exploratory connectivity analysis seeded in rlPFC to identify candidate inter-relationships between brain regions during metacognitive reports.
Behaviour
Analysis of perceptual performance showed that performance was well controlled by the staircase during scanning (mean % correct = 70.6 ± 3.2 sd). Importantly, type 1 d’ was similar for both report (mean = 1.16 ± 0.25 sd) and follow (mean = 1.14 ± 0.28 sd) trials (paired t-test, t(22) = 0.23, P = 0.82). This equivalence ensures that differences in brain activity between these conditions are not due to variation in perceptual task performance. Decision criteria (c) were not significantly different from zero (mean = −0.0064; one-sample t-test t(22) = −0.27, P = 0.79), indicating that subjects gave a relatively equal proportion of face and house responses.
On average, participants’ post-decision confidence ratings tend to increase with task performance, demonstrating good monitoring despite an absence of explicit feedback (Fig. 2A). To quantify individual differences in metacognitive ability, we calculated the area under the type 2 ROC (Aroc) using nonparametric methods (Kornbrot, 2006), as documented previously (Fleming et al., 2010a; Song et al., 2011). Aroc is a bias-free measure of a participant’s ability to link performance to confidence. A type 2 ROC model provided an excellent fit to the confidence rating data (mean R2 = 0.98). Aroc was independent of performance as measured by perceptual threshold (r = −0.063; P = 0.78; Fig. 2C) and report-trial type 1 d’ (r = 0.19, P = 0.38), replicating previous findings of a separation between task performance and metacognitive ability (Fleming et al., 2010a; Song et al., 2011). We additionally examined whether metacognitive ability was associated with global measures of executive function and personality (see Methods). Aroc was positively but non-significantly correlated with fluid intelligence as measured by the Matrix Reasoning subscale of the Wechsler Abbreviated Scale of Intelligence (Wechsler, 1999) (r = 0.19; P = 0.38); prediction of Aroc by “cognitive insight” as measured by the Beck Cognitive Insight Scale (Beck et al., 2004) was also non-significant (r = −0.19, P = 0.37).
The relationship between confidence and reaction time (RT) is complicated (see Pleskac and Busemeyer, 2010, for a review), but in general higher confidence is associated with faster RTs. In accordance with this prediction, RTs were negatively correlated with reported confidence (mean r = −0.32 ± 0.09 sd). RTs for perceptual decisions were systematically slower on incorrect (mean = 1087 ms) compared to correct trials (mean = 971 ms; paired t-test, t(22) = 10.95, P < 0.001). However, the difference in RT between correct and incorrect trials was non-significantly related to metacognitive ability across subjects (r = 0.26; P = 0.24), rendering it unlikely that subjects directly monitored their type 1 RT to gain insight into decision accuracy. Instead, our behavioural data support an account where above-chance metacognitive ability is supported by trial-to-trial access to decision uncertainty. We next turn to our fMRI data to determine the neural basis of such a representation.
Confidence-related activity
When contrasting report > follow we observed increased activity in right rostrolateral PFC (rlPFC) and dorsal anterior cingulate cortex (dACC). This contrast isolates areas of increased activity when participants rated confidence in their decision compared to following the computer (Fig. 3 and Table 1). Increased activity was seen in the reverse contrast (follow > report) in a network of occipital and medial frontal regions (Fig. 3 and Table 1), which may reflect activation of the “task-negative” network during the less demanding control condition (Andrews-Hanna, 2011).
Table 1.
Summary of significant activations for the report > follow and the follow > report contrast as reported in the main text (cluster-defining threshold P < 0.001, uncorrected; all reported activations are corrected for multiple comparisons at P < 0.05)
| Contrast | Label | Voxels at P <0.001 |
Peak Z score | P (Cluster FWE corrected) |
Peak Voxel MNI Coordinates |
Laterality |
|---|---|---|---|---|---|---|
| Report > follow | dACC | 421 | 5.38 | < 0.001 | −3, 14, 46 | L/R |
| rlPFC (MFG) | 73 | 5.10 | 0.040 | 36, 44, 28 | R | |
|
| ||||||
| Follow > report | Occipital cortex | 1894 | 6.79 | < 0.001 | −30, −88, 7 | L |
| Occipital cortex | 1827 | 6.74 | < 0.001 | 36, −85, −8 | R | |
| Supramarginal gyrus |
420 | 5.07 | < 0.001 | −57, −28, 34 | L | |
| vmPFC | 921 | 5.06 | < 0.001 | −6, 62, −11 | L/R | |
| Posterior cingulate |
561 | 4.57 | < 0.001 | 0, −46, 34 | L/R | |
| Cerebellum | 104 | 4.71 | 0.010 | 15, −76, −41 | R | |
| Posterior parietal cortex |
77 | 4.28 | 0.033 | 24, −49, 64 | R | |
| Anterior temporal lobe |
121 | 4.15 | 0.005 | 60, −13, −14 | R | |
FWE, family wise error; MNI, Montreal Neurological Institute; dACC, dorsal anterior cingulate cortex; rlPFC, rostrolateral prefrontal cortex; MFG, middle frontal gyrus; vmPFC, ventromedial prefrontal cortex.
To identify activity satisfying our first two criteria for a role in metacognitive report (active in report > follow and covariation with reported confidence), we tested for correlations between activity and confidence on report trials (using a parametric modulation analysis), masked by the previous report > follow contrast (using an inclusive masking threshold of P < 0.05, uncorrected). Negative correlations with confidence were seen in dACC, right posterior parietal cortex (R-PPC), and bilateral rlPFC (all clusters P < 0.05, corrected for multiple comparisons within mask volume; Fig. 4A and Table 2). No activity was found to correlate positively with reported confidence.
Table 2.
Summary of significant activations correlating negatively with reported confidence (cluster-defining threshold P < 0.001, uncorrected; all reported activations are corrected for multiple comparisons at P < 0.05), inclusively masked by report > follow (P < 0.05, uncorrected).
| Label | Voxels at P <0.001 |
Peak Z score | P (Cluster FWE corrected) |
Peak voxel MNI Coordinates |
Laterality |
|---|---|---|---|---|---|
| dACC/pre-SMA | 371 | 4.91 | < 0.001 | 30, 2, 64 | L/R |
| Posterior parietal cortex |
122 | 4.90 | 0.002 | 15, −73, 43 | R |
| rlPFC (MFG) | 81 | 4.79 | 0.018 | −33, 44, 28 | L |
| rlPFC (MFG) | 75 | 4.06 | 0.024 | 27, 53, 25 | R |
FWE, family wise error; MNI, Montreal Neurological Institute; dACC, dorsal anterior cingulate cortex; pre-SMA, pre-supplementary motor area; rlPFC, rostrolateral prefrontal cortex; MFG, middle frontal gyrus.
To determine the specificity of the relationship between confidence and PFC activity, we specified functional ROIs based on the correlation with confidence on report trials (Fig. 4B). Follow confidence betas did not significantly differ from zero in these regions (one-sampled t-tests, t(22) < 1.6; P > 0.1). This result indicates that simply using the confidence scale (in the follow condition) is not sufficient to modulate activity in R-PPC, dACC and rlPFC. Instead, this pattern of activity is consistent with a role for these regions in representing confidence during the report condition. Timecourses from each ROI separated by confidence and condition are displayed in Fig. 4C, illustrating the dual effects seen in these regions (greater activity during report, and response to confidence during report).
Finally, we tested our third criterion: prediction of metacognitive ability (Aroc) across subjects. For each subject, we examined the relationship between the confidence beta on report trials (averaged across face and house) and Aroc, for each region of interest defined above. As the confidence beta is already negative, a stronger correlation between confidence and brain activity is expressed as a more negative relationship. Thus, we expected a negative correlation between metacognitive ability and confidence-related activity. Indeed, in right rostrolateral PFC, we found a significant negative correlation between the confidence beta and Aroc (r = −0.47, P = 0.025; Fig. 5), which remained after controlling for report-trial type 1 d’ (partial r = −0.46, P = 0.032). No significant correlation was found in left rlPFC (r = 0.024, P = 0.91). Correlations in dACC and rPPC were also negative, but did not reach individual significance (dACC, r = −0.22, P = 0.32; R-PPC, r = −0.28, P = 0.19). We note that testing for regional correlations was carried out without correction for multiple comparisons, and thus a positive result here should be tempered by this caveat.
We specified two additional GLMs to assess alternative explanations of confidence-related activity in right rlPFC (see Methods). Activity did not differentiate between error and correct trials per se (Fig. 6; t(22) = 1.45; P = 0.16). Further, there was no significant difference between confidence betas on correct compared to incorrect trials (t(22) = 0.18; P = 0.86) and confidence was significantly correlated with activity on both trial types (one-tailed t-test against zero; both P < 0.05). Model 3 orthogonalised confidence with respect to reaction time (RT), to assess whether reaction time could account for the effect we observe in rlPFC. The effect of reported confidence remained after controlling for the variance in activity accounted for by RT (Fig. 6; t(22) = 2.35, P = 0.028).
Fig. 6.
Analysis of right rlPFC activity using alternative GLMs (see Methods). A) Model 2 separated trials into correct and incorrect, to assess whether error-related activity could account for effects of confidence. Parameter estimates (arbitrary units) are shown both for average activity during confidence rating (light grey) and the confidence parametric modulator (dark grey). Neither comparison revealed significant differences between correct and incorrect trials. B) Model 3 orthogonalised confidence with respect to reaction time (RT), demonstrating that the effect of reported confidence remained after controlling for the variance in activity accounted for by RT. **, P < 0.01; *, P < 0.05. Error bars reflect the standard error of the mean.
Functional connectivity
Our previous analyses revealed right rlPFC as satisfying our three constraints for a role in metacognitive task performance. We next explored the connectivity of this region using a psychophysiological interaction (PPI) analysis (Friston et al., 1997). This analysis isolated brain regions that selectively increased in connectivity with right rlPFC during report compared to follow trials (Fig. 5). We found significant increases in connectivity with contralateral PFC and occipital cortex (P < 0.05, corrected for multiple comparisons; Table 3). Additional activations were observed in primary and extrastriate visual cortex that did not survive correction for multiple comparisons (P < 0.001, uncorrected; see Fig. 5). Together this pattern of connectivity is consistent with the proposal that rlPFC integrates visual information during metacognitive report trials.
Table 3.
Summary of significant activations in a PPI examining increases in connectivity with rlPFC for report > follow (cluster-defining threshold P < 0.001, uncorrected; all reported activations are corrected for multiple comparisons at P < 0.05).
| Label | Peak Z score |
P (Cluster FWE corrected) |
Peak Voxel MNI Coordinates |
Laterality |
|---|---|---|---|---|
| Dorsolateral PFC (MFG) | 4.64 | 0.018 | −48, 23, 28 | L |
| Occipital cortex (lingual gyrus) |
4.50 | 0.009 | −12, −85, −8 | L |
FWE, family wise error; MFG, middle frontal gyrus; PFC, prefrontal cortex.
DISCUSSION
Here we show that fMRI activity in right rostrolateral PFC (rlPFC) satisfies three constraints for a role in metacognition of decision-making. Right rlPFC showed greater activity during self-report compared to a matched control condition; activity in rlPFC correlated with reported confidence; and the strength of the relationship between activity and confidence predicted metacognitive ability across individuals. In addition, functional connectivity between right rlPFC and both contralateral PFC and visual cortex increased during metacognitive reports.
Our work complements and extends previous studies implicating a dependence of metacognitive ability on anterior PFC structure and function (Rounis et al., 2010; Fleming et al., 2010a; Yokoyama et al., 2010). These studies identified candidate brain regions in rlPFC mediating metacognitive accuracy, but the functional role of this region in metacognition has remained unclear. By identifying a correlation between rlPFC activity and confidence that is specific to metacognitive reports, our findings may explain why damage to this region (Pannu & Kaszniak, 2005), or subclinical variation in structure (Fleming et al., 2010a), lead to altered correspondence between confidence and behaviour.
Previous studies of the neural substrates of decision confidence have directly manipulated perceptual decision difficulty (Kepecs et al., 2008; Kiani and Shadlen, 2009; Rolls et al., 2010). Kiani and Shadlen showed that monkeys could choose to “opt-out” of a perceptual decision in a situation where evidence was weak, a choice predicted by firing rates of neurons in lateral intraparietal area (LIP) involved in the perceptual decision itself (Kiani and Shadlen, 2009). Similarly, firing rates in rat orbitofrontal cortex (Kepecs et al., 2008) and the fMRI signal in human ventromedial PFC (Rolls et al., 2010) encode choice difficulty as predicted by an attractor model of the decision process (Insabato et al., 2010). These data suggest a fine-grained neural representation of choice difficulty integral to the decision process. However, in the absence of concurrent reports of decision confidence (e.g. post-decision wagers) it is difficult to assess the specificity with which this activity relates to confidence per se (Kepecs and Mainen, in press). Instead, we suggest that these studies reveal neural representations of object-level task uncertainty that may be then re-represented for use in metacognitive report. The mechanism underlying this process, particularly across different species, remains an open question. Our finding that connectivity between right rlPFC and visual cortex is increased during metacognitive reports is indicative of such re-representation in humans.
A role in metacognition is consistent with an anatomical positioning of rlPFC at the top of a cognitive hierarchy, and the fact it receives information from dorsolateral prefrontal, cingulate and anterior temporal cortex (Ramnani and Owen, 2004). Single-unit recordings in monkey frontopolar cortex reveal activity that tracks differences between incorrect and correct trials prior to receipt of feedback (Tsujimoto et al., 2010). Given that the same cells did not encode delivery of fluid reward per se, the authors concluded that monkey anterior PFC plays a role in monitoring self-generated decisions. More broadly, the contribution of rlPFC to metacognition may be to represent internal states in a format suitable for explicit communication. This hypothesis is consistent with the view that rlPFC monitors and manipulates internally-generated information (Christoff and Gabrieli, 2000). Indeed, recent structural brain imaging data indicates that “reality monitoring” and metacognitive ability share a common neural substrate (Buda et al., 2011). We note however that the respective role of rlPFC (BA10) and dlPFC (BA46) in metacognitive ability is not yet clear. For example, in the present study we observed increased connectivity between right rlPFC and left dlPFC (BA46) as a function of metacognitive report. Further studies, perhaps employing single-subject analyses, are required to isolate subregions of anterior PFC critical for metacognition.
Outside of right rlPFC, we found that left rlPFC, dorsal anterior cingulate cortex (dACC) and right posterior parietal cortex (PPC) correlated with confidence on metacognitive report trials. Unlike in right rlPFC, confidence-related activity in these regions did not predict metacognitive ability across individuals. This difference can be explained if we assume activity in these regions correlates with object-level task uncertainty (which on average will be related to reported confidence) but does not directly support meta-level commentaries. This hypothesis is in line with reports that dACC activity increases under conflict and perceptual task difficulty (Heekeren et al., 2008; Ridderinkhof et al., 2004), while PPC is sensitive to risk in economic decision-making (Huettel et al., 2005; Symmonds et al., 2011). The association between individual difference in metacognitive ability and right rlPFC is consistent with previous studies finding predominant involvement of the right side of the brain in metacognition and self-referential insight (Fleming et al., 2010a; Schnyer et al., 2004; Schmitz et al., 2006; Yokoyama et al., 2010). We note that in the present study, metacognitive ability did not significantly correlate with fluid intelligence (g). A recent patient study found that variance in performance on a group of tasks not accounted for by g was associated with lesions to right anterior PFC (Roca et al., 2010). Metacognitive ability may similarly index a capacity that is both partially independent of g and dependent on right PFC.
Whether rlPFC activity plays a role in metacognition in domains outside of evaluation of perceptual decision-making is an open question. Control of rlPFC activity can be achieved through real-time fMRI feedback and self-regulation of attention to internal states (McCaig et al., 2011), supporting a domain-general account of its role in metacognition. Previous studies of recognition memory have shown greater activity in right dorsolateral PFC and posterior parietal cortex for low-confidence responses (Cabeza et al., 2008; Henson et al., 2000; Fleck et al., 2006), and Fleck et al. (2006) showed that confidence-related activity in lateral BA10/46 is found in both memory and decision-making paradigms. However, work examining the neural substrates of metacognition in memory also highlight involvement of medial temporal lobe memory structures alongside PFC (Kim and Cabeza, 2007; Chua et al., 2009) and, particularly for prospective judgments, ventromedial PFC (Pannu and Kaszniak, 2005; Kao et al., 2005). Thus, further comparison of perceptual and mnemonic tasks is required to understand domain-specific and domain-general aspects of the neural substrates of metacognition.
Behaviourally, we replicate previous findings that variation in metacognitive ability can be dissociated from variation in metacognition due to task performance (Song et al., 2011; Maniscalco and Lau, 2011). This distillation of metacognition from other potentially confounding variables leads to a seeming paradox: if to measure metacognition one needs to first discount the influence of first-order behaviour, then the functional benefits of metacognitive capacity would appear moot. Furthermore, adjustments in task control can be carried out in the absence of awareness of task performance (van Gaal et al., 2008). One intriguing hypothesis is that metacognitive ability instead facilitates social communication. We note a recent study of decision-making found that cooperative benefit could be achieved in a perceptual decision task by sharing reports of decision confidence (Bahrami et al., 2010), and the ability to reap cooperative benefit presumably requires accurate awareness of task performance (Frith and Frith, 2012). Situating our evolving mechanistic understanding of metacognition in a functional context is an important goal for future research.
In summary, our results provide evidence that rlPFC plays a central role in linking decision confidence to metacognitive reports. While confidence in a particular sensory or decision-related state may be represented in a distributed fashion across several brain regions involved in choice (Fiser et al., 2010), such representations do not explain how metacognitive reports of confidence are generated, or why they may vary in their accuracy. Our findings show that the function and connectivity of rlPFC is associated with metacognitive report, potentially explaining why metacognitive deficits are observed following damage to anterior prefrontal cortex.
Acknowledgments
This work was supported by Wellcome Trust Programme Grant 078865/Z/05/Z to RJD and a Sir Henry Wellcome Fellowship to SMF. The Wellcome Trust Centre for Neuroimaging is supported by core funding from the Wellcome Trust 091593/Z/10/Z.
REFERENCES
- Andersson JL, Hutton C, Ashburner J, Turner R, Friston K. Modeling geometric deformations in EPI time series. NeuroImage. 2001;13:903–919. doi: 10.1006/nimg.2001.0746. [DOI] [PubMed] [Google Scholar]
- Andrews-Hanna JR. The Brain’s Default Network and Its Adaptive Role in Internal Mentation. Neuroscientist. 2011 doi: 10.1177/1073858411403316. Epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ashburner J, Friston KJ. Unified segmentation. NeuroImage. 2005;26:839–851. doi: 10.1016/j.neuroimage.2005.02.018. [DOI] [PubMed] [Google Scholar]
- Bahrami B, Olsen K, Latham PE, Roepstorff A, Rees G, Frith CD. Optimally interacting minds. Science. 2010;329:1081–1085. doi: 10.1126/science.1185718. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beck AT, Baruch E, Balter JM, Steer RA, Warman DM. A new instrument for measuring insight: the Beck Cognitive Insight Scale. Schizophrenia Research. 2004;68:319–329. doi: 10.1016/S0920-9964(03)00189-0. [DOI] [PubMed] [Google Scholar]
- Buda M, Fornito A, Bergström ZM, Simons JS. A specific brain structural basis for individual differences in reality monitoring. J Neurosci. 2011;31:14308–14313. doi: 10.1523/JNEUROSCI.3595-11.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cabeza R, Ciaramelli E, Olson IR, Moscovitch M. The parietal cortex and episodic memory: an attentional account. Nat Rev Neurosci. 2008;9:613–625. doi: 10.1038/nrn2459. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Christoff K, Gabrieli J. The frontopolar cortex and human cognition: Evidence for a rostrocaudal hierarchical organization within the human prefrontal cortex. Psychobiology. 2000;28:168–186. [Google Scholar]
- Chua EF, Schacter DL, Sperling RA. Neural correlates of metamemory: a comparison of feeling-of-knowing and retrospective confidence judgments. J Cog Neuro. 2009;21:1751–1765. doi: 10.1162/jocn.2009.21123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fiser J, Berkes P, Orbán G, Lengyel M. Statistically optimal perception and learning: from behavior to neural representations. Trends Cog Sci. 2010;14:119–130. doi: 10.1016/j.tics.2010.01.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleck MS, Daselaar SM, Dobbins IG, Cabeza R. Role of prefrontal and anterior cingulate regions in decision-making processes shared by memory and nonmemory tasks. Cereb Cortex. 2006;16:1623–1630. doi: 10.1093/cercor/bhj097. [DOI] [PubMed] [Google Scholar]
- Fleming SM, Dolan RJ. The neural basis of metacognitive ability. Phil Trans R Soc B. doi: 10.1098/rstb.2011.0417. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Weil RS, Nagy Z, Dolan RJ, Rees G. Relating introspective accuracy to individual differences in brain structure. Science. 2010a;329:1541–1543. doi: 10.1126/science.1191883. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fleming SM, Whiteley L, Hulme OJ, Sahani M, Dolan RJ. Effects of category-specific costs on neural systems for perceptual decision-making. J Neurophys. 2010b;103:3238–3247. doi: 10.1152/jn.01084.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Friston KJ, Buechel C, Fink GR, Morris J, Rolls E, Dolan RJ. Psychophysiological and modulatory interactions in neuroimaging. NeuroImage. 1997;6:218–229. doi: 10.1006/nimg.1997.0291. [DOI] [PubMed] [Google Scholar]
- Frith C, Frith U. Mechanisms of social cognition. Ann Rev Psych. 2012;63:287–313. doi: 10.1146/annurev-psych-120710-100449. [DOI] [PubMed] [Google Scholar]
- Galvin SJ, Podd JV, Drga V, Whitmore J. Type 2 tasks in the theory of signal detectability: discrimination between correct and incorrect decisions. Psych Bull Rev. 2003;10:843–876. doi: 10.3758/bf03196546. [DOI] [PubMed] [Google Scholar]
- Gläscher J. Visualization of group inference data in functional neuroimaging. Neuroinformatics. 2009;7:73–82. doi: 10.1007/s12021-008-9042-x. [DOI] [PubMed] [Google Scholar]
- Green D, Swets J. Signal detection theory and psychophysics. Wiley; New York: 1966. [Google Scholar]
- Harvey N. Confidence in judgment. Trends Cog Sci. 1997;1:78–82. doi: 10.1016/S1364-6613(97)01014-0. [DOI] [PubMed] [Google Scholar]
- Heekeren HR, Marrett S, Ungerleider LG. The neural systems that mediate human perceptual decision making. Nat Rev Neurosci. 2008;9:467–479. doi: 10.1038/nrn2374. [DOI] [PubMed] [Google Scholar]
- Huettel SA, Song AW, McCarthy G. Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J Neurosci. 2005;25:3304–3311. doi: 10.1523/JNEUROSCI.5070-04.2005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Insabato A, Pannunzi M, Rolls ET, Deco G. Confidence-Related Decision Making. J Neurophys. 2010;104:539–547. doi: 10.1152/jn.01068.2009. [DOI] [PubMed] [Google Scholar]
- Johansson P, Hall L, Sikstrom S, Olsson A. Failure to detect mismatches between intention and outcome in a simple decision task. Science. 2005;310:116–119. doi: 10.1126/science.1111709. [DOI] [PubMed] [Google Scholar]
- Kao Y-C, Davis ES, Gabrieli JDE. Neural correlates of actual and predicted memory formation. Nat Neurosci. 2005;8:1776–1783. doi: 10.1038/nn1595. [DOI] [PubMed] [Google Scholar]
- Kepecs A, Uchida N, Zariwala HA, Mainen ZF. Neural correlates, computation and behavioural impact of decision confidence. Nature. 2008;455:227–231. doi: 10.1038/nature07200. [DOI] [PubMed] [Google Scholar]
- Kepecs A, Mainen Z. A computational framework for the study of confidence in humans and animals. Phil. Trans. R. Soc. B. doi: 10.1098/rstb.2012.0037. (in press) [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kiani R, Shadlen M. Representation of confidence associated with a decision by neurons in the parietal cortex. Science. 2009;324:759. doi: 10.1126/science.1169405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kim H, Cabeza R. Trusting our memories: dissociating the neural correlates of confidence in veridical versus illusory memories. J Neurosci. 2007;27:12190–12197. doi: 10.1523/JNEUROSCI.3408-07.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kornbrot DE. Signal detection theory, the approach of choice: model-based and distribution-free measures and evaluation. Percept Psychophys. 2006;68:393–414. doi: 10.3758/bf03193685. [DOI] [PubMed] [Google Scholar]
- Kunimoto C. Confidence and Accuracy of Near-Threshold Discrimination Responses. Conscious Cogn. 2001;10:294–340. doi: 10.1006/ccog.2000.0494. [DOI] [PubMed] [Google Scholar]
- Logan GD, Crump MJC. Cognitive illusions of authorship reveal hierarchical error detection in skilled typists. Science. 2010;330:683–686. doi: 10.1126/science.1190483. [DOI] [PubMed] [Google Scholar]
- Macmillan N, Creelman C. Detection theory: a user’s guide. Lawrence Erlbaum; New York: 2005. [Google Scholar]
- Maniscalco B, Lau H. A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings. Conscious Cogn. 2011 doi: 10.1016/j.concog.2011.09.021. Epub ahead of print. [DOI] [PubMed] [Google Scholar]
- Nelson TO, Narens L. Metamemory: A theoretical framework and new findings. The psychology of learning and motivation: Advances in research and theory. 1990;26:125–173. [Google Scholar]
- Nieuwenhuis S, Ridderinkhof KR, Blom J, Band GPH, Kok A. Error-related brain potentials are differentially related to awareness of response errors: evidence from an antisaccade task. Psychophysiology. 2001;38:752–760. [PubMed] [Google Scholar]
- Pannu J, Kaszniak A. Metamemory experiments in neurological populations: A review. Neuropsychology Review. 2005;15:105–130. doi: 10.1007/s11065-005-7091-6. [DOI] [PubMed] [Google Scholar]
- Persaud N, McLeod P, Cowey A. Post-decision wagering objectively measures awareness. Nat Neurosci. 2007;10:257–261. doi: 10.1038/nn1840. [DOI] [PubMed] [Google Scholar]
- Pleskac TJ, Busemeyer JR. Two-stage dynamic signal detection: A theory of choice, decision time, and confidence. Psych Rev. 2010;117:864–901. doi: 10.1037/a0019737. [DOI] [PubMed] [Google Scholar]
- Henson RN, Rugg MD, Shallice T, Dolan RJ. Confidence in recognition memory for words: dissociating right prefrontal roles in episodic retrieval. J Cog Neuro. 2000;12:913–923. doi: 10.1162/08989290051137468. [DOI] [PubMed] [Google Scholar]
- Rabbitt P, Rodgers B. What does a man do after he makes an error? An analysis of response programming. Q J Exp Psych. 1977;29:727–743. [Google Scholar]
- Ramnani N, Owen AM. Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci. 2004;5:184. doi: 10.1038/nrn1343. [DOI] [PubMed] [Google Scholar]
- Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science. 2004;306:443–447. doi: 10.1126/science.1100301. [DOI] [PubMed] [Google Scholar]
- Riggs SE, Grant PM, Perivoliotis D, Beck AT. Assessment of Cognitive Insight: A Qualitative Review. Schizophr Bull. 2010 doi: 10.1093/schbul/sbq085. Epub ahead of print. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Roca M, Parr A, Thompson R, Woolgar A, Torralva T, Antoun N, Manes F, Duncan J. Executive function and fluid intelligence after frontal lobe lesions. Brain. 2010;133:234–247. doi: 10.1093/brain/awp269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rolls ET, Grabenhorst F, Deco G. Choice, difficulty, and confidence in the brain. NeuroImage. 2010;53:694–706. doi: 10.1016/j.neuroimage.2010.06.073. [DOI] [PubMed] [Google Scholar]
- Rounis E, Maniscalco B, Rothwell J, Passingham R, Lau H. Theta-burst transcranial magnetic stimulation to the prefrontal cortex impairs metacognitive visual awareness. Cognitive Neuroscience. 2010;1:165–175. doi: 10.1080/17588921003632529. [DOI] [PubMed] [Google Scholar]
- Schmitz TW, Rowley HA, Kawahara TN, Johnson SC. Neural correlates of self-evaluative accuracy after traumatic brain injury. Neuropsychologia. 2006;44:762–773. doi: 10.1016/j.neuropsychologia.2005.07.012. [DOI] [PubMed] [Google Scholar]
- Schnyer DM, Verfaellie M, Alexander MP, LaFleche G, Nicholls L, Kaszniak AW. A role for right medial prefrontal cortex in accurate feeling-of-knowing judgments: evidence from patients with lesions to frontal cortex. Neuropsychologia. 2004;42:957–966. doi: 10.1016/j.neuropsychologia.2003.11.020. [DOI] [PubMed] [Google Scholar]
- Song C, Kanai R, Fleming SM, Weil RS, Schwarzkopf DS, Rees G. Relating inter-individual differences in metacognitive performance on different perceptual tasks. Conscious Cogn. 2011;20:1787–92. doi: 10.1016/j.concog.2010.12.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Symmonds M, Wright ND, Bach DR, Dolan RJ. Deconstructing risk: Separable encoding of variance and skewness in the brain. NeuroImage. 2011;58:1139–1149. doi: 10.1016/j.neuroimage.2011.06.087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tsujimoto S, Genovesio A, Wise SP. Evaluating self-generated decisions in frontal pole cortex of monkeys. Nat Neurosci. 2010;13:120–126. doi: 10.1038/nn.2453. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Essen DC, Dickson J, Harwell J, Hanlon D, Anderson CH, Drury HA. An integrated software system for surface-based analyses of cerebral cortex. Journal of the American Medical Informatics Association. 2001;8:443–459. doi: 10.1136/jamia.2001.0080443. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Gaal S, Ridderinkhof KR, Fahrenfort JJ, Scholte HS, Lamme VAF. Frontal cortex mediates unconsciously triggered inhibitory control. J Neurosci. 2008;28:8053–8062. doi: 10.1523/JNEUROSCI.1278-08.2008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wechsler D. Manual for the Wechsler Abbreviated Intelligence Scale (WASI) San Antonio: 1999. [Google Scholar]
- Weiskopf N, Hutton C, Josephs O, Deichmann R. Optimal EPI parameters for reduction of susceptibility-induced BOLD sensitivity losses: a whole-brain analysis at 3 T and 1.5 T. NeuroImage. 2006;33:493–504. doi: 10.1016/j.neuroimage.2006.07.029. [DOI] [PubMed] [Google Scholar]
- Wilson TD, Dunn EW. Self-Knowledge: Its Limits, Value, and Potential for Improvement. Ann Rev Psych. 2004;55:493–518. doi: 10.1146/annurev.psych.55.090902.141954. [DOI] [PubMed] [Google Scholar]
- Yokoyama O, Miura N, Watanabe J, Takemoto A, Uchida S, Sugiura M, Horie K, Sato S, Kawashima R, Nakamura K. Right frontopolar cortex activity correlates with reliability of retrospective rating of confidence in short-term recognition memory performance. Neuroscience Research. 2010;68:199–206. doi: 10.1016/j.neures.2010.07.2041. [DOI] [PubMed] [Google Scholar]






