Abstract
The exploration-exploitation trade-off is ubiquitous in our everyday lives, and individuals display considerable variability in their preferred decision-making strategies. Most previous work pertaining to neural signatures of exploration is restricted to functional pathways. However, the specific contributions of cortical microarchitectures to high-level cognitive processes such as decision-making are as yet unknown. Here, we investigated the neuroanatomical foundations of inter-individual variability in decision-making strategies. To this end, 122 healthy participants completed a gamified multi-armed bandit paradigm aimed at teasing apart distinct exploration-exploitation decision strategies. We also collected whole-brain quantitative MRI maps indexing microstructural features of cortical myelination and iron content. Through computational modelling, we disentangled individual-specific exploration strategies, including value-free random exploration. Whole-brain regression analyses identified significant associations between value-free exploration and increased cortical myelination in right frontal brain areas with reported links to impulsivity. By elucidating the brain microstructural correlates of distinct exploration-exploitation strategies, we aimed to further our understanding of why individuals differ in their decision-making capabilities, and how decision-making may become aberrant in mental health conditions.
Keywords: computational modelling, exploration, brain microstructure, reward learning, quantitative mri
Introduction
It has been long established that individuals demonstrate considerable variability in the ways they make decisions and process information pertaining to rewards (Gershman, 2018; Schulz & Gershman, 2019). However, the neurobiological basis of these differences is not currently well characterised. A plausible explanation may be that inter-individual differences in cortical microstructures are driving this behavioural variability (Ziegler et al., 2019). Cortical microstructures such as myeloarchitecture play a vital role in the efficiency of neural signalling, by improving conduction velocity and reducing signal-to-noise ratio (Nave, 2010; Purves et al., 2001). By investigating how individual-specific differences in the brain’s structural features relate to decision-making, we can gain insight into the latent causes of such wide-ranging behavioural differences. Through this approach, we may reveal why aberrant or suboptimal decision-making strategies are often observed in individuals suffering from mental health conditions such as ADHD or depression (Must et al., 2013; Schulze et al., 2021).
Inter-individual differences in learning and decision-making become apparent when examining decision-making dilemmas such as the exploration-exploitation trade-off. In such situations, one must choose either the option with the greatest known value (exploitation), or an alternative, lesser-known option which may potentially yield yet greater rewards but at the risk of disappointing outcomes (exploration). The methods by which agents select different decision-making strategies is highly idiosyncratic and context-specific, and individuals vary greatly in their preferred decision strategies (Frank et al., 2009; Somerville et al., 2017; von Helversen et al., 2018).
Recent advances have led to the development of computational models that allow for the estimation of subject-specific parameters to describe key signatures of these exploration-exploitation behaviours (Gershman, 2018; Schwartenbeck et al., 2019). Previous work has identified the employment of exploration strategies that consider all available choices to be equally likely by disregarding all existing knowledge of the decision space, including any uncertainty and expectation estimates, thus reducing computational complexity (Daw et al., 2006; Wilson et al., 2014). This strategy is referred to as value-free random exploration. A recent study by Dubois et al. (2021) found clear evidence that humans employ a combination of complex resource-heavy approaches and simpler heuristic exploration strategies such as value-free random exploration, as well as uncertainty-led exploration and novelty exploration, to estimate an optimal decision method (Dubois et al., 2021). Recent work has also highlighted the neurochemical basis for decision-making, demonstrating that noradrenergic and dopaminergic activity play crucial roles in modulating exploration-exploitation strategy selection (Chakroun et al., 2019; Cremer et al., 2023; Dubois & Hauser, 2022). However, these neuromodulatory influences are expressed through distributed cortical circuits, suggesting that variability in the structural properties of such circuits controls how neurochemical signals are integrated and translated into behaviour. These findings highlight the potential for individual-specific neurobiological foundations of decision-making, yet further research is necessary to confirm this link between biology and behaviour.
Numerous previous studies have identified specific brain regions and functional connectivity pathways underlying key decision variables. In particular, the ventromedial prefrontal cortex (vmPFC) has been repeatedly implicated in choice probability, valuation, and subjective utility of available choices (Cockburn et al., 2022; Daw et al., 2006). The frontopolar cortex has also been highlighted in many studies as a locus of exploratory behaviours and choice switching (Boorman et al., 2009; Daw et al., 2006), and the posterior cingulate cortex (PCC) has been implicated in tracking value computations across diverse decision-making contexts (Clithero & Rangel, 2014). In addition to functional pathways, brain structural properties such as cortical thickness have been recently shown to contribute to decision-making processes (Filmer et al., 2023; Smid et al., 2023; Sunderaraman et al., 2022) and are subject to age-related changes (Liu et al., 2025). The behavioural variability we observe in decision-making contexts may therefore result from inter-individual differences in brain structure, which can arise from developmental or genetic sources, and in turn influence function (Frank et al., 2009). Examining such cortical differences through microstructural imaging can potentially reveal the underlying neuroanatomical origins of these observed differences in behaviour and brain anatomical pathways. More specifically, exploration-exploitation behaviours rely on the balance between flexible, stochastic policy control, often associated with prefrontal networks, and more stable, value-based action selection frequently attributed to parietal and sensorimotor regions (Daw et al., 2006; Klein-Flügge & Bestmann, 2012). Such processes are likely to rely heavily on the efficiency of neural signalling and underlying structural connectivity.
Quantitative MRI is a valuable method for the quantification and investigation of in vivo brain microstructures, providing a non-invasive means of assessing neuroanatomical features relevant to cognitive function (Callaghan et al., 2014; Weiskopf et al., 2015; Ziegler et al., 2019). These indices extend beyond conventional morphometric measures such as cortical volume or thickness to index variation in quantitative, non-arbitrary units with direct histological correlates. For example, previous work has exploited these recent advances in quantitative neuroimaging to correlate model parameters of respiratory interoception with in vivo indicators of cortical histology, revealing multiple neuroanatomical contributions to interoceptive sensitivity, precision, and metacognition (Nikolova et al., 2025). In particular, the R2* quantitative contrast, which indexes the iron content of cortical tissues, has been repeatedly associated with noradrenergic and dopaminergic activity due to the accumulation of the neuromelanin-iron complex in noradrenergic neurons in the locus coeruleus, and dopaminergic neurons in the substantia nigra (Riley et al., 2023; Zucca et al., 2017). Noradrenaline is broadly recognised as a key contributor to higher-level cognitive processes including decision-making and uncertainty processing (Hauser et al., 2017; Lawson et al., 2021; Yu & Dayan, 2005). Therefore, investigating this relationship between structural brain components and neurotransmitters with putative roles in decision-making may advance our understanding of why decision-making behaviours differ so greatly between individuals.
In this study, we aimed to examine the neuroanatomical foundations of inter-individual differences in exploration-exploitation behaviours. To this end, 122 participants completed a gamified exploration task, constructed as a multi-armed bandit, which enabled the quantification of subject-level variability in exploration-exploitation behaviours (Dubois et al., 2021; Dubois and Hauser, 2022). We applied a whole-brain, cluster-corrected multiple linear regression analysis on three distinct neuroanatomical maps generated through quantitative MRI, relating cortical architectures with task parameter estimates characterising exploration-exploitation behaviours. Through associating individual-specific model parameter estimates denoting behavioural heuristics with cortical microstructures, we sought to elucidate the neurobiological bases of decision-making processes, and how they might drive inter-individual differences in learning.
Materials and Methods
Participants
A total of 566 (360 females, 205 males, 1 other) participants (median age = 24, age range = 18–56) participated in the Visceral Mind Project, a large-scale neuroimaging project at the Center of Functionally Integrative Neuroscience, Aarhus University. Participants were recruited through local advertisements such as social media, posters, and flyers, and also via the SONA online participation pool system. Participants were required to have normal or corrected-to-normal vision and fluency in Danish or English. Exclusion criteria required that participants were not taking any medications excluding contraceptives or over-the-counter antihistamines. In addition, participants were required to be compatible with standard MRI scanning requirements (i.e., not pregnant/breastfeeding, no metal implants, no claustrophobia, etc.). Participants from this dataset completed multiple behavioural tasks, physiological recordings, and MRI scanning, in addition to psychiatric and lifestyle inventories, across three separate visits scheduled on different days. The MRI and behavioural data reported in this study were collected on different days. The study was granted ethical approval by the local Region Midtjylland Ethics Committee and was conducted in accordance with the Declaration of Helsinki (2013). All participants provided written informed consent and were remunerated for their participation.
Exploration-Exploitation Paradigm – ‘Maggie’s Farm’
‘Maggie’s Farm’ is a multi-armed bandit paradigm designed to examine human exploration-exploitation strategies in decision-making (Dubois et al., 2021; Dubois & Hauser, 2022) (Figure 1C). On each trial, participants were asked to choose between three “bandits” (represented by trees bearing apples), each associated with a given reward distribution (apple size), to maximise their total reward. Each bandit’s reward (apple size) was drawn from a normal distribution with a fixed sampling variance. Bandits displayed either high prior reward information (i.e., three initial samples), or limited prior information (one initial sample), while one novel bandit provided no prior reward information. Bandits also had either a standard or a low reward mean. At the start of each trial, participants were shown initial reward samples displayed on a wooden crate at the bottom of the screen. They then selected a bandit to sample from. Participants were instructed to collect the biggest apples before the end of each trial (sunset). Participants could perform either one draw (short horizon) or six draws (long horizon) from the selected bandit, depending on the trial condition. By analysing participants’ choices, the task distinguishes between different exploration strategies, such as selecting novel options to reduce uncertainty or choosing randomly without regard for expected value. See Supplementary Information for detailed task instructions, and Dubois et al. (2021) for further information regarding details of the paradigm.
Figure 1.

Participant inclusion and demographics. (A) Participant inclusion diagram, detailing data quality controls applied to both the behavioural and neuroimaging data. (B) Distributions of age and gender of the 122 participants included in the behavioural analyses. (C) Maggie’s Farm (MF) task design. Participants could choose from three possible bandits (trees) to obtain samples (apples) of varying value (apple size), to maximise their reward. At the start of each trial, participants were shown initial samples in the crate at the bottom of the screen. Top right: trial horizon and number of remaining draws were indicated by the number of empty crates. Our analyses primarily focused on the initial draw for both horizon conditions.
Statistical Analyses of Behaviour
To first assess normality in participants’ choice behaviour, behavioural heuristics, and model parameter estimates, we conducted Shapiro-Wilk normality tests. Due to non-normal distributions in the behavioural data, we proceeded with non-parametric statistical analyses for all comparisons and correlations. To examine whether trial horizon manipulation influenced exploratory behaviours (and as positive controls to demonstrate consistency with the findings of Dubois et al. 2021; Dubois and Hauser 2022), we compared the choice frequencies of different bandit values in the long versus short horizon trials using two-sided Wilcoxon signed-rank two-tailed tests. To identify potential correlations between behavioural metrics and model parameters, we conducted partial Spearman’s rank correlation analyses correcting for age, gender, and body mass index (BMI) and correcting for multiple comparisons using false discovery rate (FDR) correction (see Supplementary Figure 1 for partial correlation matrix). To investigate the association between participants’ choice behaviours and model heuristics, and mental health factors extracted from psychiatric surveys (Banellis, et al. 2026), we applied partial Spearman’s rank correlation analyses, correcting for age, gender, and BMI and correcting for multiple comparisons using FDR correction (see Supplementary Information, Supplementary Figures 2 and 3 for results, factor structure, and further details).
Computational Modelling of Behaviour
The computational model used here employs Thompson sampling (capturing uncertainty-driven value-based random exploration), with the addition of both value-free random exploration and novelty exploration following the framework described in Dubois et al. (see Dubois et al. 2021; Dubois and Hauser 2022, for further model details).
This previous validation work examining the same task in a different sample (Dubois et al., 2021) compared multiple computational models, consisting of three base models: the UCB model which includes the UCB algorithm and a softmax choice function; the Thompson model which employs Thompson sampling; and a hybrid model which combined the UCB model and the Thompson model. These computationally-demanding models were compared both with and without the addition of simpler heuristic exploration strategies, i.e., value-free random exploration (ɛ-greedy), and novelty exploration (novelty bonus η). Here, we employ the winning model from this model comparison, i.e., the model with the greatest held-out data likelihood (%): the Thompson model with the addition of ɛ-greedy and novelty bonus η.
To model value-free random exploration in line with these previous analyses, we added an ɛ-greedy component to the decision rule, ensuring that every ɛ% of the time, an option alternative to the one predicted is chosen. Also in line with previous work, we added a novelty bonus η to the computation of the value of novel bandits in order to model novelty exploration.
The value of each bandit, i, is defined as follows:
A sample is taken from each bandit. The probability of choosing bandit i depends on the probability that all pairwise differences between the sample from bandit i and the other bandits j ≠ i were greater or equal to 0 (see Speekenbrink & Konstantinidis (2015) for the probability of maximum utility choice rule). In Maggie’s Farm, two pairwise differences scores (contained in the two-dimensional vector u) were computed for each bandit due to the presence of three bandits at a time. The probability of choosing bandit i is described by:
where f is the multivariate Normal density function with mean vector:
where the matrix Ai computes the pairwise differences between bandit i and other bandits. For example, for bandit i = 1:
We used the maximum a posteriori (MAP) probability estimate for fitting parameter values, employing the fmincon optimisation function in MATLAB, in line with previous work (see Dubois et al. 2021; Dubois and Hauser 2022, for further details regarding parameter estimation).
Multi-Parameter Brain Mapping
The multi-parameter pipeline employed here follows that described in Nikolova et al. (2025). We utilised a well-established qMRI protocol (Weiskopf et al., 2013, 2015) to map percent saturation resulting from magnetisation transfer (MT), longitudinal relaxation rate (R1) and effective transverse relaxation rate (R2*), followed by voxel-based quantification to examine how subject-specific parameter estimates of exploration-exploitation behaviours correlate with different characteristics of brain microstructure.
Data Acquisition
Neuroimaging data were acquired using a 3T MR system (Magnetom Prisma, Siemens healthcare, Erlangen, Germany), using a standard 32-channel radiofrequency (RF) head coil and a body coil. We obtained high-resolution whole brain T1-weighted anatomical images (0.8 mm3 isotropic) using an MP-RAGE sequence (repetition time = 2.2 s, echo time = 2.51 ms, matrix size = 256 × 256 × 192 voxels, flip angle = 8°, AP acquisition direction).
We acquired whole-brain image acquisitions at isotropic 0.8 mm resolution using an MPM quantitative imaging protocol (Callaghan et al., 2019; Weiskopf et al., 2013). The sequences comprised three spoiled multi-echo 3D fast low angle shot (FLASH) acquisitions and three additional calibration sequences to correct for RF transmit field inhomogeneities. The FLASH sequences were acquired with MT, PD and T1 weighting. We used a flip angle of 6° for the MT- and PD-weighted images, and 21° for the T1-weighted acquisitions. MT-weighting employed a Gaussian RF pulse 2 kHz off resonance with 4 ms duration and a nominal flip rate of 220°. The field of view was 256 mm head-foot, 224 mm anterior-posterior, and 179 mm right-left. Gradient echoes with alternating readout gradient polarity were obtained using equidistant echo times ranging from 2.34 to 13.8 ms (MT) or 18.4 ms (PD and T1), using a readout bandwidth of 490 Hz/pixel. For the MT-weighted acquisition, only six echoes were collected to achieve a repetition time (TR) of 25 ms for all FLASH volumes. For accelerated data acquisition, partially parallel imaging was performed using the GRAPPA algorithm, with an acceleration factor of 2 in each phase encoded direction and 40 integrated reference lines. A slab rotation of 30° was used for all acquisitions. The B1 mapping acquisition comprised 11 measurements with the nominal flip rate ranging from 115° to 65° in 5° steps. The total scanning time for the qMRI acquisitions was approximately 26 minutes.
Map Creation
All qMRI images were pre-processed using the hMRI toolbox v. 0.5.0 (January 2023) (Tabelow et al., 2019) and SPM12 (version 12.r7771, Wellcome Trust Centre for Neuroimaging, https://www.fil.ion.ucl.ac.uk/spm/), to correct the raw qMRI images for spatial transmit, receive field inhomogeneities and obtain quantitative MT, PD, R1 and R2* estimate maps. This correction was executed using empirical data, i.e., the RF sensitivity map and B1 maps collected from each participant. Excluding enabling imperfect spoiling correction, the hMRI toolbox was configured using default settings. All images were reoriented to MNI standard space prior to map creation. This processing produced four maps modelling different aspects of tissue microstructure: an MT map sensitive to myeloarchitectural integrity (Helms et al., 2008), a PD map representing tissue water content, an R1 map reflecting myelination, iron concentration and water content (primarily driven by myelination) (Lutti et al., 2014), and an R2* map sensitive to tissue iron concentration (Langkammer et al., 2010).
MT saturation and R1 both reflect qualities of myelin, however they index different underlying biophysical properties (Filo et al., 2019; Weiskopf et al., 2021). R1 is predominantly shaped by tissue composition, water content, and iron, whereas MT saturation indexes macromolecular content through magnetisation transfer. As a result, subtle variations in microstructural myelin components may exert a greater effect on one map type compared with the other. However, the in-depth understanding of the neuroarchitecture-to-MPM contrast association remains an active research area, and some biophysical constructs contribute to both map types.
The unified segmentation approach (Ashburner & Friston, 2005) was used to segment MT saturation maps into grey matter (GM), white matter (WM) and cerebrospinal fluid (CSF) probability maps. We used tissue probability maps based on multi-parametric maps developed by Lorio et al. (2016), without bias field correction given that MT maps do not show significant bias field modulation. We then used the GM and WM probability maps to perform inter-subject registration using Diffeomorphic Image Registration (DARTEL), a nonlinear diffeomorphic algorithm (Ashburner, 2007). The MT, PD, R1 and R2* maps were then normalised to MNI space (at isotropic 1 mm resolution) using the resulting DARTEL template and participant-specific deformation fields. The nonlinear registration of the quantitative maps was based on the MT maps due to their high contrast in subcortical structures, and a WM-GM contrast in the cortex similar to T1 weighted images (Helms et al., 2009). Finally, tissue-weighted smoothing was applied using a kernel of 8 mm full width at half maximum (FWHM) using the voxel-based quantification (VBQ) approach (Draganski et al., 2011). Importantly, in contrast to voxel-based morphometry analysis, this VBQ smoothing approach aims to minimise partial volume effects and optimally preserves the quantitative values of the original qMRI images by not modulating the parameter maps to account for volume changes. The resulting GM segments for each map were used for all statistical analyses.
MRI Quality Control and Participant Exclusions
Multi-parameter mapping contrast images were acquired for 503 total participants. Following inspection, several participants were removed from all analyses for reasons related to either MRI or behavioural data. Three participants were excluded immediately following MR data collection for medical reasons (one cerebral palsy and two other suspected brain abnormalities). Three participants were excluded due to errors in the scanning sequences. As MPM data is known to be particularly sensitive to motion artefacts, we conducted a thorough quality control (QC) assessment to identify high-motion images. Visual QC HTML reports were created of each participant using the hMRI-vQC toolbox (Sherif et al., 2022), and all reports were visually inspected and labelled by two researchers. Doubtful cases were discussed, and a further 57 participants were excluded due to excessive motion affecting the tissue-class segmentation. Data from the remaining 443 participants was used in the spatial analysis and template creation using DARTEL.
A total of 196 participated in the Maggie’s Farm task, 122 of which had complete datasets for the task (median age: 24, age range: 18-52, 67 females, 54 males, 1 other; see Table 1 for participant demographics). Participants with missing or incomplete behavioural data were excluded from these analyses. The overlap between the behavioural paradigm and MPM data left 111 participants for VBQ analyses. Following additional QC using the CAT12 toolbox in SPM12, a further four participants were excluded from VBQ analyses for MT maps (MT: final N = 107), four for R1 maps (R1: final N = 107), and three for R2* maps (R2*: final N = 108) (Figure 1).
Table 1.
Participant demographics of 122 Maggie’s Farm participants.
|
| |
|---|---|
| VARIABLE | MEAN (± SD) |
|
| |
| Age | 24.9 ± 5.0 |
|
| |
| Gender | 67 (54.9%) female, 54 (44.3%) male, 1 (0.8%) other |
|
| |
| BMI | 23.1 ± 2.9 |
|
| |
Voxel Based Quantification Analysis
Grey and white matter masks were generated based on our samples, by averaging the smoothed, modulated GM and WM segment images, and thresholding the result at p > .2. Inter-subject variation in MT, R1 and R2* GM maps were modelled in separate multiple linear regression analyses. A total of 16 regressors of interest were used in the VBQ analysis, consisting of behavioural heuristics and subject-specific model parameter estimates generated through Thompson sampling modelling (see Table 2 for a full list of regressors included). Additionally, we included age, gender, body mass index (BMI) and total intracranial volume (TIV) as nuisance covariates in all analyses, following recommended procedures for computational neuroanatomy (Ridgway et al., 2008). VBQ data is often subject to non-stationarity, therefore we applied Threshold-Free Cluster Enhancement (TFCE) correction to our contrasts in combination with a GM mask, which provides non-parametric statistics and is robust to such non-stationarity in the data. We analysed whole-brain maps of each positive and negative t-contrast using a TFCE-corrected FWE-cluster p-value with p < .05 inclusion threshold (Hupé, 2015; Ridgway et al., 2008). All statistical analyses were conducted in SPM12, and we utilised the JuBrain Anatomy Toolbox v. 3.0 (Eickhoff et al., 2005) to determine anatomical labels and regional percentages.
Table 2.
Behavioural model parameter glossary.
|
| |
|---|---|
| PARAMETER | DEFINITION |
|
| |
| Xi SH | Epsilon greedy parameter for short horizon trials |
|
| |
| Xi LH | Epsilon greedy parameter for long horizon trials |
|
| |
| η SH | Novelty bonus for short horizon trials |
|
| |
| η LH | Novelty bonus for long horizon trials |
|
| |
| σ0 SH | Prior variance for short horizon trials |
|
| |
| σ0 LH | Prior variance for long horizon trials |
|
| |
| Q0 | Expected value before seeing any samples |
|
| |
| Score SH | Score in the short horizon (i.e., the size of the single apple picked) |
|
| |
| Score all LH trials | Total score in the long horizon (i.e., the sum of all the apples picked) |
|
| |
| Score first LH trial | Score on the first trial in the long horizon (i.e., the size of the first apple picked) |
|
| |
| Behaviour EV SH | Expected value of chosen bandit (i.e., exploitation), in the short horizon |
|
| |
| Behaviour EV LH | Expected value of chosen bandit (i.e., exploitation), in the long horizon |
|
| |
| Behaviour IS SH | Number of samples that were displayed for the bandit that they chose (i.e., information seeking), in the short horizon |
|
| |
| Behaviour IS LH | Number of samples that were displayed for the bandit that they chose (i.e., information seeking), in the long horizon |
|
| |
| Behaviour Consist SH | Consistency measure, i.e., whether participants made the same choice when observing the same data, in the short horizon |
|
| |
| Behaviour Consist LH | Consistency measure, i.e., whether participants made the same choice when observing the same data, in the long horizon |
|
| |
Results
Exploration-Exploitation Behaviours are Modulated by Trial Horizon
To evaluate participants’ chosen exploration-exploitation strategies, we first analysed participants’ choice behaviour in the multi-armed bandit task, Maggie’s Farm, and estimated subject-specific behavioural heuristics through Thompson sampling modelling (Figure 1C).
Participants chose to sample less from the high-value bandit in long horizon trials compared with short horizon trials (two-sided Wilcoxon signed-rank two-tailed test: V = 336.5, p < .001), demonstrating that participants were willing to forego selecting the bandit with the greatest expected reward outcome to potentially learn about alternative bandits (Figure 2A). Consequently, participants chose to sample more from the novel bandit (V = 514.0, p < .001) and from the low-value bandit (V = 1076.5, p < .001) in long horizon trials versus short horizon trials (Figure 2A). This demonstrates that participants chose to engage in more exploratory behaviours in the long horizon trials, where exploration is beneficial, compared with short horizon trials, where exploration is less beneficial. This behaviour is also consistent with that presented in previous studies examining choice behaviours in the same task (Dubois et al., 2021; Dubois & Hauser, 2022), which found that manipulating trial horizon drove exploratory behaviours.
Figure 2.

Effects of trial horizon on bandit choice behaviour (A), behavioural heuristics (B), Thompson sampling model parameters (C), and reward earned in the first sample and average sample within a trial (D). A: In long horizon trials, participants sampled significantly less from the high-value bandit (left), and more from the novel bandit (centre) and low-value bandit (right). B: Exploitation: participants selected bandits with lower expected values more in the long versus short horizon, i.e., participants explored more in the long horizon. Information-seeking: participants chose lesser-known bandits more frequently in the long versus short horizon. C: In long horizon trials compared with short horizon trials, participants had significantly higher estimates of ɛ (value-free random exploration; left), η (novelty bonus; centre), and σ0 (prior variance; right). Parameters were fitted separately for each horizon and were fitted to the first draw of each participant. D: Participants obtained lower rewards in the initial draw of long horizon trials compared to short horizon trials, suggesting that participants initially prioritised acquiring information over rewards. This information gathering resulted in higher rewards overall in long horizon trials, as the newly acquired information enabled participants to make more informed decisions on bandit selection. *** indicates p < .001, ** indicates p < .01.
To investigate this choice behaviour further, we generated behavioural metrics describing exploitation behaviours (expected value of the selected bandit, i.e., mean value of the initial displayed samples) and information seeking behaviours (i.e., number of samples displayed for the selected bandit). If participants exhibited more explorative behaviours, we would expect participants to initially select bandits with lower expected values in long horizon trials. As expected, we found that participants chose bandits with a lower expected value (i.e., they explored more) in the long horizon trials compared with the short horizon trials (V = 5640.0, p < .001) (Figure 2B). Participants also chose lesser known (i.e., more informative) bandits more frequently in the long horizon trials versus short horizon trials (V = 6861.0, p < .001) (Figure 2B), suggesting that participants were more likely to select bandits they were less familiar with in the long horizon trials, potentially to acquire information and resolve uncertainty about unfamiliar bandits.
Participants utilise value-free exploration when exploration may be beneficial
To formally quantify how participants employ different exploration strategies, we examined differences in behavioural model parameter estimates between long and short horizon trials. The ɛ-greedy parameter indexes value-free random exploration, in that ɛ% of the time each available bandit has an equal probability of being selected by the participant. Participants had higher values of ɛ-greedy, i.e., greater value-free random exploration, in the long horizon versus short horizon trials (two-sided Wilcoxon signed-rank two-tailed test: V = 1167.0, p < .001) (Figure 2C), suggesting that participants employed value-free explorative strategies in trials where exploration was beneficial. Participants also had significantly greater novelty bonuses, i.e., they showed greater novelty exploration in long horizon trials versus short horizon (V = 643.0, p < .001) (Figure 2C). Additionally, participants exhibited higher prior variances, i.e., uncertainty-driven value-based random exploration, or greater uncertainty about a bandit’s mean before seeing any samples, in long horizon trials versus short horizon trials (V = 2624.0, p = 0.00398) (Figure 2C), further bolstering the suggestion that exploration strategies were promoted during long horizon trials, which allowed the participant to subsequently exploit the information gathered to obtain greater rewards overall. These findings also remain consistent with those in Dubois et al. (2021, 2022), further demonstrating that long horizon trials engendered robust value-free exploratory behaviours.
Value-free random exploration leads to greater rewards in the long run
To establish whether this choice behaviour yielded greater rewards in the long run, we examined reward earned in the initial samples of short horizon trials, initial samples in long horizon trials, and average reward earned across all six samples in the long horizon. As expected, participants earned fewer rewards in the first sample of long horizon trials versus short horizon trials due to the horizon-specific choice behaviour described above (FDR-corrected two-sided Wilcoxon signed-rank two-tailed test: V = 1015.5, p < .001) (Figure 2D). However, participants earned higher rewards on average across all samples in the long horizon compared to the short horizon initial sample (V = 10.0, p < .001), suggesting that participants initially selected less optimal bandits to gather information about lesser-known bandits, then applied this newly acquired information to select more optimal bandits in the future and maximise their rewards.
Voxel-Based Quantification reveals neuroanatomical correlates of value-free exploration
We next investigated how these behavioural metrics and model parameter estimates of value-free random exploration in our exploration-exploitation paradigm relates to brain microstructural indices. To achieve this, we employed whole-brain multiple linear regression with TFCE correction against participants’ ɛ-greedy parameter estimates in short horizon trials and long horizon trials separately, while adjusting for age, gender, BMI, and total intracranial volume (TIV).
We found that R1 map values in the right superior frontal gyrus (TFCE corrected: k = 15138, pFWEcorr = .013, peak voxel coordinates: x = 8.0, y = –11.2, z = 77.6) and right middle frontal gyrus (TFCE corrected: k = 3467, pFWEcorr = .021, peak voxel coordinates: x = 36.0, y = 12.8, z = 55.2) were significantly positively correlated with ɛ-greedy parameter estimates specifically in long horizon trials (Figure 3A-C, Table 4). In contrast, we found no significant correlations between R1 map values and ɛ-greedy values in short horizon trials. This finding specifically in long horizon but not short horizon trials therefore indicates a significant positive association between value-free random exploration in trials where exploration is more beneficial, and myelination in right frontal gyri, which have been previously linked to the control of impulsive behaviours (Hu et al., 2016).
Figure 3.

Microstructural correlates of value-free random exploration (ɛ-greedy) for R1 (A-C) and MT maps (D-F). A: Distribution of ɛ-greedy parameter estimates in long horizon trials across the cohort (N = 107). B-C: R1 values in the right superior frontal gyrus (SFG) are positively correlated with ɛ-greedy estimates in the long horizon. D: Distribution of ɛ-greedy parameter estimates in short horizon trials across the cohort (N = 107). E-F: MT saturation in the right postcentral gyrus (PostCG) is negatively correlated with ɛ-greedy estimates in the short horizon. Maps were TFCE (non-parametric) cluster-corrected for data non-stationarity and FWE corrected for multiple comparisons (pFWE < .05). Colour bars indicate TFCE values, scatter plots are for visualisation purposes.
Table 4.
Summary of whole brain VBQ results: positive correlation between R1 and ɛ-greedy parameter in long horizon trials.
|
| ||||||
|---|---|---|---|---|---|---|
| SIGNIFICANT WHOLE BRAIN CLUSTERS | ||||||
|
| ||||||
| REGION | K | P(FWE-CORR) | TFCE | X | Y | Z |
|
| ||||||
| R Superior Frontal Gyrus | 6539 | 0.015 | 3083.99 | 8 | –11.2 | 77.6 |
|
| ||||||
| R Middle Frontal Gyrus | 3126 | 0.023 | 2742.65 | 36 | 12.8 | 55.2 |
|
| ||||||
| R Precentral Gyrus | 7143 | 0.025 | 2683.08 | 39.2 | –8.8 | 60.8 |
|
| ||||||
| R Cerebellum | 14419 | 0.026 | 2662.38 | 8 | –68.8 | –30.4 |
|
| ||||||
| L Postcentral Gyrus | 2334 | 0.030 | 2542.83 | –47.2 | –24 | 59.2 |
|
| ||||||
| L Precentral Gyrus | 3629 | 0.031 | 2520.42 | –8.8 | –16.8 | 69.6 |
|
| ||||||
| L Middle Frontal Gyrus | 1698 | 0.033 | 2477.97 | –31.2 | 13.6 | 50.4 |
|
| ||||||
| R Middle Temporal Gyrus | 1150 | 0.045 | 2253.25 | 50.4 | –48 | 2.4 |
|
| ||||||
| R Middle Frontal Gyrus | 653 | 0.046 | 2236.41 | 48.8 | 13.6 | 42.4 |
|
| ||||||
| R Angular Gyrus | 496 | 0.047 | 2217.32 | 46.4 | –65.6 | 33.6 |
|
| ||||||
| L Middle Frontal Gyrus | 347 | 0.047 | 2210.99 | –39.2 | 43.2 | –2.4 |
|
| ||||||
| L Middle Frontal Gyrus | 580 | 0.048 | 2202.08 | –34.4 | 39.2 | 18.4 |
|
| ||||||
We also found that MT saturation in the right postcentral gyrus (TFCE corrected: k = 5840, pFWEcorr = .024, peak voxel coordinates: x = 68.8, y = –10.4, z = 20) showed significant negative correlation with ɛ-greedy estimates in the short horizon trials (Figure 3D-F, Table 3). MT saturation in the right superior parietal lobule was also negatively correlated with ɛ-greedy estimates in short horizon trials (TFCE corrected: k = 3883, pFWEcorr = .036, peak voxel coordinates: x = 24.8, y = –46.4, z = 47.2). However, we found no significant associations between MT saturation and ɛ-greedy estimates in long horizon trials. In short horizon trials, participants make only one bandit choice, therefore the optimal bandit choice in the short horizon is to select the bandit with the greatest expected value and to forego value-free random exploration and information seeking. These findings therefore indicate that greater myeloarchitectural integrity in the right postcentral gyrus and right superior parietal lobe is associated with reduced value-free random exploration when such exploration is not beneficial.
Table 3.
Summary of whole brain VBQ results: negative correlation between MT Saturation and ɛ-greedy parameter in short horizon trials.
|
| ||||||
|---|---|---|---|---|---|---|
| SIGNIFICANT WHOLE BRAIN CLUSTERS | ||||||
|
| ||||||
| REGION | K | P(FWE-CORR) | TFCE | X | Y | Z |
|
| ||||||
| R Postcentral Gyrus | 5840 | 0.024 | 2681.63 | 68.8 | –10.4 | 20 |
|
| ||||||
| R Superior Parietal Lobule | 3883 | 0.036 | 2373.76 | 24.8 | –46.4 | 47.2 |
|
| ||||||
| L Cerebellum | 757 | 0.038 | 2340.27 | –10.4 | –59.2 | –36 |
|
| ||||||
| R Middle Frontal Gyrus | 1181 | 0.041 | 2289.43 | 53.6 | 14.4 | 40 |
|
| ||||||
| R Medial Orbital Gyrus | 620 | 0.044 | 2239.23 | 16 | 44 | –20 |
|
| ||||||
| R Anterior Orbital Gyrus | 528 | 0.045 | 2219.54 | 24 | 40.8 | –11.2 |
|
| ||||||
| R Supramarginal Gyrus | 404 | 0.047 | 2200.75 | 63.2 | –24.8 | 39.2 |
|
| ||||||
| L Superior Occipital Gyrus | 676 | 0.047 | 2193.52 | –16 | –82.4 | 37.6 |
|
| ||||||
| R Superior Frontal Gyrus | 97 | 0.049 | 2167.19 | 20.8 | 58.4 | 4.8 |
|
| ||||||
| R Middle Frontal Gyrus | 70 | 0.049 | 2157.75 | 48 | 44.8 | 17.6 |
|
| ||||||
These significant clusters were only detectable in association with ɛ-greedy parameter estimates and were not detectable when examining bandit selection frequencies (see Supplementary Figure 4, Supplementary Tables 1–2), suggesting that our computational model captures distinct neurobiological effects compared with those captured by simpler behavioural metrics, such as raw selection frequencies.
No significant associations between behavioural heuristics of value-free random exploration and R2* map values survived TFCE correction, suggesting no obvious relationship between exploration-exploitation behaviours and cortical iron concentration.
Meta-analytic Coactivation analyses uncover functional associations
Finally, we conducted a meta-analytic coactivation analysis of our findings in the right postcentral gyrus for MT map values and right SFG for R1 map values. To do this we utilised Neurosynth; a publicly-available meta-analytic database, using the right SFG and right postcentral gyrus peaks as seed regions. We generated meta-analytic maps displaying significant co-activation with our seed regions, in addition to associated functional and psychological terms from the literature. We sorted all associated terms with a non-zero reverse inference z-score by their posterior probability of appearing in a publication, given a pattern of activation (p(term | activation)). The top literature terms (max. ten) for each region are presented in Supplementary Tables 3–4 (see Supplementary Figure 6 for meta-analytic maps for each region).
We found that the right postcentral gyrus displayed significant coactivation with the right primary visual cortex, and bilateral premotor regions. In terms of functional associations, the right postcentral gyrus was most commonly related to speech, in line with suggestions that the right postcentral gyrus is linked to sensory representations of the larynx (example top terms: “pitch”, “speech production”; “vocal”) (Belyk & Brown, 2014). Previous work has also implicated functional activations in the right postcentral gyrus in implicit learning in autism spectrum disorder (Schipul & Just, 2016). In contrast, the right SFG displayed significant coactivation with the right insula, in addition to left premotor/supplementary motor regions. The right SFG was primarily associated with motor-based meta-analytic terms (example top terms: “muscle”, “motor premotor”), and has been linked to error detection and inhibition of distractor interference (Chevrier & Schachar, 2010; Xu et al., 2011).
Discussion
Here, we utilised the Maggie’s Farm gamified multi-armed bandit task to interrogate the microstructural neural correlates of value-free random exploration behaviours. We applied Thompson sampling with additional behavioural heuristics describing value-free random exploration and novelty (Krebs et al., 2009) to examine how participants selected different behavioural strategies. We found that participants specifically made use of long horizon trials to sample lesser-known bandits and acquire new information to increase their overall reward, closely replicating previous findings which apply these same behavioural heuristics to the same task (Dubois et al., 2021; Dubois & Hauser, 2022). Further, we employed whole-brain regression analyses to demonstrate significant associations between heuristics of value-free exploration in long horizon trials and indices of myeloarchitecture in right superior frontal areas, which have been previously implicated in impulsive behaviours (Hu et al., 2016; Lim et al., 2021; P. Zhang et al., 2023). Specifically, we utilised voxel-based quantification (VBQ), which enables the biophysical, voxel-wise analysis of quantitative brain maps denoting indicators of iron concentration and myelin content (Draganski et al., 2011). In contrast to voxel-based morphometry (VBM), which supplies indirect, relative differences in tissue densities and is sensitive to differences in processing choices, VBQ provides biophysically plausible parameters describing absolute microstructural variations in cortical tissues (Senjem et al., 2005). Together, our findings here suggest that individual differences in decision-making and exploration behaviours may have distinct microstructural foundations in the brain.
Here, we employ a computational model to quantitatively describe specific psychological traits such as value-free random exploration, by combining the resource-demanding Thompson sampling with two computationally-light heuristic strategies. The utilisation of multiple different exploration behaviours, which all approximate an optimal exploration strategy, has been widely reported in human decision-making (Dubois et al., 2022; Gershman, 2018; Wilson et al., 2014). Examining simpler behavioural metrics such as bandit selection frequencies does not necessarily allow us to tease apart these different properties of exploration and may absorb shared variance from multiple forms of exploratory behaviour, for example directed versus random exploration.
Previous work has robustly demonstrated that participants employ both complex strategies and simpler heuristic strategies to seek and gather information during trials in which they can subsequently exploit this information (Dubois et al., 2021; Dubois & Hauser, 2022; Wilson et al., 2014). In this study, we successfully replicated these findings by combining simple heuristic modelling of value-free random exploration (ɛ-greedy) and novelty bonuses (η) with the more complex and resource-demanding Thompson sampling model. We found that participants chose low-value bandits significantly more in long horizon trials compared to short horizon trials, demonstrating that participants prioritised acquiring information about low-value or alternative bandits rather than maximising their reward in the short term by selecting high-value bandits in the first instance. We also found that participants chose lesser-known bandits more frequently in long horizon versus short horizon trials, indicating that participants took advantage of the long horizon to gather information about more informative (lesser-known) bandits to potentially maximise their reward in later samples, in line with previous studies (Warren et al., 2017; Wilson et al., 2014; Wu et al., 2018). We confirmed this hypothesis by examining participants’ mean scores for their initial samples in both the long and short horizons, and the average score across all six samples in the long horizon. In line with our hypotheses and with previous findings (Dubois et al., 2021; Dubois & Hauser, 2022), participants earned significantly more rewards across long horizon trial samples compared with short horizon initial samples, even though participants earned significantly less reward in long horizon initial samples.
Through whole-brain regression analyses, we then demonstrated positive associations between cortical myelination in the right superior (SFG) and right middle frontal gyri (MFG), including the supplementary motor area (SMA), and value-free random exploration in long horizon trials only. Since the SMA lies within the superior frontal gyrus, our region of significant correlation may reflect contributions from both regions. The right SFG has been implicated in impulsivity (Hu et al., 2016; P. Zhang et al., 2023), whereas the SMA is more classically associated with action planning and language processing (Hartwigsen et al., 2013; Hertrich et al., 2016; Moore-Parks et al., 2010). Our findings presented here may therefore depict an interaction between cognitive control and motor planning processes.
The link between increased value-free exploration and increased myelination in the SMA has not been previously reported. However, increased activation in the pre-SMA and striatum have been shown to facilitate faster decision-making by lowering response thresholds and alleviating global inhibition from the motor system (Forstmann et al., 2008). Further, sequential sampling models have demonstrated that activation in the pre-SMA, caudate nucleus, and anterior insula play important roles in evidence accumulation over time, which in turn facilitates value-based decision-making (Gluth et al., 2012). Therefore, these findings point to potential contributions of greater microarchitectural integrity in the SMA to action planning and evidence accumulation in time-pressured decision-making contexts. However, future studies are required to more closely examine the specific inputs of the SMA to these cognitive processes.
Previous work has identified greater activations in the right SFG during exploratory behaviours compared with exploitative behaviours in a classic four-armed bandit task (Laureiro-Martínez et al., 2014). A recent systematic review highlighted contributions of bilateral superior and middle frontal gyri to exploration-exploitation behaviours: specifically, the right and left middle frontal gyri were identified as core regions contributing to greater exploratory behaviours compared to exploitation, with right and left superior frontal gyri as secondary regions (Wyatt et al., 2024). Further, recent research examining brain structure has shown that cortical thickness in the SFG is negatively associated with impulsivity, indicating that impulsiveness, which is commonly associated with various psychiatric disorders, may rise from neuroanatomical differences (Lim et al., 2021; Schilling et al., 2013). Together, this highlights a putative role for myelination in right frontal regions in exploration behaviours. However, future studies specifically probing the link between cortical microstructures and impulsive behaviours, possibly combining impulsivity-focused behavioural tasks with impulsivity self-report scales, would provide vital additional information to confirm this link.
We also showed that value-free exploration in short horizon trials was negatively correlated with indices of cortical myeloarchitecture in the right postcentral gyrus, in that lower magnetisation transfer (MT) saturation values were associated with greater value-free random exploration and vice versa, specifically in short horizon trials in which this exploration is not necessarily beneficial. We observed this negative effect in the right postcentral gyrus; a region of the primary somatosensory cortex postulated to exhibit sensory representations of the larynx (Belyk & Brown, 2014). This association between exploratory behaviours and brain microstructures in the right postcentral gyrus is a novel finding which has not previously been documented. Recent work has, however, presented evidence for strong positive correlations between postcentral gyrus activity and the value of reducing variability, indicating that the postcentral gyrus may play a role in how an agent values the resolution of uncertainty (S. Zhang et al., 2025). In combination with our findings here, this may point towards a role for macromolecular content in the primary somatosensory cortex in uncertainty reduction. Additionally, a recent VBM study demonstrated a negative association between grey matter volume in the postcentral gyrus and perceptual sensitivity of numerosity (Yuan et al., 2023). Previous work has also found that the structure of primary sensory brain regions plays a crucial role in visual acuity and sensitivity on an individual level (Duncan & Boynton, 2003; Schwarzkopf et al., 2011). These findings, along with our findings in this study, suggest that structural variability in primary sensory brain areas may contribute to inter-individual differences in conscious experience, which may, in turn, beget variability in how individuals process information in their observed environment to inform their decision making.
The association between variations in cortical microstructures and exploration-exploitation behaviours may stem from various mechanisms. Myelination, for instance, is responsible for increased conduction velocity of axonal electrical signals, and is therefore crucial for facilitating fast and efficient neural signalling (Nave, 2010; Purves et al., 2001). Speculatively, this improved signalling efficiency may enable more flexibility in individuals’ internal models of the environment, therefore facilitating switching to exploratory behavioural strategies in response to environmental instability. The right SFG has been previously implicated with exploratory decision-making (Laureiro-Martínez et al., 2014; Wyatt et al., 2024), whereas the right postcentral gyrus has been linked to sensory gating and regulation of task-relevant sensorimotor responses (Meehan & Staines, 2007; Staines et al., 2002). Within this framework, increased myelination in the right SFG may indicate enhanced efficiency in the neural circuits supporting exploratory policy implementation, consistent with higher ɛ-greedy parameter estimates in trials where exploration is beneficial. In contrast, greater indices of myeloarchitecture in the right postcentral gyrus may improve the suppression of task-irrelevant sensorimotor signals and the regulation of stochastic response tendencies, thereby reducing unnecessary random exploration and supporting more stable exploitative behaviour in trials where exploration is not beneficial.
Interestingly, our analyses did not reveal any significant correlations between value-free exploration and canonical dopaminergic midbrain or hippocampal regions, despite their well-established roles in exploration-exploitation behaviours and decision-making (Rigoli et al., 2016; Schwartenbeck et al., 2015). The absence of significant associations in these regions may be a consequence of our rigorous whole-brain multiple regression pipeline with correction for multiple comparisons, which may lead to reduced sensitivity to subtler effects in smaller brain regions of interest. Moreover, it has been recently reported that qMRI parameters vary across cortical depths and correlate with layer-specific gene expression and cell counts (McColgan et al., 2021). To further investigate the contributions of subcortical microstructural variation to exploration behaviours, future studies may employ optimised qMRI sequences to specifically target subcortical regions of interest (Carter et al., 2025; Chen et al., 2014). For example, multiple-measurement protocols have been previously employed to improve the low signal-to-noise ratio typically linked to the high spatial resolution necessary to image smaller subcortical structures, such as the locus coeruleus and substantia nigra (Chen et al., 2014).
A limitation of this study is the correlational design in which behavioural and neural data were acquired separately, therefore one cannot make inferences about potential causal pathways linking brain structure and function to behavioural metrics and psychiatric symptom scores. Future research could involve identifying genetic contributions to psychiatric symptoms and differences in brain structures, and examining how such polygenic influences may impact various aspects of decision-making. Further, longitudinal studies investigating how lifestyle, environment, and mental health may impact inter-individual variability in cortical microstructures may provide valuable insights into the complex interplay between brain structure, brain function, and exhibited behaviours. Despite recruiting participants displaying a range of psychiatric phenotypes, we did not explicitly study clinical populations. Previous work has shown brain microstructural changes in Parkinson’s disease patients (Drori et al., 2025), and differences in white matter microstructures in cognitively healthy individuals who express strong genetic factors of late-onset Alzheimer’s disease (Operto et al., 2018). A natural next step from the work presented here is to examine how decision-making strategies in individuals suffering from mental health conditions that impact decision-making such as ADHD, depression, and anxiety, may be reflected in microstructural signatures in the brain.
As with any voxel-based methodology, our findings may be subject to some degree of sensitivity to processing choices, including spatial normalisation and smoothing parameters. To mitigate this, we followed established preprocessing guidelines used in other previous VBQ studies (Nikolova et al., 2025; Vejloe et al., 2026). Specifically, we employed a unified segmentation-normalisation framework in which registration and tissue classification are performed simultaneously (Ashburner & Friston, 2005), and utilised a smoothing approach specifically optimised for VBQ to minimise partial volume effects and optimally preserve the quantitative values of the original qMRI images (Draganski et al., 2011).
The variation in qMRI parameters across cortical depths presents an additional limitation, as the processing pipeline employed here does not account for depth-specific effects. Future work could build upon our voxel-level analyses by utilising surface-based methods, such as surface-based registration, to examine such depth-specific effects and also improve the precision of spatial normalisation (Khan et al., 2011).
Previous research has indicated that exploration model parameters may lack generalisability (Eckstein et al., 2022; Witte et al., 2025), which presents a possible limitation to the current study. However, the exploration parameters in our model do not denote general exploration, rather they index specific exploratory behaviours; ɛ-greedy for example specifically denotes value-free random exploration, and the novelty bonus η indexes novelty exploration. Also, our previous study (Dubois & Hauser, 2022) employing the same computational model and task in a different sample also collected self-report survey scores in the Barratt Impulsiveness Scale (BIS), and Adult ADHD Self-Report Scale (ASRS). This work demonstrated significant positive correlations between ɛ-greedy parameter estimates in long horizon trials and general impulsivity, motor impulsivity (subscale of BIS), ADHD, and ADHD hyperactivity-impulsivity (subscale of ASRS) scores (Dubois & Hauser, 2022). This builds upon previous findings linking exploration to increased impulsivity, particularly in ADHD (Hauser et al., 2014; Williams & Taylor, 2006), by demonstrating that value-free random exploration specifically is increased in ADHD, while associations were not found for other forms of exploration. This finding is congruent with the idea of impulsivity as ‘acting on a whim’, as value-free random exploration disregards all existing information and is therefore the least computationally-demanding. Future work may examine the association between variations in cortical microstructures and self-report measures of impulsivity, and how these metrics interact with various exploratory strategies. Additionally, we focused primarily on which bandit participants selected in their initial choice within a trial. Future work may also investigate at which point within long horizon trials participants switched from exploratory (i.e., selecting lower-value but novel or informative bandits) to exploitatory strategies to probe how cortical microstructures may drive individual differences in strategy switching.
Demographic factors such as socioeconomic status have been previously associated with exploration (Decker et al., 2025) and may therefore play an important role in individual differences in exploration-exploitation behaviours. The absence of such demographic data presents a potential limitation for this study, however our sample was primarily young adults recruited from the local University student population which in itself has relatively low socioeconomic variability compared to a community sample. Future work may employ exploratory factor analyses linking exploration behaviours and a range of lifestyle and demographic factors, including socioeconomic status.
Overall, we present novel insights into how behavioural heuristics of exploration-exploitation behaviours and decision-making are associated with distinct indices of cortical microstructures in task-relevant brain regions. Our findings here indicate that brain microstructures such as myelination may influence how individuals make decisions and act upon them to acquire information and seek rewards. This therefore highlights great potential for future work examining causal relationships between cortical microstructure, functional brain pathways, and observed behaviour, and may lay the groundwork for future studies examining how such cortical microstructures differ between individuals suffering from psychiatric conditions characterised by aberrant decision-making, such as anxiety disorders and ADHD.
Additional File
The additional file for this article can be found as follows:
Associations between behavioural metrics and transdiagnostic psychiatric factors, and additional VBQ control analyses.
Funding Statement
This research is financially supported by a Lundbeckfonden Fellowship (R272-2017-4345) and a European Research Council Grant (ERC-2020-StG-948788) awarded to MGA. The funding sources were not involved in the study design, collection, analysis, interpretation, or writing of the manuscript. TUH has received funding from the Wellcome Trust (316955/Z/24/Z), the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No 946055), and the Carl-Zeiss-Stiftung. This work was supported by the Alexander von Humboldt foundation, (more) precisely the Alexander-von-Humboldt-Professorship award to Peter Dayan. For the purpose of Open Access, the author has applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission.
References
- 1.Ashburner, J. (2007). A fast diffeomorphic image registration algorithm. NeuroImage, 38(1), 95–113. 10.1016/j.neuroimage.2007.07.007 [DOI] [PubMed] [Google Scholar]
- 2.Ashburner, J., & Friston, K. J. (2005). Unified segmentation. NeuroImage, 26(3), 839–851. 10.1016/j.neuroimage.2005.02.018 [DOI] [PubMed] [Google Scholar]
- 3.Banellis, L., Nikolova, N., Ehmsen, J., Courtin, A., Vejlø, M., Tyrer, A., Böhme, R., Bavato, F., Hoogervorst, K., Fardo, F., & Allen, M. (2026). Interoceptive Ability is Unrelated to Mental Health Symptoms: Evidence From a Large Scale Multi-Domain Psychophysical Investigation. OSF. 10.1038/s44220-026-00688-4 [DOI] [Google Scholar]
- 4.Belyk, M., & Brown, S. (2014). Somatotopy of the extrinsic laryngeal muscles in the human sensorimotor cortex. Behavioural Brain Research, 270, 364–371. 10.1016/j.bbr.2014.05.048 [DOI] [PubMed] [Google Scholar]
- 5.Boorman, E. D., Behrens, T. E. J., Woolrich, M. W., & Rushworth, M. F. S. (2009). How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action. Neuron, 62(5), 733–743. 10.1016/j.neuron.2009.05.014 [DOI] [PubMed] [Google Scholar]
- 6.Callaghan, M. F., Freund, P., Draganski, B., Anderson, E., Cappelletti, M., Chowdhury, R., Diedrichsen, J., FitzGerald, T. H. B., Smittenaar, P., Helms, G., Lutti, A., & Weiskopf, N. (2014). Widespread age-related differences in the human brain microstructure revealed by quantitative magnetic resonance imaging. Neurobiology of Aging, 35(8), 1862–1872. 10.1016/j.neurobiolaging.2014.02.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Callaghan, M. F., Lutti, A., Ashburner, J., Balteau, E., Corbin, N., Draganski, B., Helms, G., Kherif, F., Leutritz, T., Mohammadi, S., Phillips, C., Reimer, E., Ruthotto, L., Seif, M., Tabelow, K., Ziegler, G., & Weiskopf, N. (2019). Example dataset for the hMRI toolbox. Data in Brief, 104132. 10.1016/j.dib.2019.104132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Carter, F., Anwander, A., Johnson, M., Goucha, T., Adamson, H., Friederici, A. D., Lutti, A., Gauthier, C. J., Weiskopf, N., Bazin, P.-L., & Steele, C. J. (2025). Assessing quantitative MRI techniques using multimodal comparisons. PLOS ONE, 20(7), e0327828. 10.1371/journal.pone.0327828 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Chakroun, K., Mathar, D., Wiehler, A., Ganzer, F., & Peters, J. (2019). Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making (p. 706176). bioRxiv. 10.1101/706176 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Chen, X., Huddleston, D. E., Langley, J., Ahn, S., Barnum, C. J., Factor, S. A., Levey, A. I., & Hu, X. (2014). Simultaneous imaging of locus coeruleus and substantia nigra with a quantitative neuromelanin MRI approach. Magnetic Resonance Imaging, 32(10), 1301–1306. 10.1016/j.mri.2014.07.003 [DOI] [PubMed] [Google Scholar]
- 11.Chevrier, A., & Schachar, R. J. (2010). Error detection in the stop signal task. NeuroImage, 53(2), 664–673. 10.1016/j.neuroimage.2010.06.056 [DOI] [PubMed] [Google Scholar]
- 12.Clithero, J. A., & Rangel, A. (2014). Informatic parcellation of the network involved in the computation of subjective value. Social Cognitive and Affective Neuroscience, 9(9), 1289–1302. 10.1093/scan/nst106 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Cockburn, J., Man, V., Cunningham, W. A., & O’Doherty, J. P. (2022). Novelty and uncertainty regulate the balance between exploration and exploitation through distinct mechanisms in the human brain. Neuron, 110(16), 2691–2702.e8. 10.1016/j.neuron.2022.05.025 [DOI] [PubMed] [Google Scholar]
- 14.Cremer, A., Kalbe, F., Müller, J. C., Wiedemann, K., & Schwabe, L. (2023). Disentangling the roles of dopamine and noradrenaline in the exploration-exploitation tradeoff during human decision-making. Neuropsychopharmacology, 48(7), 1078–1086. 10.1038/s41386-022-01517-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Daw, N. D., O’Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441(7095), 876–879. 10.1038/nature04766 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Decker, A. L., Leonard, J., Romeo, R., Itiat, J., Hubbard, N. A., Bauer, C. C. C., Grotzinger, H., Giebler, M. A., Torres, Y. C., Imhof, A., & Gabrieli, J. D. E. (2025). Exploration is associated with socioeconomic disparities in learning and academic achievement in adolescence. Nature Communications, 16(1), 6342. 10.1038/s41467-025-61746-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Draganski, B., Ashburner, J., Hutton, C., Kherif, F., Frackowiak, R. S. J., Helms, G., & Weiskopf, N. (2011). Regional specificity of MRI contrast parameter changes in normal ageing revealed by voxel-based quantification (VBQ). NeuroImage, 55(4), 1423–1434. 10.1016/j.neuroimage.2011.01.052 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Drori, E., Cohen, L., Arkadir, D., Yahalom, G., & Mezer, A. A. (2025). Multiparametric quantitative MRI uncovers putamen microstructural changes in Parkinson’s disease. Npj Parkinson’s Disease, 11(1), 197. 10.1038/s41531-025-01020-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Dubois, M., Bowler, A., Moses-Payne, M. E., Habicht, J., Moran, R., Steinbeis, N., & Hauser, T. U. (2022). Exploration heuristics decrease during youth. Cognitive, Affective, & Behavioral Neuroscience, 22(5), 969–983. 10.3758/s13415-022-01009-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Dubois, M., Habicht, J., Michely, J., Moran, R., Dolan, R. J., & Hauser, T. U. (2021). Human complex exploration strategies are enriched by noradrenaline-modulated heuristics. eLife, 10, e59907. 10.7554/eLife.59907 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Dubois, M., & Hauser, T. U. (2022). Value-free random exploration is linked to impulsivity. Nature Communications, 13(1), 4542. 10.1038/s41467-022-31918-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Duncan, R. O., & Boynton, G. M. (2003). Cortical Magnification within Human Primary Visual Cortex Correlates with Acuity Thresholds. Neuron, 38(4), 659–671. 10.1016/S0896-6273(03)00265-4 [DOI] [PubMed] [Google Scholar]
- 23.Eckstein, M. K., Master, S. L., Xia, L., Dahl, R. E., Wilbrecht, L., & Collins, A. G. (2022). The interpretation of computational model parameters depends on the context. eLife, 11, e75474. 10.7554/eLife.75474 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005). A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. NeuroImage, 25(4), 1325–1335. 10.1016/j.neuroimage.2004.12.034 [DOI] [PubMed] [Google Scholar]
- 25.Filmer, H. L., Loughnan, K., Seeto, J. X., Ballard, T., Ehrhardt, S. E., Shaw, T. B., Wards, Y., Rideaux, R., Leow, L.-A., Sewell, D. K., & Dux, P. E. (2023). Individual Differences in Decision Strategy Relate to Neurochemical Excitability and Cortical Thickness. Journal of Neuroscience, 43(42), 7006–7015. 10.1523/JNEUROSCI.1086-23.2023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Filo, S., Shtangel, O., Salamon, N., Kol, A., Weisinger, B., Shifman, S., & Mezer, A. A. (2019). Disentangling molecular alterations from water-content changes in the aging human brain using quantitative MRI. Nature Communications, 10(1), 3403. 10.1038/s41467-019-11319-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Forstmann, B. U., Dutilh, G., Brown, S., Neumann, J., von Cramon, D. Y., Ridderinkhof, K. R., & Wagenmakers, E.-J. (2008). Striatum and pre-SMA facilitate decision-making under time pressure. Proceedings of the National Academy of Sciences, 105(45), 17538–17542. 10.1073/pnas.0805903105 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Frank, M. J., Doll, B. B., Oas-Terpstra, J., & Moreno, F. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12(8), 1062–1068. 10.1038/nn.2342 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gershman, S. J. (2018). Deconstructing the human algorithms for exploration. Cognition, 173, 34–42. 10.1016/j.cognition.2017.12.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Gluth, S., Rieskamp, J., & Büchel, C. (2012). Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain. Journal of Neuroscience, 32(31), 10686–10698. 10.1523/JNEUROSCI.0727-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Hartwigsen, G., Saur, D., Price, C. J., Baumgaertner, A., Ulmer, S., & Siebner, H. R. (2013). Increased Facilitatory Connectivity from the Pre-SMA to the Left Dorsal Premotor Cortex during Pseudoword Repetition. Journal of Cognitive Neuroscience, 25(4), 580–594. 10.1162/jocn_a_00342 [DOI] [PubMed] [Google Scholar]
- 32.Hauser, T. U., Allen, M., Purg, N., Moutoussis, M., Rees, G., & Dolan, R. J. (2017). Noradrenaline blockade specifically enhances metacognitive performance. eLife, 6. 10.7554/eLife.24901 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hauser, T. U., Iannaccone, R., Ball, J., Mathys, C., Brandeis, D., Walitza, S., & Brem, S. (2014). Role of the medial prefrontal cortex in impaired decision making in juvenile attention-deficit/hyperactivity disorder. JAMA Psychiatry, 71(10), 1165–1173. 10.1001/jamapsychiatry.2014.1093 [DOI] [PubMed] [Google Scholar]
- 34.Helms, G., Dathe, H., & Dechent, P. (2008). Quantitative FLASH MRI at 3T using a rational approximation of the Ernst equation. Magnetic Resonance in Medicine, 59(3), 667–672. 10.1002/mrm.21542 [DOI] [PubMed] [Google Scholar]
- 35.Helms, G., Draganski, B., Frackowiak, R., Ashburner, J., & Weiskopf, N. (2009). Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps. NeuroImage, 47(1), 194–198. 10.1016/j.neuroimage.2009.03.053 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Hertrich, I., Dietrich, S., & Ackermann, H. (2016). The role of the supplementary motor area for speech and language processing. Neuroscience & Biobehavioral Reviews, 68, 602–610. 10.1016/j.neubiorev.2016.06.030 [DOI] [PubMed] [Google Scholar]
- 37.Hu, S., Ide, J. S., Zhang, S., & Li, C. R. (2016). The Right Superior Frontal Gyrus and Individual Variation in Proactive Control of Impulsive Response. Journal of Neuroscience, 36(50), 12688–12696. 10.1523/JNEUROSCI.1175-16.2016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hupé, J.-M. (2015). Statistical inferences under the Null hypothesis: Common mistakes and pitfalls in neuroimaging studies. Frontiers in Neuroscience, 9. https://www.frontiersin.org/articles/10.3389/fnins.2015.00018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Khan, R., Zhang, Q., Darayan, S., Dhandapani, S., Katyal, S., Greene, C., Bajaj, C., & Ress, D. (2011). Surface-based analysis methods for high-resolution functional magnetic resonance imaging. Graphical Models, 73(6), 313–322. 10.1016/j.gmod.2010.11.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Klein-Flügge, M. C., & Bestmann, S. (2012). Time-Dependent Changes in Human Corticospinal Excitability Reveal Value-Based Competition for Action during Decision Processing. Journal of Neuroscience, 32(24), 8373–8382. 10.1523/JNEUROSCI.0270-12.2012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Krebs, R. M., Schott, B. H., Schütze, H., & Düzel, E. (2009). The novelty exploration bonus and its attentional modulation. Neuropsychologia, 47(11), 2272–2281. 10.1016/j.neuropsychologia.2009.01.015 [DOI] [PubMed] [Google Scholar]
- 42.Langkammer, C., Krebs, N., Goessler, W., Scheurer, E., Ebner, F., Yen, K., Fazekas, F., & Ropele, S. (2010). Quantitative MR imaging of brain iron: A postmortem validation study. Radiology, 257(2), 455–462. 10.1148/radiol.10100495 [DOI] [PubMed] [Google Scholar]
- 43.Laureiro-Martínez, D., Canessa, N., Brusoni, S., Zollo, M., Hare, T., Alemanno, F., & Cappa, S. F. (2014). Frontopolar cortex and decision-making efficiency: Comparing brain activity of experts with different professional background during an exploration-exploitation task. Frontiers in Human Neuroscience, 7, 927. 10.3389/fnhum.2013.00927 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Lawson, R. P., Bisby, J., Nord, C. L., Burgess, N., & Rees, G. (2021). The Computational, Pharmacological, and Physiological Determinants of Sensory Learning under Uncertainty. Current Biology, 31(1), 163–172.e4. 10.1016/j.cub.2020.10.043 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Lim, J.-E., Kim, S., Seo, S., Kang, W., Kim, A., Kang, Y., Choi, K. W., Tae, W.-S., Ham, B.-J., & Han, K.-M. (2021). Association of Prefrontal Cortex Thinning with High Impulsivity in Healthy Adults. Psychiatry Investigation, 18(6), 570–579. 10.30773/pi.2020.0404 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Liu, P., Doehler, J., Henschke, J. U., Northall, A., Knaf-Serian, A., Loaiza-Carvajal, L. C., Budinger, E., Schwarzkopf, D. S., Speck, O., Pakan, J. M. P., & Kuehn, E. (2025). Layer-specific changes in sensory cortex across the lifespan in mice and humans. Nature Neuroscience, 28(9), 1978–1989. 10.1038/s41593-025-02013-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Lorio, S., Fresard, S., Adaszewski, S., Kherif, F., Chowdhury, R., Frackowiak, R. S., Ashburner, J., Helms, G., Weiskopf, N., Lutti, A., & Draganski, B. (2016). New tissue priors for improved automated classification of subcortical brain structures on MRI. NeuroImage, 130, 157–166. 10.1016/j.neuroimage.2016.01.062 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Lutti, A., Dick, F., Sereno, M. I., & Weiskopf, N. (2014). Using high-resolution quantitative mapping of R1 as an index of cortical myelination. NeuroImage, 93 Pt 2, 176–188. 10.1016/j.neuroimage.2013.06.005 [DOI] [PubMed] [Google Scholar]
- 49.McColgan, P., Helbling, S., Vaculčiaková, L., Pine, K., Wagstyl, K., Attar, F. M., Edwards, L., Papoutsi, M., Wei, Y., Van den Heuvel, M. P., Tabrizi, S. J., Rees, G., & Weiskopf, N. (2021). Relating quantitative 7T MRI across cortical depths to cytoarchitectonics, gene expression and connectomics. Human Brain Mapping, 42(15), 4996–5009. 10.1002/hbm.25595 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Meehan, S. K., & Staines, W. R. (2007). Task-relevance and temporal synchrony between tactile and visual stimuli modulates cortical activity and motor performance during sensory-guided movement. Human Brain Mapping, 30(2), 484–496. 10.1002/hbm.20520 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Moore-Parks, E. N., Burns, E. L., Bazzill, R., Levy, S., Posada, V., & Müller, R.-A. (2010). An fMRI study of sentence-embedded lexical-semantic decision in children and adults. Brain and Language, Special Issue on Language Development, 114(2), 90–100. 10.1016/j.bandl.2010.03.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Must, A., Horvath, S., Nemeth, V. L., & Janka, Z. (2013). The Iowa Gambling Task in depression – what have we learned about sub-optimal decision-making strategies? Frontiers in Psychology, 4. 10.3389/fpsyg.2013.00732 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Nave, K.-A. (2010). Myelination and support of axonal integrity by glia. Nature, 468(7321), 244–252. 10.1038/nature09614 [DOI] [PubMed] [Google Scholar]
- 54.Nikolova, N., Ehmsen, J. F., Banellis, L., Brændholt, M., Steenkjær, C., Vejlø, M., Fardo, F., & Allen, M. G. (2025). Microstructural Brain Correlates of Inter-individual Differences in Respiratory Interoception. Journal of Neuroscience. 10.1523/JNEUROSCI.0787-24.2025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Operto, G., Cacciaglia, R., Grau-Rivera, O., Falcon, C., Brugulat-Serrat, A., Ródenas, P., Ramos, R., Morán, S., Esteller, M., Bargalló, N., Molinuevo, J. L., Gispert, J. D., Camí, J., Salvadó, G., Skouras, S., Sánchez, G., Minguillón, C., Fauria, K., Gramunt, N., … for the ALFA Study . (2018). White matter microstructure is altered in cognitively normal middle-aged APOE-ε4 homozygotes. Alzheimer’s Research & Therapy, 10(1), 48. 10.1186/s13195-018-0375-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Purves, D., Augustine, G. J., Fitzpatrick, D., Katz, L. C., LaMantia, A.-S., McNamara, J. O., & Williams, S. M. (2001). Increased Conduction Velocity as a Result of Myelination. In Neuroscience. 2nd edition. Sinauer Associates. https://www.ncbi.nlm.nih.gov/books/NBK10921/ [Google Scholar]
- 57.Ridgway, G. R., Henley, S. M. D., Rohrer, J. D., Scahill, R. I., Warren, J. D., & Fox, N. C. (2008). Ten simple rules for reporting voxel-based morphometry studies. NeuroImage, 40(4), 1429–1435. 10.1016/j.neuroimage.2008.01.003 [DOI] [PubMed] [Google Scholar]
- 58.Rigoli, F., Friston, K. J., & Dolan, R. J. (2016). Neural processes mediating contextual influences on human choice behaviour. Nature Communications, 7(1), 12416. 10.1038/ncomms12416 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Riley, E., Cicero, N., Swallow, K., De Rosa, E., & Anderson, A. (2023). Locus coeruleus neuromelanin accumulation and dissipation across the lifespan. bioRxiv, 2023.10.17.562814. 10.1101/2023.10.17.562814 [DOI] [Google Scholar]
- 60.Schilling, C., Kühn, S., Paus, T., Romanowski, A., Banaschewski, T., Barbot, A., Barker, G. J., Brühl, R., Büchel, C., Conrod, P. J., Dalley, J. W., Flor, H., Ittermann, B., Ivanov, N., Mann, K., Martinot, J.-L., Nees, F., Rietschel, M., Robbins, T. W., … Gallinat, J. (2013). Cortical thickness of superior frontal cortex predicts impulsiveness and perceptual reasoning in adolescence. Molecular Psychiatry, 18(5), 624–630. 10.1038/mp.2012.56 [DOI] [PubMed] [Google Scholar]
- 61.Schipul, S. E., & Just, M. A. (2016). Diminished neural adaptation during implicit learning in autism. NeuroImage, 125, 332–341. 10.1016/j.neuroimage.2015.10.039 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Schulz, E., & Gershman, S. J. (2019). The algorithmic architecture of exploration in the human brain. Current Opinion in Neurobiology, Machine Learning, Big Data, and Neuroscience, 55, 7–14. 10.1016/j.conb.2018.11.003 [DOI] [PubMed] [Google Scholar]
- 63.Schulze, M., Coghill, D., Lux, S., & Philipsen, A. (2021). Disentangling ADHD’s Presentation-Related Decision-Making—A Meta-Analytic Approach on Predominant Presentations. Frontiers in Psychiatry, 12. 10.3389/fpsyt.2021.519840 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Schwartenbeck, P., FitzGerald, T. H. B., Mathys, C., Dolan, R., & Friston, K. (2015). The Dopaminergic Midbrain Encodes the Expected Certainty about Desired Outcomes. Cerebral Cortex, 25(10), 3434–3445. 10.1093/cercor/bhu159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Schwartenbeck, P., Passecker, J., Hauser, T. U., FitzGerald, T. H., Kronbichler, M., & Friston, K. J. (2019). Computational mechanisms of curiosity and goal-directed exploration. eLife, 8, e41703. 10.7554/eLife.41703 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Schwarzkopf, D. S., Song, C., & Rees, G. (2011). The surface area of human V1 predicts the subjective experience of object size. Nature Neuroscience, 14(1), 28–30. 10.1038/nn.2706 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Senjem, M. L., Gunter, J. L., Shiung, M. M., Petersen, R. C., & Jack, C. R. (2005). Comparison of different methodological implementations of voxel-based morphometry in neurodegenerative disease. NeuroImage, 26(2), 600–608. 10.1016/j.neuroimage.2005.02.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Sherif, S., Bastin, C., Maquet, P., Vandewalle, G., Balteau, E., Callaghan, M. F., & Phillips, C. (2022). HMRI-vQC : A visualization Quality Control toolbox for Multi-Parameter Mapping. OHBM Annual Meeting. [Google Scholar]
- 69.Smid, C. R., Ganesan, K., Thompson, A., Cañigueral, R., Veselic, S., Royer, J., Kool, W., Hauser, T. U., Bernhardt, B., & Steinbeis, N. (2023). Neurocognitive basis of model-based decision making and its metacontrol in childhood. Developmental Cognitive Neuroscience, 62, 101269. 10.1016/j.dcn.2023.101269 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Somerville, L. H., Sasse, S. F., Garrad, M. C., Drysdale, A. T., Abi Akar, N., Insel, C., & Wilson, R. C. (2017). Charting the expansion of strategic exploratory behavior during adolescence. Journal of Experimental Psychology: General, 146(2), 155–164. 10.1037/xge0000250 [DOI] [PubMed] [Google Scholar]
- 71.Speekenbrink, M., & Konstantinidis, E. (2015). Uncertainty and Exploration in a Restless Bandit Problem. Topics in Cognitive Science, 7(2), 351–367. 10.1111/tops.12145 [DOI] [PubMed] [Google Scholar]
- 72.Staines, W. R., Graham, S. J., Black, S. E., & McIlroy, W. E. (2002). Task-relevant modulation of contralateral and ipsilateral primary somatosensory cortex and the role of a prefrontal-cortical sensory gating system. NeuroImage, 15(1), 190–199. 10.1006/nimg.2001.0953 [DOI] [PubMed] [Google Scholar]
- 73.Sunderaraman, P., Lee, S., Varangis, E., Habeck, C., Chapman, S., Joyce, J. L., Hartstone, W., Brickman, A. M., Stern, Y., & Cosentino, S. (2022). Self-awareness for financial decision making abilities is linked to right temporal cortical thickness in older adults. Brain Imaging and Behavior, 16(3), 1139–1147. 10.1007/s11682-021-00590-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Tabelow, K., Balteau, E., Ashburner, J., Callaghan, M. F., Draganski, B., Helms, G., Kherif, F., Leutritz, T., Lutti, A., Phillips, C., Reimer, E., Ruthotto, L., Seif, M., Weiskopf, N., Ziegler, G., & Mohammadi, S. (2019). hMRI – A toolbox for quantitative MRI in neuroscience and clinical research. NeuroImage, 194, 191–210. 10.1016/j.neuroimage.2019.01.029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Vejloe, M., Nikolova, N., Banellis, L., Tyrer, A., Skvortsova, V., Hauser, T. U., & Allen, M. (2026). Dissociable Microstructural Correlates of Learning Rate and Learning Noise in Gamified Reward-Based Decision-Making. bioRxiv, 2026.02.24.707646. 10.64898/2026.02.24.707646 [DOI] [Google Scholar]
- 76.von Helversen, B., Mata, R., Samanez-Larkin, G. R., & Wilke, A. (2018). Foraging, exploration, or search? On the (lack of) convergent validity between three behavioral paradigms. Evolutionary Behavioral Sciences, 12(3), 152–162. 10.1037/ebs0000121 [DOI] [Google Scholar]
- 77.Warren, C. M., Wilson, R. C., van der Wee, N. J., Giltay, E. J., van Noorden, M. S., Cohen, J. D., & Nieuwenhuis, S. (2017). The effect of atomoxetine on random and directed exploration in humans. PloS One, 12(4), e0176034. 10.1371/journal.pone.0176034 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Weiskopf, N., Edwards, L. J., Helms, G., Mohammadi, S., & Kirilina, E. (2021). Quantitative magnetic resonance imaging of brain anatomy and in vivo histology. Nature Reviews Physics, 3(8), Article 8. 10.1038/s42254-021-00326-1 [DOI] [Google Scholar]
- 79.Weiskopf, N., Mohammadi, S., Lutti, A., & Callaghan, M. F. (2015). Advances in MRI-based computational neuroanatomy: From morphometry to in-vivo histology. Current Opinion in Neurology, 28(4), 313–322. 10.1097/WCO.0000000000000222 [DOI] [PubMed] [Google Scholar]
- 80.Weiskopf, N., Suckling, J., Williams, G., Correia, M., Inkster, B., Tait, R., Ooi, C., Bullmore, E., & Lutti, A. (2013). Quantitative multi-parameter mapping of R1, PD*, MT, and R2* at 3T: A multi-center validation. Frontiers in Neuroscience, 7. https://www.frontiersin.org/article/10.3389/fnins.2013.00095 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Williams, J., & Taylor, E. (2006). The evolution of hyperactivity, impulsivity and cognitive diversity. Journal of the Royal Society, Interface, 3(8), 399–413. 10.1098/rsif.2005.0102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Wilson, R. C., Geana, A., White, J. M., Ludvig, E. A., & Cohen, J. D. (2014). Humans use directed and random exploration to solve the explore–exploit dilemma. Journal of Experimental Psychology: General, 143(6), 2074–2081. 10.1037/a0038199 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Witte, K., Thalmann, M., & Schulz, E. (2025). Model-based exploration is measurable across tasks but not linked to personality and psychiatric assessments. Scientific Reports, 15(1), 27479. 10.1038/s41598-025-09152-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Wu, C. M., Schulz, E., Speekenbrink, M., Nelson, J. D., & Meder, B. (2018). Generalization guides human exploration in vast decision spaces. Nature Human Behaviour, 2(12), 915–924. 10.1038/s41562-018-0467-4 [DOI] [PubMed] [Google Scholar]
- 85.Wyatt, L. E., Hewan, P. A., Hogeveen, J., Spreng, R. N., & Turner, G. R. (2024). Exploration versus exploitation decisions in the human brain: A systematic review of functional neuroimaging and neuropsychological studies. Neuropsychologia, 192, 108740. 10.1016/j.neuropsychologia.2023.108740 [DOI] [PubMed] [Google Scholar]
- 86.Xu, J., Monterosso, J., Kober, H., Balodis, I. M., & Potenza, M. N. (2011). Perceptual load-dependent neural correlates of distractor interference inhibition. PloS One, 6(1), e14552. 10.1371/journal.pone.0014552 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Yu, A. J., & Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46(4), 681–692. 10.1016/j.neuron.2005.04.026 [DOI] [PubMed] [Google Scholar]
- 88.Yuan, X., Ni, L., Li, H., Zhang, D., & Zhou, K. (2023). The neural correlates of individual differences in numerosity perception: A voxel-based morphometry study. iScience, 26(8), 107392. 10.1016/j.isci.2023.107392 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Zhang, P., Pan, Y., Zha, R., Song, H., Yuan, C., Zhao, Q., Piao, Y., Ren, J., Chen, Y., Liang, P., Tao, R., Wei, Z., & Zhang, X. (2023). Impulsivity-related right superior frontal gyrus as a biomarker of internet gaming disorder. General Psychiatry, 36(4). 10.1136/gpsych-2022-100985 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2025). The neural correlates of novelty and variability in human decision-making under an active inference framework. eLife, 13, RP92892. 10.7554/eLife.92892 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Ziegler, G., Hauser, T. U., Moutoussis, M., Bullmore, E. T., Goodyer, I. M., Fonagy, P., Jones, P. B., Lindenberger, U., & Dolan, R. J. (2019). Compulsivity and impulsivity traits linked to attenuated developmental frontostriatal myelination trajectories. Nature Neuroscience, 22(6), 992–999. 10.1038/s41593-019-0394-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Zucca, F. A., Segura-Aguilar, J., Ferrari, E., Muñoz, P., Paris, I., Sulzer, D., Sarna, T., Casella, L., & Zecca, L. (2017). INTERACTIONS OF IRON, DOPAMINE AND NEUROMELANIN PATHWAYS IN BRAIN AGING AND PARKINSON’S DISEASE. Progress in Neurobiology, 155, 96–119. 10.1016/j.pneurobio.2015.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]




