Skip to main content
Elsevier Sponsored Documents logoLink to Elsevier Sponsored Documents
. 2021 Mar;208:104535. doi: 10.1016/j.cognition.2020.104535

Children perform extensive information gathering when it is not costly

Aislinn Bowler a,b,c, Johanna Habicht a,b, Madeleine E Moses-Payne d, Niko Steinbeis e, Michael Moutoussis a,b, Tobias U Hauser a,b,
PMCID: PMC7871012  PMID: 33370652

Abstract

Humans often face decisions where little is known about the choice options. Gathering information prior to making a choice is an important strategy to improve decision making under uncertainty. This is of particular importance during childhood and adolescence, when knowledge about the world is still limited. To examine how much information youths gather, we asked 107 children (8–9 years, N = 30), early (12–13 years, N = 41) and late adolescents (16–17 years, N = 36) to perform an information sampling task. We find that children gather significantly more information before making a decision compared to adolescents, but only if it does not come with explicit costs. Using computational modelling, we find that this is because children have reduced subjective costs for gathering information. Our findings thus demonstrate how children overcome their limited knowledge and neurocognitive constraints by deploying excessive information gathering, a developmental feature that could inform aberrant information gathering in psychiatric disorders.

Keywords: Cognitive development, Information gathering, Computational modelling

1. Introduction

Throughout life, people regularly encounter new situations and are forced to make decisions that they have never made before. Selecting the optimal choice option in these situations is particularly challenging because humans cannot rely on their previous experience and often have to act with only incomplete knowledge. Such situations are particularly common early in life, as children and adolescents have much more limited knowledge about the world and fewer experiences.

Humans are known to deploy a variety of strategies to solve these decisions under uncertainty. For example, we may make inference about possible outcomes by using a model of the world and relational reasoning (Tenenbaum, Kemp, Griffiths, & Goodman, 2011). We may also account for the potential information gain of a choice when valuating choice options, allowing us to make exploratory choices that are suboptimal in the short-term, but will increase performance in the long-term (Daw, O'Doherty, Dayan, Seymour, & Dolan, 2006; Dubois et al., 2020; Gershman, 2018; Wilson, Geana, White, Ludvig, & Cohen, 2014; Wu, Schulz, Speekenbrink, Nelson, & Meder, 2018). A third strategy is to postpone a decision, and to gather more decision-relevant information prior to making a choice. This information gathering allows to reduce uncertainty about choice options before committing to a choice, and thus helps to prevent making a poor choice in the first place (in part overcoming the exploration/exploitation trade-off). However, information gathering also comes with costs, as the search for information is often costly in terms of time, missed opportunities, and sometimes even financially (Bogacz, Hu, Holmes, & Cohen, 2010; Hauser et al., 2017).

In recent years, cognitive neuroscience has started to reveal the mechanisms underlying information gathering and how healthy adults solve this challenge. A key finding is that humans dynamically adjust their decision criteria depending on how long they have been sampling, and not necessarily based on explicit objective sampling costs (Bogacz, Wagenmakers, Forstmann, & Nieuwenhuis, 2010; Gesiarz, Cahill, & Sharot, 2019; Hauser, Moutoussis, Iannaccone, et al., 2017; Ma, Sanfey, & Ma, 2019; Malhotra, Leslie, Ludwig, & Bogacz, 2017; Thura, Cos, Trung, & Cisek, 2014). This behaviour is evidence for subjective sampling costs that increase as more information is gathered, rendering a long information sampling process unattractive. At an early stage, subjects only stop if there is strong evidence in favour of one option, but after extensive information gathering, participants become more lenient and are more willing to stop gathering information even if there is only slight evidence in favour of one option (Cisek, Puskas, & El-Murr, 2009; Hauser, Moutoussis, Iannaccone, et al., 2017; Malhotra et al., 2017; Moutoussis, Bentall, El-Deredy, & Dayan, 2011; Thura et al., 2014).

Being able to overcome limited information for decisions is particularly pressing during development, as children and adolescents can draw on much less prior experience to make a decision. Strikingly, children and adolescents are able to perform well on decisions under uncertainty (Gopnik, Griffiths, & Lucas, 2015; Tenenbaum et al., 2011), especially when taking their limited neurocognitive resources into account (Paus, 2005; Thompson-Schill, Ramscar, & Chrysikou, 2009; Ziegler et al., 2019). The reason for the efficient and dynamic learning in children is likely to be driven by multiple distinct cognitive features. For example, several studies have shown that children and adolescents differ in how they solve the well-known trade-off between exploration and exploitation, relying on different (often simpler) exploration strategies (Blanco & Sloutsky, 2020; Dubois et al., 2020; Meder, Wu, Schulz, & Ruggeri, 2020; Schulz, Wu, Ruggeri, & Meder, 2019). Moreover, children pro-actively direct their information search to accommodate their knowledge (Gopnik et al., 2017; Gweon, Tenenbaum, & Schulz, 2010; Meder, Nelson, Jones, & Ruggeri, 2019; Ruggeri & Lombrozo, 2014; Ruggeri, Sim, & Xu, 2017).

Relatively little is known about whether the extent of information gathering also changes during development in the transition from childhood to adolescence, which is important given the emergence of psychiatric disorders involving information gathering in youth (Fear & Healy, 1997; Kessler et al., 2005). Differently put, does development also impact how much information is gathered prior to a decision? And if so, what are the mechanisms underlying it? First evidence indeed suggests that children modulate their information gathering according to their own knowledge and external constraints (Gweon, Shafto, & Schulz, 2014), and that information gathering decreases during development (Gweon et al., 2014; Ruggeri, Lombrozo, Griffiths, & Xu, 2016; van den Bos & Hertwig, 2017). However, the computational mechanisms underlying these processes remain unclear, and little is known about whether youth are sensitive to imposed information gathering costs, and how this behaviour changes between childhood and adolescence.

In this study, we investigated how information gathering changes from late childhood (8–9 years of age) to early (12–13 years old) and late adolescence (16–17 years old). We thereby focused on the question whether the subjective costs of sampling change during this period, and whether this is dependent on the explicit costs of information gathering. We thus studied information gathering using a well-established paradigm (Clark, Robbins, Ersche, & Sahakian, 2006) that allows to capture subjective sampling costs in contexts that come with or without explicit sampling costs. Using a computational model of this information gathering task, we show that children engage in an excessive information gathering, but only if it does not incur additional explicit costs.

2. Materials and methods

2.1. Subjects

To assess age-related differences in information gathering, we recruited children and adolescents from schools across London. In total, we recruited 107 youths (62 females) in three age groups: 30 children (aged 8–9 years old (yo), mean 9.34y), 41 young adolescents (12-13yo, mean 13.13yo), and 36 older adolescents (16-17yo, mean 17.19y). We determined the sample size assuming similar, medium to large effect sizes as previous developmental studies and as our own studies with this task (e. g., Decker, Otto, Daw, & Hartley, 2016; Hauser, Moutoussis, Purg, Dayan, & Dolan, 2018; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017; Smid, Kool, Hauser, & Steinbeis, 2020; Somerville et al., 2017; Stenson et al., 2020). Our power simulations (10,000 simulations per group size simulation) revealed that we needed approx. 27 subjects per group to find significant group differences with a power of 80%. The groups did not differ in their age-adjusted IQ estimates (WASI-II; Wechsler, 2011) (children: 93.9 ± 13.4 (mean ± SD); young adolescents 98.5 ± 13.5; late adolescents 97.2 ± 10.3). All youths gave written informed consent, and parental consent was obtained for all participants below the age of 16. The study was approved by the UCL research ethics committee (No. 14261/001). Testing was conducted in a quiet room within the child's school and all subjects received a voucher for participating in the study (value £7). Different data from the same group of children is reported elsewhere (e.g., Dubois, Bowler, et al., 2020; Moses-Payne, Habicht, Bowler, Steinbeis, & Hauser, 2020).

2.2. Task

To study information gathering, we used a modified information sampling task (Clark et al., 2006;Hauser et al., 2018 ; Hauser, Moutoussis, Dayan, & Dolan, 2017 ; Hauser, Moutoussis, Iannaccone, et al., 2017). For each game (Fig. 1A), subjects were presented with 25 covered cards and they needed to decide whether the majority of the cards were either yellow or blue (colours changed on every game; cards could only ever be one of two colours on a given game). Subjects were allowed to overturn as many cards as they wished (using a computer mouse) until they felt certain enough to make their choice. Once they reached that state, they could declare which colour was in the majority by clicking on a colour button below the card deck. After each game, subjects were informed of how many points they won in the game.

Fig. 1.

Fig. 1

Increased information gathering in children. (A) Task procedure: Youths played an information gathering task in which they were allowed to overturn as many cards as they needed before making a decision and declaring whether the yellow or blue cards formed the majority of the 25 originally covered cards. (B) The 8–9 year-old children opened more cards than the early (12-13yo) and late (16-17yo) adolescents in the fixed condition, in which opening cards was not associated with explicit costs. There was no difference in sampling in the decreasing condition, in which their earnings decreased when opening more cards. (C) Moreover, children were slightly worse at choosing the colour that was currently more plentiful in the decreasing condition, indicating worse inference abilities. *** p < .001; ** p < .01; * p < .05; yo year-olds. (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.)

We asked all subjects to play two task versions, in which we manipulated the cost of information gathering (15 games per condition). If children and adolescents are sensitive to external costs, then they should modulate their information gathering between the conditions. In a fixed-win condition, a correct choice was rewarded with +100 points, while a wrong decision was penalised by −100 points. Turning over cards did not impose any explicit costs. In the decreasing-win condition, subjects started with a potential gain of +250 points. However, each overturned card led to a reduced potential win by −10 points (e.g. after 3 draws, a potential win is +220 points). If subjects chose the wrong colour, they always lost 100 points, irrespective of how many cards they had already sampled.

To assess the extent of information gathering in each task condition, our key variable-of-interest was the average number of draws that subjects performed prior to declaring for one of the two colours. This measure reflects the need for information gathering of a subject. As a secondary outcome, we also investigated how well the subject's decision was aligned with the revealed evidence (here termed ‘accuracy’), as an indication of how precise their inference was.

2.3. Statistical analyses

For the behavioural analyses, we ran repeated-measures ANOVAs with a within-subject factor condition (fixed, decreasing) and a between-subject factor group (children, young adolescents, late adolescents). Significant effects were further explored using (independent samples) t-tests. For comparison of the model parameters, we used one-way ANOVAs with the between-subjects group factor. We report effect sizes of all analyses using Cohen's d for t-tests and partial eta-squared η2 for ANOVAs. Here, we present analysis results using ANOVAs, but using age as a continuous variable yielded very similar results (see Supplement).

2.4. Computational model

To investigate the computational mechanisms underlying age-related change in information gathering, we fitted computational models that we have previously developed for this task. We provide a summary of the model with key equations in the Supplementary Material. For a detailed discussion of the model, please see (Hauser et al., 2018; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017). Here we provide a description of the model and the key model parameters.

In this model, the agent makes a decision between three possible choice options: declaring for yellow, declaring for blue, or continuing with sampling (i.e. non-declaring). To make this choice, the agent assigns a value to each of these choice options. The value for declaring for blue or yellow are made based on the agent's current belief that given colour will win, multiplied with the potential win and loss amount. The agent forms this belief based on the cards that they have already opened. For example, if the agent already opened six cards and five of them were yellow, then the agent thinks it is much more likely that yellow will form the majority of cards, than if only three of the six cards were yellow.

To assign a value to the non-declaring choice option, the agent uses planning to project themselves into the future and evaluate how valuable future choices could be. It does that by thinking ahead and considering how clear a decision will be if they continue sampling another x cards, based on what the agent already knows (i.e. the cards it already opened). The quality of this planning process is thereby governed by the decision temperature parameter τ, which determines how precisely the agent plans and makes inference. A low τ thereby reflects an agent's belief to make highly rational decisions and to follow their beliefs strictly. A low τ therefore leads to a precise inference, whilst a high τ reflects a more diffuse inference process.

An additional factor that influences the value of the non-declaring option is the emergence of subjective sampling costs. Model comparison (cf Supplementary Material) showed that subjects internally represent costs for continuing sampling, even when they are not imposed by the experiment (e.g. in the fixed condition). These costs are added to the non-decision value and render it less attractive to continue sampling if the costs are high. These costs are determined by two model parameters: the scaling parameter cs describes how large the costs can maximally become, while parameter p describes when these costs start to emerge. A low p means that these costs incur early in the sampling process, thus promoting an early decision.

For each sample, the agent arbitrates between these three choice alternatives and hence makes predictions about what a subject should choose based on specific model parameters. To compare the model parameters between age groups, we fitted each computational model and parameter to each subject, which then provided us with the best fitting parameters for a given subject (cf Supplementary Material for details). These fitted parameters were subsequently used to make inference about the underlying development-related processes.

3. Results

3.1. Children gather more information when it's free

Three groups of children (8-9yo), early (12-13yo), and late adolescents (16-17yo) performed an information gathering task that we had extensively examined previously in adults and patients (Fig. 1A) (Hauser et al., 2018; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017). Youths were tasked to decide whether the majority of 25 covered cards were yellow or blue. Prior to making a decision, subjects could uncover as many cards as they wished, until they felt ‘certain enough’ with their decision. To assess the impact of external costs on information gathering, each subject played two task conditions. In the ‘fixed’ win condition, no points were deducted for gathering information prior to declaring for a colour, whereas in the ‘decreasing’ win condition the potential wins steadily decreased as a function of sampling (cf methods for more details).

To assess developmental change in information gathering, we investigated whether the groups differed in the number of cards they opened before making a final decision. We found both a significant age group effect (Fig. 1B; F(2,104) = 11.28, p < .001, η2 = 0.178) as well as a significant interaction with condition (F(2,104) = 20.43, p < .001, η2 = 0.282; main effect of condition: F(1,104) = 293.75, p < .001, η2 = 0.739). Subsequent t-tests revealed that this was driven by a significant increase in information gathering in children as compared to adolescents in the fixed (vs early adolescents: t(69) = 4.61, p < .001, d = 1.10; vs late adolescents: t(64) = 5.59, p < .001, d = 1.36), but not in the decreasing condition (vs early adolescents: t(69) = −0.50, p = .617, d = 0.12; vs late adolescents: t(64) = 0.54, p = .589, d = 0.13). No differences between the adolescent groups were observed in any of the analyses. This means that children gather significantly more information than adolescents when there is no explicit cost associated with information gathering, but show equal information gathering when sampling information is expensive. This also suggests that children deploy their information gathering in a strategic way to optimise outcomes.

3.2. Developmental differences in inference

Next, we investigated whether the age groups differed in other aspects of their performance. In particular, we investigated how accurate their decisions were, relative to the opened cards, i.e. whether subjects chose the colour that was more plentiful according to what they had drawn so far. We found that subjects in general performed close to ceiling but despite this, youths were more accurate in the fixed than in the decreasing condition (Fig. 1C; F(1,104) = 4.28, p = .041, η2 = 0.039). Interestingly, we found both a group main effect (F(2,104) = 8.73, p < .001, η2 = 0.144) and a group-by-condition interaction (F(2,104) = 3.88, p = .024, η2 = 0.069). Post-hoc t-tests showed that children were less accurate than adolescents and that this difference was primarily driven by differences in the decreasing condition (vs early adolescents: t(69) = −2.87, p = .005, d = 0.66; vs late adolescents: t(64) = −3.24, p = .002, d = 0.78), but much less so in the fixed condition (vs early adolescents: t(69) = −0.58, p = .564, d = 0.15; vs late adolescents: t(64) = −2.23, p = .030, d = 0.54). This means that children were less precise in their decisions, primarily in the decreasing condition where information gathering per se was already costly and where children did not differ in their information gathering prior to making a decision.

3.3. Excessive information gathering counteracts inference imprecision

To further understand how these behavioural effects came about and what mechanisms were underlying them, we fitted a range of different computational models to subjects' behaviour and then analysed the model parameters of the best-fitting computational model (cf Supplementary Methods; Hauser et al., 2018; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017). This means that the winning model was fitting the data better than the alternative models and was able to correctly predict >75% of choices (cross-validated data; chance level performance: 33%). More details can be found in Fig. S2 and the Supplementary Material.

To characterise the computational aspects that differed between the age groups, we compared the free model parameters, which can be subdivided roughly into two families. The first set of parameters (cs, p) describe the emergence of the subjective sampling costs that control the extent of information gathering prior to declaring for a colour. The other set of parameters governs the precision of the inference and decision process (ξ, τ). They determine how precisely one plans into the future, but also how this information is then used to inform decision making.

3.4. Altered costs drive excessive information gathering in children

One key parameter that governs when in a sampling process subjective costs start to matter (i.e. when it gets subjectively expensive to open further boxes) is parameter p (using separate parameters for the fixed-win and decreasing-win conditions). We have previously found that this parameter is sensitive to dissociate different groups that show differences in the number of draws (Hauser et al., 2018; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017).

In our developmental sample, we found a significant difference between the groups in parameter p of the fixed condition (Fig. 2B; F(2,104) = 11.72, p < .001, η2 = 0.184). Subsequent tests revealed that this was because children had larger parameter values than young and late adolescents (vs early adolescents: t(69) = 3.63, p = .001, d = 0.90; vs late adolescents: t(64) = 5.13, p < .001, d = 1.29). There was no difference in the decreasing condition (Fig. 2E; F(2,104) = 0.49, p = .615, η2 = 0.009). In alignment with our behavioural data, this means that a critical driver underlying the increased information gathering in children is the later arising of subjective costs in the fixed condition.

Fig. 2.

Fig. 2

Model parameters reveal multiple distinct processes change with age. The parameters of the best-fitting model reveal that children differed from the adolescent groups across multiple model parameters. (A) Children have a lowered maximal subjective cost parameter as well as a later emergence of these costs in the fixed (B), but not in the decreasing (E) condition, which is underlying the increased information gathering behaviour in the former condition. Children also had an increased decision temperature in the decreasing (F) condition. The higher decision temperature for the decreasing condition suggests that in this more demanding setting, children perform less precise inference. A difference in decision temperature in the fixed condition did not survive multiple comparison correction (C). We found no difference in decision noise between the groups (D). *** p < .001; (*) uncorrected p < .05, which did not survive Bonferroni multiple comparison correction.

Interestingly, there was also a group effect on the scaling of the costs cs (Fig. 2A; F(2,104) = 7.92, p = .001, η2 = 0.132). This was driven by a reduced maximal cost (i.e. smaller scaling parameter cs) in children compared to the older groups (vs early adolescent: t(69) = 2.903, p = .005, d = 0.69; vs late adolescents: t(64) = 3.88, p < .001, d = 0.95). This suggests that there may be multiple mechanisms at work in children, not only a delay in when these costs arise (parameter p), but also that sampling costs are generally perceived as less costly.

3.5. Reduced inference precision in children

Next, we investigated the parameters related to the precision of their inference and action. The first parameter ξ characterises a decision noise or noise floor, which accounts for decisions that were unguided by any traceable reasoning process in our model. We did not find any difference in this parameter between the three groups (Fig. 2D; F(2,104) = 0.37, p = .695, η2 = 0.007). Next, we investigated whether the inference precision parameter τ differed between age groups. This parameter not only determines how strictly you stick to the best possible option, but also governs how deterministic and precise the inference process takes place.

In the fixed condition, a difference in τ did not survive multiple comparison correction (Fig. 2C; F(2,104) = 4.49, p = .013 uncorrected, p = .078 Bonferroni corrected, η2 = 0.080), in line with non-significant results in the continuous age analyses (cf. Supplementary Material).

In the decreasing condition we found a significant age group effect on τ (Fig. 2F; F(2,104) = 14.76, p < .001, η2 = 0.221). This was driven by an increased τ in the children compared to the adolescents (vs early adolescents: t(69) = 4.88, p < .001, d = 1.23; vs late adolescents: t(64) = 5.51, p < .001, d = 1.39). This means that children make less precise inference in the decreasing condition.

4. Discussion

How can children make good decisions despite limited knowledge, experience, and computational resources? Here, we show that children increase the extent of their information gathering, but only if this is not costly.

Children are assumed to have limited resources and knowledge to draw from (Gopnik et al., 2015; Thompson-Schill et al., 2009), but they manage to learn and navigate the world with an astonishing sophistication. A variety of features that help children to actively learn and seek information have been identified (Tenenbaum et al., 2011). For example, children use computationally less expensive strategies and heuristics to guide their exploration (Blanco & Sloutsky, 2020; Dubois, Bowler, et al., 2020; Meder et al., 2020; Schulz et al., 2019). Moreover, children know to deploy information gathering strategies that are tailored to their existing knowledge (Gopnik et al., 2017; Gweon et al., 2010; Ruggeri et al., 2017; Ruggeri & Lombrozo, 2014). Here, we extend these findings and show that children in addition extend their information gathering, but only when it comes at no additional explicit costs.

Excessive information gathering in children may appear counter-intuitive at first, because children are believed to be generally more impulsive and avoid long deliberation (Moutoussis, Dolan, & Dayan, 2016; Olson, Hooper, Collins, & Luciana, 2007; Peters & Büchel, 2011; Steinberg et al., 2009). Moreover, lower attention span and cognitive limitations would also suggest that children may tire more quickly. However, our findings are in line with previous findings showing persisting information searches in children compared to adults (Ruggeri et al., 2016). To resolve this contradiction, it is important to acknowledge that information gathering costs are always relative to the information gain and the outcomes of the choice. The extended information gathering and reduced sampling costs (cf below) in children thus means that spending time on gathering information does not appear as costly for the children relative to the possible gains they have when making the correct decision. This could be beneficially used in educational or related settings, in which reducing the costs for a child to gather more information could benefit them and help them to learn better.

Our findings also show that children are indeed highly sensitive to external sampling costs and adjust their behaviour similar to adults when external sampling costs are imposed. In the costed condition, where gathering each piece of information incurs an explicit cost, children did not differ in their sampling behaviour. This means that children (as well as adolescents) are able to flexibly adjust their information gathering based on the external incentive structure. In the costed condition, excessive information gathering would not have been beneficial for children, because sampling more information would have led to a reduction in possible wins, thus leading to worse overall performance (cf Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017). The condition-specific findings thus clearly show that children are sensitive to the external costs and take these into account when gathering information. This is in line with previous work, showing that children take costs into account when learning (Gweon et al., 2014). We did not observe any difference in information gathering between early and late adolescents. This could be because changes in this age range are more nuanced than between children and adolescents. Moreover, information gathering differences could be present primarily in more complex decision problems that require excessive use of cognitive maps and model-based reasoning (Schulz et al., 2019; Vaghi et al., 2020). In addition, it would be interesting to observe how information gathering changes in even younger children and to assess whether pre-school children show similar levels of information-gathering.

Our computational modelling revealed that the behavioural differences were driven by different mechanisms. Analysing the model parameters, we found that the observed increase in information gathering in children in the fixed condition is driven by a strong developmental effect on when the subjective costs arise during sampling (parameter p). This means that children are gathering more information because their subjective costs kick in later. We did not find any difference in that parameter in the decreasing condition, in which this parameter also captures the objective costs (i.e. the reduction in wins per sample). Interestingly, we additionally found a general scaling effect of the subjective costs with children having a lower cost scaling parameter cs, which affects both conditions of the task. This means that even when the costs of gathering information kick in, children still perceive these costs as less grave than adolescents. The exact nature of these intrinsic costs remain unclear and are likely to constitute a conglomerate of subjective factors, such as time costs, fatigue, or cognitive effort. Moreover, how exactly they relate to the externally imposed costs and how they are scaled relative to the potential wins and losses should be studied in more detail in future studies. Nevertheless, our findings suggest that children deploy multiple, potentially distinct, processes to increase their information gathering. Some of these processes seem to be condition-specific and primarily apply when there are no explicit costs associated with gathering information. Other processes are more general, affecting all conditions similarly.

We additionally found that the children's inference precision (parameter τ) was lower in the decreasing condition, in line with children's lower accuracy in that condition. In our model, this parameter not only governs how strongly the actual choices depend on their individual valuation, but also determines how precisely you think about the future and thus how well you can rely on the current information you have already gathered. Our finding is thus likely to align with a slow emergence of model-based reasoning (Decker et al., 2016; Smid et al., 2020; Vaghi et al., 2020) and related aspects of higher-order cognitive computations (e.g., Bolenz & Eppinger, 2020; Decker et al., 2016; Hauser, Iannaccone, Walitza, Brandeis, & Brem, 2015; Somerville et al., 2017; Tymula et al., 2012; van den Bos, Rodriguez, Schweitzer, & McClure, 2015) that require substantial resources that may not be available until later in adolescence (Thompson-Schill et al., 2009; Ziegler et al., 2019).

An inherent limitation in this cognitive resource could be overcome by gathering additional information when this comes for free, as seen in our fixed condition. This means that one can outsource the highly demanding inference process and investing in further information gathering, which simplifies the decision problem (because the difference between yellow and blue gets stronger with further sampling). This may also explain why children perform worse when they are not gathering more information, and it shows that children are strategic in their information gathering adjusting it to external circumstances. It would be interesting to further examine these mechanisms and whether the excessive information gathering in the fixed condition is linked to the children's uncertainty about the choice and planning process as, for example, captured by their confidence (cf. Moses-Payne et al., 2020; Weil et al., 2013). Moreover, it would be interesting to assess whether the effects remain if the incentive structure would be changed (e.g. sweets instead of points).

Relatively little is known about the neural mechanisms underlying information gathering and the associated sampling costs. Studies in perceptual decision making suggest that decision signals are boosted by accumulating costs that promote timely decisions (Cisek et al., 2009; Thura et al., 2014; Thura, Beauregard-Racine, Fradet, & Cisek, 2012; Thura and Cisek, 2014, Thura and Cisek, 2016). In addition, a recent pharmacological study suggests that noradrenaline may be critical for the modulation of these information costs (Hauser et al., 2018). A more detailed investigation of the neural mechanisms as well as the neurotransmitters underlying the developmental effect we observed in our study would thus be desirable.

Aberrant information gathering behaviour is also a key feature of psychiatric disorders, such as obsessive-compulsive disorder (Chamberlain et al., 2007; Dar, Rish, Hermesh, Taub, & Fux, 2000; Fear & Healy, 1997; Grassi et al., 2015; Hauser, Moutoussis, Dayan, & Dolan, 2017; Hauser, Moutoussis, Iannaccone, et al., 2017; Jacobsen, Freeman, & Salkovskis, 2012; Pélissier & O'Connor, 2002; Volans, 1976; Voon et al., 2016) or schizophrenia (Ermakova et al., 2018; Garety, Hemsley, & Wessely, 1991; Huq, Garety, & Hemsley, 1988; Jepsen et al., 2018; Moutoussis et al., 2011; So, Siu, Wong, Chan, & Garety, 2016). Interestingly, these disorders have been linked to parameters similar to the ones we found change from childhood to adolescence (Hauser, Moutoussis, Iannaccone, et al., 2017; Moutoussis et al., 2011). Whether aberrant information gathering during the transition to adolescence is linked to the emergence of these psychiatric disorders needs to be investigated in longitudinal studies.

In summary, we show that information gathering behaviour decreases between childhood and early adolescence. Using computational modelling, we show that children gather information excessively when it comes at no explicit costs. This increased information gathering may be beneficial in situations in which little is known and where learning can only take place once the choice options are better understood. These findings may help understand how different information gathering impairments arise in adolescence-related psychiatric disorders.

Data and code availability

Data is available from the corresponding author upon reasonable request. A toolbox with the computational model is currently in preparation.

Declaration of Competing Interest

None.

Acknowledgements

We thank the children, adolescents, their schools (especially Sydney Russell School, Baden Powell School and Holmleigh Primary School) and families for taking part in our study. We thank Shona Waters for her help with collecting the data. AB is supported by a Medical Research Council Studentship (MR/R015759/1). TUH is supported by a Wellcome Sir Henry Dale Fellowship (211155/Z/18/Z), a grant from the Jacobs Foundation (2017-1261-04), the Medical Research Foundation, and a 2018 NARSAD Young Investigator Grant (27023) from the Brain & Behavior Research Foundation. MM receives support from the UCLH NIHR BRC. The Max Planck UCL Centre is a joint initiative supported by UCL and the Max Planck Society. The Wellcome Centre for Human Neuroimaging is supported by core funding from the Wellcome Trust (203147/Z/16/Z). The authors declare no competing financial interests.

Footnotes

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.cognition.2020.104535.

Appendix A. Supplementary data

Supplementary material

mmc1.pdf (345KB, pdf)

References

  1. Blanco N.J., Sloutsky V.M. Systematic exploration and uncertainty dominate young children’s choices. Developmental Science. 2020:e13026. doi: 10.1111/desc.13026. n/a(n/a) [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Bogacz R., Hu P.T., Holmes P.J., Cohen J.D. Do humans produce the speed-accuracy trade-off that maximizes reward rate? Quarterly Journal of Experimental Psychology (2006) 2010;63(5):863–891. doi: 10.1080/17470210903091643. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bogacz R., Wagenmakers E.-J., Forstmann B.U., Nieuwenhuis S. The neural basis of the speed–accuracy tradeoff. Trends in Neurosciences. 2010;33(1):10–16. doi: 10.1016/j.tins.2009.09.002. [DOI] [PubMed] [Google Scholar]
  4. Bolenz F., Eppinger B. 2020. Valence bias in metacontrol of decision making in adolescents and young adults. [DOI] [PubMed] [Google Scholar]
  5. van den Bos W., Hertwig R. Adolescents display distinctive tolerance to ambiguity and to uncertainty during risky decision making. Scientific Reports. 2017;7:40962. doi: 10.1038/srep40962. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. van den Bos W., Rodriguez C.A., Schweitzer J.B., McClure S.M. Adolescent impatience decreases with increased frontostriatal connectivity. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(29):E3765–E3774. doi: 10.1073/pnas.1423095112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Chamberlain S.R., Fineberg N.A., Blackwell A.D., Clark L., Robbins T.W., Sahakian B.J. A neuropsychological comparison of obsessive-compulsive disorder and trichotillomania. Neuropsychologia. 2007;45(4):654–662. doi: 10.1016/j.neuropsychologia.2006.07.016. [DOI] [PubMed] [Google Scholar]
  8. Cisek P., Puskas G.A., El-Murr S. Decisions in changing conditions: The urgency-gating model. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience. 2009;29(37):11560–11571. doi: 10.1523/JNEUROSCI.1844-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Clark L., Robbins T.W., Ersche K.D., Sahakian B.J. Reflection impulsivity in current and former substance users. Biological Psychiatry. 2006;60(5):515–522. doi: 10.1016/j.biopsych.2005.11.007. [DOI] [PubMed] [Google Scholar]
  10. Dar R., Rish S., Hermesh H., Taub M., Fux M. Realism of confidence in obsessive-compulsive checkers. Journal of Abnormal Psychology. 2000;109(4):673–678. doi: 10.1037/0021-843X.109.4.673. [DOI] [PubMed] [Google Scholar]
  11. Daw N.D., O’Doherty J.P., Dayan P., Seymour B., Dolan R.J. Cortical substrates for exploratory decisions in humans. Nature. 2006;441(7095):876–879. doi: 10.1038/nature04766. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Decker J.H., Otto A.R., Daw N.D., Hartley C.A. From creatures of habit to goal-directed learners: Tracking the developmental emergence of model-based reinforcement learning. Psychological Science. 2016;27(6):848–858. doi: 10.1177/0956797616639301. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Dubois M., Bowler A., Moses-Payne M.E., Habicht J., Steinbeis N., Hauser T.U. Tabula-rasa exploration decreases during youth and is linked to ADHD symptoms. BioRxiv. 2020;2020(06):11.146019. doi: 10.1101/2020.06.11.146019. [DOI] [Google Scholar]
  14. Dubois M., Habicht J., Michely J., Moran R., Dolan R.J., Hauser T.U. Noradrenaline modulates tabula-rasa exploration. BioRxiv. 2020 doi: 10.1101/2020.02.20.958025. 2020.02.20.958025. [DOI] [Google Scholar]
  15. Ermakova A.O., Gileadi N., Knolle F., Justicia A., Anderson R., Fletcher P.C.…Murray G.K. Cost evaluation during decision-making in patients at early stages of psychosis. Computational Psychiatry. 2018;3:18–39. doi: 10.1162/cpsy_a_00020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Fear C.F., Healy D. Probabilistic reasoning in obsessive-compulsive and delusional disorders. Psychological Medicine. 1997;27(1):199–208. doi: 10.1017/s0033291796004175. [DOI] [PubMed] [Google Scholar]
  17. Garety P.A., Hemsley D.R., Wessely S. Reasoning in deluded schizophrenic and paranoid patients. Biases in performance on a probabilistic inference task. The Journal of Nervous and Mental Disease. 1991;179(4):194–201. doi: 10.1097/00005053-199104000-00003. [DOI] [PubMed] [Google Scholar]
  18. Gershman S.J. Deconstructing the human algorithms for exploration. Cognition. 2018;173:34–42. doi: 10.1016/j.cognition.2017.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Gesiarz F., Cahill D., Sharot T. Evidence accumulation is biased by motivation: A computational account. PLoS Computational Biology. 2019;15(6) doi: 10.1371/journal.pcbi.1007089. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Gopnik A., Griffiths T.L., Lucas C.G. 2015. When younger learners can be better (or at least more open-minded) than older ones: Current directions in psychological science. [DOI] [Google Scholar]
  21. Gopnik A., O’Grady S., Lucas C.G., Griffiths T.L., Wente A., Bridgers S.…Dahl R.E. Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood. Proceedings of the National Academy of Sciences of the United States of America. 2017;114(30):7892–7899. doi: 10.1073/pnas.1700811114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Grassi G., Pallanti S., Righi L., Figee M., Mantione M., Denys D.…Stratta P. Think twice: Impulsivity and decision making in obsessive-compulsive disorder. Journal of Behavioral Addictions. 2015;4(4):263–272. doi: 10.1556/2006.4.2015.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Gweon H., Shafto P., Schulz L.E. CogSci; 2014. Children consider prior knowledge and the cost of information both in learning from and teaching others. [Google Scholar]
  24. Gweon H., Tenenbaum J.B., Schulz L.E. Infants consider both the sample and the sampling process in inductive generalization. Proceedings of the National Academy of Sciences. 2010;107(20):9066–9071. doi: 10.1073/pnas.1003095107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Hauser T.U., Iannaccone R., Walitza S., Brandeis D., Brem S. Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development. NeuroImage. 2015;104:347–354. doi: 10.1016/j.neuroimage.2014.09.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Hauser T.U., Moutoussis M., Dayan P., Dolan R.J. Increased decision thresholds trigger extended information gathering across the compulsivity spectrum. Translational Psychiatry. 2017;7(12):1296. doi: 10.1038/s41398-017-0040-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hauser T.U., Moutoussis M., Iannaccone R., Brem S., Walitza S., Drechsler R.…Dolan R.J. Increased decision thresholds enhance information gathering performance in juvenile Obsessive-Compulsive Disorder (OCD) PLoS Computational Biology. 2017;13(4) doi: 10.1371/journal.pcbi.1005440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Hauser T.U., Moutoussis M., Purg N., Dayan P., Dolan R.J. Beta-blocker propranolol modulates decision urgency during sequential information gathering. Journal of Neuroscience. 2018:0192–0218. doi: 10.1523/JNEUROSCI.0192-18.2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Huq S.F., Garety P.A., Hemsley D.R. Probabilistic judgements in deluded and non-deluded subjects. The Quarterly Journal of Experimental Psychology. A Human Experimental Psychology. 1988;40(4):801–812. doi: 10.1080/14640748808402300. [DOI] [PubMed] [Google Scholar]
  30. Jacobsen P., Freeman D., Salkovskis P. Reasoning bias and belief conviction in obsessive-compulsive disorder and delusions: Jumping to conclusions across disorders? The British Journal of Clinical Psychology/The British Psychological Society. 2012;51(1):84–99. doi: 10.1111/j.2044-8260.2011.02014.x. [DOI] [PubMed] [Google Scholar]
  31. Jepsen J.R.M., Rydkjaer J., Fagerlund B., Pagsberg A.K., Jespersen R.F., Glenthøj B.Y., Oranje B. Overlapping and disease specific trait, response, and reflection impulsivity in adolescents with first-episode schizophrenia spectrum disorders or attention-deficit/hyperactivity disorder. Psychological Medicine. 2018;48(4):604–616. doi: 10.1017/S0033291717001921. [DOI] [PubMed] [Google Scholar]
  32. Kessler R.C., Berglund P., Demler O., Jin R., Merikangas K.R., Walters E.E. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  33. Ma I., Sanfey A.G., Ma W.J. The cost of appearing suspicious? Information gathering in trust decisions. BioRxiv. 2019 doi: 10.1101/495697. [DOI] [Google Scholar]
  34. Malhotra G., Leslie D.S., Ludwig C.J.H., Bogacz R. Overcoming indecision by changing the decision boundary. Journal of Experimental Psychology. General. 2017;146(6):776–805. doi: 10.1037/xge0000286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Meder B., Nelson J.D., Jones M., Ruggeri A. Stepwise versus globally optimal search in children and adults. Cognition. 2019;191 doi: 10.1016/j.cognition.2019.05.002. [DOI] [PubMed] [Google Scholar]
  36. Meder B., Wu C.M., Schulz E., Ruggeri A. PsyArXiv; 2020. Development of directed and random exploration in children [preprint] [DOI] [PubMed] [Google Scholar]
  37. Moses-Payne M.E., Habicht J., Bowler A., Steinbeis N., Hauser T.U. 2020. I know better! Emerging metacognition allows adolescents to ignore false advice. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Moutoussis M., Bentall R.P., El-Deredy W., Dayan P. Bayesian modelling of jumping-to-conclusions bias in delusional patients. Cognitive Neuropsychiatry. 2011;16(5):422–447. doi: 10.1080/13546805.2010.548678. [DOI] [PubMed] [Google Scholar]
  39. Moutoussis M., Dolan R.J., Dayan P. How people use social information to find out what to want in the paradigmatic case of inter-temporal preferences. PLoS Computational Biology. 2016;12(7) doi: 10.1371/journal.pcbi.1004965. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Olson E.A., Hooper C.J., Collins P., Luciana M. Adolescents’ performance on delay and probability discounting tasks: Contributions of age, intelligence, executive functioning, and self-reported externalizing behavior. Personality and Individual Differences. 2007;43(7):1886–1897. doi: 10.1016/j.paid.2007.06.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Paus T. Mapping brain maturation and cognitive development during adolescence. Trends in Cognitive Sciences. 2005;9(2):60–68. doi: 10.1016/j.tics.2004.12.008. [DOI] [PubMed] [Google Scholar]
  42. Pélissier M.-C., O’Connor K.P. Deductive and inductive reasoning in obsessive-compulsive disorder. The British Journal of Clinical Psychology/The British Psychological Society. 2002;41(Pt 1):15–27. doi: 10.1348/014466502163769. [DOI] [PubMed] [Google Scholar]
  43. Peters J., Büchel C. The neural mechanisms of inter-temporal decision-making: Understanding variability. Trends in Cognitive Sciences. 2011;15(5):227–239. doi: 10.1016/j.tics.2011.03.002. [DOI] [PubMed] [Google Scholar]
  44. Ruggeri A., Lombrozo T. Learning by asking: How children ask questions to achieve efficient search. Proceedings of the Annual Meeting of the Cognitive Science Society. 2014;36(36) https://escholarship.org/uc/item/32c734r9 [Google Scholar]
  45. Ruggeri A., Lombrozo T., Griffiths T.L., Xu F. Sources of developmental change in the efficiency of information search. Developmental Psychology. 2016;52(12):2159–2173. doi: 10.1037/dev0000240. [DOI] [PubMed] [Google Scholar]
  46. Ruggeri A., Sim Z.L., Xu F. “Why is Toma late to school again?” Preschoolers identify the most informative questions. Developmental Psychology. 2017;53(9):1620–1632. doi: 10.1037/dev0000340. [DOI] [PubMed] [Google Scholar]
  47. Schulz E., Wu C.M., Ruggeri A., Meder B. Searching for rewards like a child means less generalization and more directed exploration. Psychological Science. 2019;30(11):1561–1572. doi: 10.1177/0956797619863663. [DOI] [PubMed] [Google Scholar]
  48. Smid C.R., Kool W., Hauser T.U., Steinbeis N. PsyRxiv; 2020. Model-based decision-making and its metacontrol in childhood. [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. So S.H.-W., Siu N.Y.-F., Wong H.-L., Chan W., Garety P.A. “Jumping to conclusions” data-gathering bias in psychosis and other psychiatric disorders—Two meta-analyses of comparisons between patients and healthy individuals. Clinical Psychology Review. 2016 doi: 10.1016/j.cpr.2016.05.001. [DOI] [PubMed] [Google Scholar]
  50. Somerville L.H., Sasse S.F., Garrad M.C., Drysdale A.T., Abi Akar N., Insel C., Wilson R.C. Charting the expansion of strategic exploratory behavior during adolescence. Journal of Experimental Psychology. General. 2017;146(2):155–164. doi: 10.1037/xge0000250. [DOI] [PubMed] [Google Scholar]
  51. Steinberg L., Graham S., O’Brien L., Woolard J., Cauffman E., Banich M. Age differences in future orientation and delay discounting. Child Development. 2009;80(1):28–44. doi: 10.1111/j.1467-8624.2008.01244.x. [DOI] [PubMed] [Google Scholar]
  52. Stenson A.F., Nugent N.R., van Rooij S.J.H., Minton S.T., Compton A.B., Hinrichs R., Jovanovic T. Puberty drives fear learning during adolescence. Developmental Science. 2020:e13000. doi: 10.1111/desc.13000. n/a(n/a) [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Tenenbaum J.B., Kemp C., Griffiths T.L., Goodman N.D. How to grow a mind: Statistics, structure, and abstraction. Science. 2011;331(6022):1279–1285. doi: 10.1126/science.1192788. [DOI] [PubMed] [Google Scholar]
  54. Thompson-Schill S.L., Ramscar M., Chrysikou E.G. Cognition without control: When a little frontal lobe goes a long way. Current Directions in Psychological Science. 2009 doi: 10.1111/j.1467-8721.2009.01648.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Thura D., Beauregard-Racine J., Fradet C.-W., Cisek P. Decision making by urgency gating: Theory and experimental support. Journal of Neurophysiology. 2012;108(11):2912–2930. doi: 10.1152/jn.01071.2011. [DOI] [PubMed] [Google Scholar]
  56. Thura D., Cisek P. Deliberation and commitment in the premotor and primary motor cortex during dynamic decision making. Neuron. 2014;81(6):1401–1416. doi: 10.1016/j.neuron.2014.01.031. [DOI] [PubMed] [Google Scholar]
  57. Thura D., Cisek P. Modulation of premotor and primary motor cortical activity during volitional adjustments of speed-accuracy trade-offs. The Journal of Neuroscience. 2016;36(3):938–956. doi: 10.1523/JNEUROSCI.2230-15.2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Thura D., Cos I., Trung J., Cisek P. Context-dependent urgency influences speed-accuracy trade-offs in decision-making and movement execution. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience. 2014;34(49):16442–16454. doi: 10.1523/JNEUROSCI.0162-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Tymula A., Rosenberg Belmaker L.A., Roy A.K., Ruderman L., Manson K., Glimcher P.W., Levy I. Adolescents’ risk-taking behavior is driven by tolerance to ambiguity. Proceedings of the National Academy of Sciences of the United States of America. 2012;109(42):17135–17140. doi: 10.1073/pnas.1207144109. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Vaghi M.M., Moutoussis M., Vasa F., Kievit R.A., Hauser T.U., Vértes P.E.…Dolan R.J. Compulsivity is linked to reduced adolescent development of goal-directed control and fronto-striatal functional connectivity. Proceedings of the National Academy of Sciences. 2020;117:25911–25922. doi: 10.1073/pnas.1922273117. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Volans P.J. Styles of decision-making and probability appraisal in selected obsessional and phobic patients. British Journal of Social and Clinical Psychology. 1976;15(3):305–317. doi: 10.1111/j.2044-8260.1976.tb00038.x. [DOI] [PubMed] [Google Scholar]
  62. Voon V., Droux F., Morris L., Chabardes S., Bougerol T., David O.…Polosan M. Decisional impulsivity and the associative-limbic subthalamic nucleus in obsessive-compulsive disorder: Stimulation and connectivity. Brain. 2016 doi: 10.1093/brain/aww309. [DOI] [PMC free article] [PubMed] [Google Scholar]
  63. Wechsler D. NCS Pearson; 2011. Wechsler abbreviated scala of intelligence, second edition (WASI-II) [Google Scholar]
  64. Weil L.G., Fleming S.M., Dumontheil I., Kilford E.J., Weil R.S., Rees G.…Blakemore S.-J. The development of metacognitive ability in adolescence. Consciousness and Cognition. 2013;22(1):264–271. doi: 10.1016/j.concog.2013.01.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Wilson R.C., Geana A., White J.M., Ludvig E.A., Cohen J.D. Humans use directed and random exploration to solve the explore-exploit dilemma. Journal of Experimental Psychology. General. 2014;143(6):2074–2081. doi: 10.1037/a0038199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Wu C.M., Schulz E., Speekenbrink M., Nelson J.D., Meder B. Generalization guides human exploration in vast decision spaces. Nature Human Behaviour. 2018;2(12):915–924. doi: 10.1038/s41562-018-0467-4. [DOI] [PubMed] [Google Scholar]
  67. Ziegler G., Hauser T.U., Moutoussis M., Bullmore E.T., Goodyer I.M., Fonagy P.…Dolan R.J. Compulsivity and impulsivity traits linked to attenuated developmental frontostriatal myelination trajectories. Nature Neuroscience. 2019;22(6):992–999. doi: 10.1038/s41593-019-0394-3. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary material

mmc1.pdf (345KB, pdf)

Data Availability Statement

Data is available from the corresponding author upon reasonable request. A toolbox with the computational model is currently in preparation.

RESOURCES