Abstract
Decision-making in the context of risk is a complex and dynamic process that changes across development. Here, we assess the influence of learning and sensitivity to negative feedback (i.e., loss) on age-related changes in risky decision-making, both of which can show unique developmental trajectories. The present study examined risky decision-making in 216 individuals, ranging in age from 3–26 years, using the Balloon Emotional Learning Task (BELT), a computerized task in which participants pump up a series of virtual balloons in order to earn points, but risk balloon explosion on each trial which results in no points. Importantly, there were three balloon conditions, signified by different balloon colors, ranging from quick- to slow-to-explode, and participants could learn the color–condition pairings via task experience. Overall, we found age-related increases in pumps made and points earned. However, in the quick-to-explode condition, there was a nonlinear adolescent peak for points earned. Follow-up analyses indicated that this adolescent phenotype occurred at the developmental intersection of linear age-related increases in learning and decreases in sensitivity to negative feedback. Adolescence was marked by intermediate values on both these processes. These findings show that a combination of linearly changing processes can result in non-linear changes in risky decision-making, where adolescent-specific risky decision-making is associated with developmental improvements in learning and reduced sensitivity to negative feedback.
Keywords: risky decision-making, sensitivity to negative feedback, development
Decision-making is a complex behavior (Rangel, Camerer, & Montague, 2008). Perhaps unsurprisingly, effective decision-making in the context of risk is slow to develop, and exhibits non-linear paths across development (Boyer, 2006), reaching maturity in adulthood (Byrnes, 2002). Decision-making under risk consists of multiple psychological processes, including learning from experience (i.e., associative learning), which increases with development (e.g., Dumas, 2005), and sensitivity to negative feedback (i.e., loss), which decreases across development (e.g., Cassotti, Aite, Osmont, Houde, & Borst, 2014; Levin, Hart, Weller, & Harshman, 2007). Characterizing these two processes may provide insight into developmental patterns of decision-making (e.g., nonlinear paths towards mature performance). The current study examined the roles of associative learning and sensitivity to negative feedback in the development of risky decision-making in a cross-sectional sample of children, adolescents, and adults.
Developmental Changes in Sensitivity to Negative Feedback
The salience of negatively valenced feedback (e.g., loss, punishment) differs across development, though even adults do not engage in purely rational decision-making in the context of risk (Kahneman & Tversky, 1979). Numerous cross-sectional studies suggest that young children are particularly sensitive to negative feedback (Levin et al., 2007; Slovic, 1966), showing more reactivity in both behavioral and neural responses to potential loss or punishment (Crone, Bunge, Latenstein, & van der Molen, 2005; van Leijenhorst, Crone, & Bunge, 2006; Van Leijenhorst, Westenberg, & Crone, 2008). In addition, children’s learning is more likely to be motivated by negative feedback, an effect that diminishes with increasing age (Van Den Bos, Cohen, Kahnt, & Crone, 2012), as learning from positive feedback becomes more salient. These findings parallel evidence that early life is normatively characterized by higher reactivity to threatening stimuli (Gullone, 2000; Marks, 1987) and negativity biases (Tottenham, Phuong, Flannery, Gabard-Durnam, & Goff, 2013). Behavior influenced by sensitivity to negative feedback is likely to result in more conservative decision-making, and this effect on decision-making should attenuate with age. In the current study, we examined how negatively valenced feedback influences behavior across development.
Development of Associative Learning
While sensitivity to negative feedback declines across development, the ability to learn associations between stimuli and valenced outcomes increases across development. Learning of stimulus–outcome associations occurs as early as the preschool years (Guo, North, Gorden-Larsen, Bulik, & Choi, 2007; Herbert, Eckerman, & Stanton, 2003), but undergoes significant improvements from childhood into adulthood (Cohen et al., 2010; Dumas, 2005). Successful learning of stimulus–outcome associations is essential for making correct predictions to guide behavior. In the current study, we sought to examine the contributions of both associative learning and sensitivity to negative feedback to risky decision-making across development.
Current Study
We used the Balloon Emotional Learning Task (BELT) (Humphreys, Lee, & Tottenham, 2013) to examine age-related changes (cross-sectional sample from ages 3–26 years), in both sensitivity to negative feedback and associative learning as they relate to risky decision-making. Participants were presented a series of virtual balloons that they could pump up in order to earn points. The task involves risky decision-making as participants must decide whether to continue pumping or to save their earned points. Balloons explode at an initially unknown point, resulting in the loss of accrued points on that trial. Participants are able to learn, through experience, which balloons explode after a few (quick-to-explode), variable, or many (slow-to-explode) pumps. The BELT was adapted from the Balloon Analogue Risk Task (BART; Lejuez et al., 2002). Prior research using the BART has found that pumps made on this task positively correlated with risk-taking behavior in samples of children, adolescents, and adults (Aklin, Lejuez, Zvolensky, Kahler, & Gwadz, 2005; Humphreys & Lee, 2011; Lejuez et al., 2003). Furthermore, recent work indicates that pubertal status is associated with risk-taking on the BART, such that adolescents with advanced pubertal status made more pumps on the task, even after accounting for participant age (Collado, MacPherson, Kurdziel, Rosenberg, & Lejuez, 2014). The BELT was designed specifically to modify the BART in important ways. Namely, the BART contains all uncertain conditions (i.e., the participant is unable to learn the optimal point in which to pump up the balloon because all balloon conditions are variable). While the BELT provides a variable balloon condition, similar to the BART, it also contains two stable balloon conditions (the quick-to-explode condition which has a low explosion threshold and the slow-to-explode condition which has a high explosion threshold). The addition of these conditions allow for the ability to learn stimulus–outcome associations to distinguish contexts in which more pumps would likely result in more points (the slow-to-explode condition) and when this same behavior is more likely to result in the loss of accrued points (the quick-to-explode condition). The BELT provides the ability to obtain measures of (a) risk-taking (pumps), (b) success (points), (c) sensitivity to negatively valenced feedback (post-explosion pump reduction), and (d) associative learning (gain in points). The BELT was designed for use across a wide-range of ages, allowing for the assessment of a number of aspects of risky decision-making from preschool age into adulthood.
Our goal was to examine age-related patterns of risky decision-making on the BELT, and whether changes in sensitivity to negative feedback (i.e., post-explosion pump reduction) and learning (i.e., gain in points, which indexes accumulated learning leading to improvements in task performance) would explain age-related changes on this task. Based on previous work (e.g., Peper, Koolschijn, & Crone, 2013), we anticipated that pumps and points would increase with age. We expected that associative learning would linearly improve with increasing age. We also anticipated that sensitivity to negative feedback would be highest in young children (who would demonstrate a greater decrease in pumping following balloon explosions), and would linearly decrease with age. Lastly, given that adolescence is developmentally intermediate to these changing processes (i.e., sensitivity to negative feedback and learning), and prior work indicating an adolescent-peak in performance due to heightened responsiveness to feedback (Van Der Schaaf, Warmerdam, Crone, & Cools, 2011), we expected to find an adolescent-specific peak in both pumps made and points earned on the “quick-to-explode” balloon condition, as this condition provides the lowest threshold for explosion feedback.
Methods
Participants
The youth (children and adolescents) included were part of a larger, ongoing study of emotional development with children and adolescents from a large metropolitan area in the western United States. We included a total of 158 healthy youths (46% male), though 18 were excluded due to invalid responses (e.g., when the participant intentionally exploded all balloons), resulting in a total of 140 valid participants. This sample ranged in age from 3–17 years old (M=9.12, SD=4.05), and parents reported the following racial/ethnic distribution for these youths: 32% European-American, 30% African-American, 21% other or unknown, 12% Asian-American, 4% American Indian/Alaskan Native, 1% Native Hawaiian or Pacific Islander. Twelve percent identified as Hispanic or Latino(a). This sample consists of the comparison never-institutionalized youth, a portion were previously included in a study examining risky decision-making following institutional rearing (Humphreys et al., 2015). The adult sample has been described previously (Humphreys et al., 2013) and consisted of 76 (34% male) participants. This sample ranged in age from 18–36 years old (M=20.36, SD=2.48), and self-endorsed the following racial/ethnic distribution: 45% Asian-American, 31% European-American, 9% mixed or other, 5% American Indian/Alaskan Native, 4% African-American, 4% Native Hawaiian or Pacific Islander, and 1% Hispanic/Latino(a). A total of 216 participants were included in the analyses. Prior studies with these samples included did not explicitly examine age-related changes on the BELT, and by combining existing samples we have the opportunity to examine behavior on this task in a wide age range.
Procedures
Recruitment methods for the youth sample included California birth records, IRB approved local newspaper ads, and online classifieds. To be eligible for the study, all participants were required to be free of psychiatric/neurological illness and major life trauma as determined via phone screening. Exclusionary criteria included an estimated IQ of less than 80 (for participants age 6–17 years) or severe physical handicap (e.g., quadriplegic, blind, or deaf).
Families were then invited to our laboratory for in-person assessments. Following parent consent and child assent, children completed a standardized test of cognitive ability, self-report measures, and computerized tasks. Parents completed rating scales based on the child’s behavior and parenting practices. Procedures for the adult sample can be found in Humphreys et al. (2013). The Institutional Review Board approved all study procedures.
Measures
Demographic information
Child age and sex were collected via parent report during the phone screen. Date of birth was confirmed at the in-person assessment. The adult sample completed this information via self-report at the time of the assessment.
Balloon Emotional Learning Task (BELT; Humphreys et al., 2013)
All participants completed a computerized risky decision-making task with three different conditions, each with different corresponding explosion points. See Figure 1 for a visual display of the task. For example, pink balloons always exploded at 19 pumps (“slow-to-explode”), orange balloons exploded variably at 7 pumps, 13 pumps, or 19 pumps distributed equally across each third of the task (“variable”), and blue balloons always exploded at 7 pumps (“quick-to-explode”), therefore providing the lowest threshold for feedback. Participants were asked to press a button to “pump up” balloons and earn points based on the number of pumps for each of the 27 balloon trials (i.e., more pumps = more points). Explosions occurred at an initially unknown number of pumps, resulting in the loss of all points for that trial. Balloons color–condition pairings were counterbalanced across participants, and there was an equal number of each balloon condition across each third of the task. Participants were not told that colors signified different response contingencies, but were explicitly told that not all balloons pop at the same point.
Data Analysis
The BELT produces several potential outcome measures of interest: 1) pumps made out of possible pumps, 2) points earned out of possible points, 3) post-explosion pump reduction as a measure of sensitivity to negative feedback, and 4) gain in points earned from the first third to the second third of the task as a measure of associative learning, given that the most rapid learning occurred during this period of the task, and in concert with other work emphasizing early learning in decision-making tasks (Maddox, Baldwin, & Markman, 2006). Linear mixed models with maximum likelihood estimation were used to accommodate the nested structure of the data (i.e., trials within individuals). Age and age squared (following winsorizing of one adult participant’s age from 36 years to the next highest value of 26 years, because it fell three standard deviations above the mean) were included as predictors in order to examine potential changes in outcomes by linear and quadratic age. Participant age (centered), age squared, balloon condition (slow-to-explode, quick-to-explode, and variable), and trial were examined as fixed effects predictors of outcomes, with random slope and intercept within individuals. Balloon condition by age and age squared interactions were examined. Sex was included as a covariate for all analyses, though was not a significant predictor for any outcome.
In order to test mediation, per expert recommendations (e.g., Hayes et al., 2009; MacKinnon, Fairchild, & Fritz, 2007) we conducted a single step test of mediation using SPSS PROCESS (Model 4; Hayes, 2012). To assess the indirect effect, a non-parametric bootstrap procedure using sampling with replacement (n = 5,000) was implemented and 95% bias corrected and accelerated confidence intervals (CI) were calculated for the indirect effect. If the CI does not include zero, the indirect effect is considered statistically significant.
Results
Table 1 provides a correlation matrix and descriptive statistics for the independent variables of interest and outcomes produced by the BELT. Age was positively correlated with pumps on all three balloon conditions, and points on the slow-to-explode and variable condition. There was no correlation between age and points on the quick-to-explode condition. There was a positive correlation between pumps and points for the slow-to-explode and variable conditions, and a negative correlation between these metrics in the quick-to-explode condition, indicating that these represent separable constructs.
Table 1.
1. | 2. | 3. | 4. | 5. | 6. | 7. | 8. | |
---|---|---|---|---|---|---|---|---|
1. Age | 1 | |||||||
2. Sex (Male=1) | −.12† | 1 | ||||||
3. Slow-to-explode Pumps | .40*** | .04 | 1 | |||||
4. Variable Pumps | .39*** | .02 | .79*** | 1 | ||||
5. Quick-to-explode Pumps | .41*** | −.02 | .55*** | .72*** | 1 | |||
6. Slow-to-explode Points | .46*** | .01 | .89*** | .76*** | .60*** | 1 | ||
7. Variable Points | .32*** | −.11† | .38*** | .52*** | .62*** | .50*** | 1 | |
8. Quick-to-explode Points | .10 | −.10 | −.39*** | −.41*** | −.27*** | −.31*** | −.02 | 1 |
Mean (SD) or % | 13.02 (6.32) | 42% | .41 (.19) | .51 (.16) | .81 (.14) | .39 (.15) | .40 (.09) | .46 (.19) |
Note.
p<.10.
p<.001.
Pumps
The mixed effects analysis for pumps on the task, which included 27 observed trials for each of the 216 participants, indicated significant effects of balloon condition (F(1,5661.71)=889.53, p<.001), trial (F(1,348.46)=6.02, p=.015), and age (F(1,222.07)=42.13, p<.001) (see Figure 2). On average, the proportion of pumps made were highest on the quick-to-explode condition (.81, 95% CI [.79, .83]), followed by the variable condition (.51, 95% CI [.49, .53]), and the slow-to-explode condition (.41, 95% CI [.39, .43]), all of which significantly differed from each other (ps<.001). Pumps decreased across the course of the task. Age was associated with more pumps (Est. = 0.01 [0.001], p < .001, 95% CI [0.001, 0.01]), while age squared was not a significant predictor of overall pumps. However, a significant balloon condition by age squared interaction was found (F(1,5661.71)=38.50, p<.001). Analyses were then conducted within each balloon condition to determine the shape of age-related change within each condition. For the slow-to-explode condition, there was a linear effect of age (F(1,219.01)=11.21, p<.001), as well as a quadratic effect of age (F(1,219.01)=4.22, p=.04). For the variable condition, there was a linear effect of age (F(1,222.76)=31.46, p<.001); the quadratic effect of age was not significant (F(1,222.76)=2.73, p=.10). For the quick-to-explode condition, there was both a significant linear (F(1,217.65)=42.35, p<.001) and quadratic effect of age (F(1,217.65)=12.38, p<.001). As can be observed in Figure 2, the age-related pattern of pumps on the slow-to-explode and variable conditions was relatively flat until adolescence, and demonstrated a steep incline from adolescence into adulthood. However, pumps on the quick-to-explode condition increased in early childhood and peaked in late adolescence (age 18). In summary, pumps increased with age, and for the quick-to-explode condition, pumps peaked during adolescence.
Points
The mixed effects analysis for points on the task indicated significant effects of balloon condition (F(1,5804.07)=194.37, p<.001), trial (F(1,678.86)=30.99, p<.001), and age (F(1,222.54)=58.32, p<.001) (see Figure 3). On average, proportion of points earned was highest on the quick-to-explode condition (.46, 95% CI [.45, .48]), while the variable (.39, 95% CI [.38, .41]) and slow-to-explode conditions (.39, 95% CI [.37, .40]) did not significantly differ from one another. Points significantly increased across the task, and increased with age. However, significant balloon condition by age and balloon condition by age squared interactions were found (F(1,5804.07)=5.27, p=.005 and F(1,5804.07)=26.24, p<.001, respectively). Analyses were conducted within each balloon condition to determine the shape of age-related change within each condition. For the slow-to-explode condition, there was a linear (F(1,224.30)=20.97, p<.001) and quadratic effect of age (F(1,224.30)=4.13, p=.04). For the variable condition, a linear effect of age was found (F(1,223.53)=22.88, p<.001); the quadratic effect was not significant (F(1,223.53)=2.70, p=.10). For the quick-to-explode condition, there was both a significant linear (F(1,224.93)=7.63, p=.006) and quadratic effect of age (F(1,224.93)=14.26, p<.001). As can be seen in Figure 3, proportion points earned on the slow-to-explode and variable conditions were relatively flat until adolescence and steeply inclined from adolescence into adulthood. Proportion points earned on the quick-to-explode condition, however, demonstrated a clear peak in mid-adolescence (age 14). Though adults earned the most points on the slow-to-explode and variable conditions, adolescents earned the most points for the quick-to-explode condition, which had the lowest explosion point and therefore provided feedback regarding its explosion threshold with the fewest number of pumps. We next sought to examine the potential differences in task behavior that resulted in the differing success found in adolescents and adults based on balloon condition.
Learning
To assess associative learning during the task, we examined the change in points earned from the first third to the second third of the task, within each balloon condition. As noted above, the most rapid learning occurred during this period of the task, and early learning in decision-making tasks has been a focus of study (Maddox et al., 2006). Ordinary least squares linear regression was used to examine the impact of age and age squared on associative learning, statistically controlling for sex and points earned on the first third in each condition. For plotting purposes (see Figure 4) participants were grouped by age (children [ages 3–11], adolescents [ages 12–17], and adults [ages 18 and older]). A significant effect was found for linear age on the slow-to-explode condition (ΔR2=.05, β=.23, p<.001, 95% CI [−.01, .10]), while the quadratic effect was not significant (ΔR2=.01, β=.08, p=.19, 95% CI [−.01, .03]). Post hoc pairwise comparisons using the Least Significant Difference test for the age groups described above revealed that adults demonstrated significantly more learning than the adolescent and child groups (ps<.002), which did not significantly differ from each other (p=.86). For the variable condition, there was a significant effect of linear age (ΔR2=.02, β=.16, p<.001, 95% CI [−.02, .06]), and again the quadratic effect was not significant (ΔR2=.001, β=−.03, p=.48, 95% CI [−.01, .01]). Post hoc comparisons found that adults and adolescents did not significantly differ from each other (p=.87), and both groups demonstrated significantly more learning than the child group (ps<.04). For the quick-to-explode condition, linear age was not a significant predictor of learning (ΔR2=.001, β=.04, p=.54, 95% CI [−.01, .01]), though the quadratic effect of age was (ΔR2=.04, β=−.19, p<.001, 95% CI [−.01, .08]). Pairwise comparisons demonstrated that adolescents showed significantly more learning than both adult and child groups (ps<.02), which did not significantly differ from each other (p=.90).
Learning as a Mediator of the Association between Age and Points
We next evaluated whether learning mediated the association between age and total points earned, statistically controlling for sex and points earned on the first third of the task. The 95% CI for the indirect effect of learning did not contain zero (point estimate = 0.85 [0.18], 95% CI [0.51, 1.23], thus, supporting that a gain in points mediated the association between age and points earned on the task, even after accounting for initial age differences in points earned on the first third of the task.
Post-explosion Behavior
Because decision-making is influenced by negative feedback (i.e., explosions) from previous trials (Humphreys & Lee, 2011; Humphreys et al., 2015), we examined age-related changes in sensitivity to negative feedback using post-explosion pump reduction on the quick-to-explode condition. This balloon condition had the lowest threshold for explosions and accordingly provided the most opportunity to examine post-explosion reactivity. Post-explosion pump reduction was calculated by taking the mean of the difference in pumps made on each explosion trial and the trial immediately following from the same balloon condition. This measured sensitivity to negative feedback, where positive values indicated fewer pumps on the subsequent balloon whereas a value of zero indicated no change in pumps following the balloon explosion. Thirteen individuals did not explode a balloon, and were therefore not included in this analysis. The mean for post-explosion pump reduction was 0.21 (SD=0.14), and a one-sample t-test demonstrated that this significantly differed from zero (p<.001), such that, on average, individuals pumped less following an exploded balloon. There was a linear effect of age on post-explosion pump reduction (t(200)=−4.32, B = −0.01 [0.002], p<.001, 95% CI [−0.01, −0.004]), but no quadratic effect. For graphing purposes, we plotted standardized (z-score) sensitivity to negative feedback on the above age groups (children, adolescents, and adults) against standardized associative learning (Figure 5). This figure indicates that while learning increased across developmental periods, sensitivity to negative feedback decreased. Whereas children and adults were high on at least one of these scores, adolescents were intermediate on both.
Sensitivity to Negative Feedback as a Mediator of the association between Age and Points
We conducted another mediation analysis to examine whether sensitivity to negative feedback mediated the association between age and total points earned, with sex as a covariate. The 95% CI for the indirect effect of sensitivity to negative feedback did not contain zero (point estimate = 0.16 [0.09], 95% CI [0.02, 0.36], thus, sensitivity to negative feedback also mediated the association between age and points earned on the task.
Discussion
In a cross-sectional sample of individuals from preschool age to early adulthood we observed linear age-related changes in learning (gain in points) and sensitivity to negative feedback (post-explosion pump reduction) that were associated with non-linear changes in both behavior and outcome on a risky decision-making task. Results indicated that age-related patterns in pumps made and points earned varied by task condition. Conditions with higher thresholds for negative feedback (slow-to-explode, variable) exhibited positive age-related increases in points, whereas an adolescent peak in points was found on the condition with the lowest threshold for negative feedback (quick-to-explode).
The Role of Learning during Risky Decision-Making
Learning from experience is of clear importance to successful decision-making, and sequential tasks provide the ability to demonstrate how learning affects subsequent behavior. Older age is associated with greater use of feedback to guide behavior (Byrnes & Beilin, 1991; Byrnes & Overton, 1986). Byrnes and colleagues found that adults not only made better choices at the beginning of a decision-making task compared to adolescents, but also learned more via task experience (Byrnes, Miller, & Reynolds, 1999). This is in concert with our findings that adults demonstrated the greatest learning on the BELT. Learning mediated the association between age and total points earned on the task, supporting other work finding age-related increases in successful risky decision-making (Cassotti et al., 2014). Adults are able to distinguish between balloon conditions from experience (Humphreys et al., 2013), learning that the slow-to-explode balloons explode after a greater number of pumps and the quick-to-explode balloons explode after a smaller number of pumps.
It is important to note that learning was observed across all age groups, indicating that the task was likely understood by even young participants. Work from other implicit learning tasks indicate that this learning may have first occurred at an emotional, rather than strictly cognitive level. The somatic marker hypothesis (Bechara et al., 2000; Bechara, Damasio, Damasio, & Lee, 1999; Damasio, 1994), posits that emotions play a crucial role in learning and decision-making, as the feelings experienced after making decisions results in learning that enables better subsequent decisions.
The Role of Sensitivity to Negative Feedback during Risky Decision-Making
Considering the results from an affective development perspective, this work is consistent with evidence of normative increased negativity bias in childhood (Tottenham et al., 2013), where children seem particularly susceptible to potentially negative information (Van Den Bos et al., 2012). This negativity bias is consistent with the heightened amygdala reactivity commonly observed in childhood, a marker of emotional reactivity at the neural level (Decety, Michalska, & Kinzler, 2012; Decety & Michalska, 2010; Gee et al., 2013; Swartz, Carrasco, Wiggins, Thomason, & Monk, 2014; Vink, Derks, Hoohendam, Hillegers, & Kahn, 2014) paired with immature top-down regulation from the prefrontal cortex (Decety et al., 2012; Gabard-Durnam et al., 2014; Gee et al., 2013; Perlman & Pelphrey, 2011), which is a neural phenotype linked to negative emotionality (Goldin, McRae, Ramel, & Gross, 2008). The present study found that the youngest participants were characterized by high sensitivity to negative feedback and the oldest participants demonstrated low sensitivity to negative feedback; adolescents were intermediate in this behavior. That is, younger age was associated with a greater behavioral reaction (reduced pumping on subsequent trial) to an explosion. An intermediate level of sensitivity to negative feedback appeared to result in better outcomes for adolescents on the quick-to-explode condition, while the same advantage was not found in conditions with a higher threshold for negative feedback. Thus, for the quick-to-explode condition the adolescents’ intermediate level of loss sensitivity resulted in a “sweet spot”, allowing this group to outperform both younger and older participants, as well as providing evidence that adolescents were invested in performing well on the task. A similar adolescent-peak in performance (compared to both children and adults) was found in a study of reversal learning (Van Der Schaaf et al., 2011). The authors also pointed to adolescents’ intermediate level of punishment learning, relative to children and adults, for their success on this task, and ruled out age-related differences in motivation and arousal for the observed inverted-U shaped pattern across development. The BELT, unlike some other implicit decision-making tasks (see Bechara, Damasio, Tranel, & Damasio, 1997), allowed for probing that revealed that increased sensitivity to negative feedback may be advantageous only under certain conditions.
Several converging studies have provided evidence that children and adolescents’ heightened sensitivity to negative feedback can impair decision-making in the context of risk (Aïte et al., 2012; Cassotti, Houdé, & Moutier, 2011; Huizenga, Crone, & Jansen, 2007). For example, children and adolescents are more likely to shift from an advantageous choice following negative feedback compared to adults (van den Bos, Guroglu, van den Bulk, Rombouts, & Crone, 2009), which can result in less adaptive outcomes. On the BELT, this heightened sensitivity likely hampered exploration that would have allowed these younger participants to earn more points on the slow-to-explode balloon condition.
Taken together, the decreased sensitivity to negative feedback found in adults, in combination with prediction-error learning, led to successful decision-making under risk in most circumstances. While detecting errors facilitates learning, so does the ability to tolerate some negative feedback (Cassotti et al., 2014). Adults were willing to tolerate more exploded balloons in order to learn more about the task parameters, enabling them to earn more points on balloon conditions with higher explosion thresholds; yet each balloon exploded resulted in a loss of all points on that trial. Thus, this ability to tolerate loss comes with a cost. The adults’ relative insensitivity to balloon explosions appeared to result in slower learning of the quick-to-explode threshold hold and fewer points earned on this condition compared to adolescents.
There are several limitations to this study that should be noted. Although we treated age as a continuous variable in initial analyses, we defined adolescence broadly in the grouped analyses, and therefore these findings may not be directly comparable to studies using alternative age cut points. Related to this point, our analyses were based on age in years, rather than pubertal status, which may be an important predictor in understanding developmental shifts in emotional processing in adolescence (Steinberg, 2007). Additionally, though our wide age-range allows us to consider age-related changes, the cross-sectional nature of the sample precludes us from studying intraindividual change. It is also possible that given the large range of ages included, understanding of the BELT may have varied based on developmental level, as the task involved multiple decisions to be made. Future work may benefit from obtaining participants’ perceived strategy during and/or after the task. While the BELT provides some distinct advantages over more simplistic tasks, more complex tasks tend to have better ecological validity (Schonberg, Fox, & Poldrack, 2011). It is unclear how outcomes from the BELT align with real-world behavior, though there is evidence that behavior on the BART is associated with real world risk-taking behavior (Lejuez et al., 2002, 2007). Previous work has linked behavior on the BELT to personality traits (e.g., sensation seeking and associative sensitivity; Humphreys et al., 2013) as well as separation anxiety (e.g., Humphreys et al., 2015). Some have recommended separation of the study of risky choice and sensitivity to gains and losses (van Duijvenvoorde & Crone, 2013), which are combined in the present task. As with Cohen et al. (2010), our task allows for the decomposition of stimulus, choice, and feedback, but also differs from other risky decision-making tasks in that the parameters are fixed but unknown to participants, who may or may not determine the explosion thresholds during the 27 trials. Future research will need to address these methodological issues with longer tasks and more varied rewards and losses.
In conclusion, we found overall age-related increases in learning on a risky decision-making task, as well as overall age-related decreases in sensitivity to negative feedback. Both factors predicted changes in successful risky decision-making. Examining developmental changes in risky decision-making and the result of this behavior should take into account these two changing systems. The use of instrumental learning tasks, in which participants choose the degree to which to explore the environment, provides a useful addition to traditional associative learning and risky decision-making tasks.
Acknowledgments
This work was supported by NIMH R01MH091864 and the Dana Foundation to Nim Tottenham, Ph.D. and a National Science Foundation Graduate Research Fellowship to Kathryn L. Humphreys, Ph.D.
References
- Aïte A, Cassotti M, Rossi S, Poirel N, Lubin A, Houdé O, Moutier S. Is human decision making under ambiguity guided by loss frequency regardless of the costs? A developmental study using the Soochow Gambling Task. Journal of Experimental Child Psychology. 2012;113(2):286–94. doi: 10.1016/j.jecp.2012.05.008. [DOI] [PubMed] [Google Scholar]
- Aklin WM, Lejuez CW, Zvolensky MJ, Kahler CW, Gwadz M. Evaluation of behavioral measures of risk taking propensity with inner city adolescents. Behaviour Research and Therapy. 2005;43(2):215–228. doi: 10.1016/j.brat.2003.12.007. [DOI] [PubMed] [Google Scholar]
- Bechara A, Damasio H, Tranel D, Damasio AR. Deciding advantageously before knowing the advantageous strategy. Science. 1997;275:1293–1295. doi: 10.1126/science.275.5304.1293. [DOI] [PubMed] [Google Scholar]
- Boyer T. The development of risk-taking: A multi-perspective review. Developmental Review. 2006;26(3):291–345. doi: 10.1016/j.dr.2006.05.002. [DOI] [Google Scholar]
- Byrnes JP. The development of decision-making. The Journal of Adolescent Health. 2002;31:208–215. doi: 10.1016/S1054-139X(02)00503-7. [DOI] [PubMed] [Google Scholar]
- Byrnes JP, Beilin H. The cognitive basis of uncertainty. Human Development. 1991;34:189–203. doi: 10.1159/000277054. [DOI] [Google Scholar]
- Byrnes JP, Miller DC, Reynolds M. Learning to make good decisions: A self-regulation perspective. Child Development. 1999;70(5):1121–1140. doi: 10.1111/1467-8624.00082. [DOI] [Google Scholar]
- Byrnes JP, Overton WF. Reasoning about certainty and uncertainty in concrete, causal, and propositional contexts. Developmental Psychology. 1986;22:793–799. doi: 10.1037/0012-1649.22.6.793. [DOI] [Google Scholar]
- Cassotti M, Aite A, Osmont A, Houde O, Borst G. What have we learned about the processes involved in the Iowa Gambling Task from developmental studies? Frontiers in Psychology. 2014;5:1–5. doi: 10.3389/fpsyg.2014.00915. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cassotti M, Houdé O, Moutier S. Developmental changes of win-stay and loss-shift strategies in decision making. Child Neuropsychology. 2011;17(4):400–11. doi: 10.1080/09297049.2010.547463. [DOI] [PubMed] [Google Scholar]
- Cohen JR, Asarnow RF, Sabb FW, Bilder RM, Bookheimer SY, Knowlton BJ, Poldrack Ra. A unique adolescent response to reward prediction errors. Nature Neuroscience. 2010;13(6):669–71. doi: 10.1038/nn.2558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collado A, MacPherson L, Kurdziel G, Rosenberg LA, Lejuez CW. The relationship between puberty and risk taking in the real world and in the laboratory. Personality and Individual Differences. 2014;68:143–148. doi: 10.1016/j.paid.2014.04.019. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Crone EA, Bunge SA, Latenstein H, van der Molen MW. Characterization of children’s decision making: Sensitivity to punishment frequency, not task complexity. Child Neuropsychology. 2005;11:245–263. doi: 10.1080/092970490911261. [DOI] [PubMed] [Google Scholar]
- Decety J, Michalska KJ. Neurodevelopmental changes in the circuits underlying empathy and sympathy from childhood to adulthood. Developmental Science. 2010;13(6):886–899. doi: 10.1111/j.1467-7687.2009.00940.x. [DOI] [PubMed] [Google Scholar]
- Decety J, Michalska KJ, Kinzler KD. The contribution of emotion and cognition to moral sensitivity: A neurodevelopmental study. Cerebral Cortex. 2012;22(1):209–220. doi: 10.1093/cercor/bhr111. [DOI] [PubMed] [Google Scholar]
- Dumas TC. Developmental regulation of cognitive abilities: modified composition of a molecular switch turns on associative learning. Progress in Neurobiology. 2005;76(3):189–211. doi: 10.1016/j.pneurobio.2005.08.002. [DOI] [PubMed] [Google Scholar]
- Gabard-Durnam LJ, Flannery J, Goff B, Gee DG, Humphreys KL, Telzer E, Tottenham N. The development of human amygdala functional connectivity at rest from 4 to 23 years: A cross-sectional study. Neuro Image. 2014;95:193–207. doi: 10.1016/j.neuroimage.2014.03.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gee DG, Humphreys KL, Flannery J, Goff B, Telzer EH, Shapiro M, Tottenham N. A developmental shift from positive to negative connectivity in human amygdala-prefrontal circuitry. The Journal of Neuroscience. 2013;33(10):4584–93. doi: 10.1523/JNEUROSCI.3446-12.2013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldin PR, McRae K, Ramel W, Gross JJ. The neural bases of emotion regulation: Reappraisal and suppression of negative emotion. Biological Psychiatry. 2008;63(6):577–586. doi: 10.1016/j.biopsych.2007.05.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gullone E. The development of normal fear: a century of research. Clinical Psychology Review. 2000;20:429–451. doi: 10.1016/S0272-7358(99)00034-3. [DOI] [PubMed] [Google Scholar]
- Guo G, North KE, Gorden-Larsen P, Bulik CM, Choi S. Body mass, DRD4, physical activity, sedentary behavior, and family socioeconomic status: the add health study. Obesity. 2007;15(5):1199–1206. doi: 10.1038/oby.2007.640. [DOI] [PubMed] [Google Scholar]
- Hayes AF. PROCESS: A versatile computational tool for observed variable moderation, mediation, and conditional process modeling. White paper. 2012 Retrieved from http://www.afhayes.com/public/process2012.pdf.
- Hayes AF, Gentry WA, Gilmore DC, Shuffler ML, Leslie JB, Gandz J, Liverpool PR. Beyond Baron and Kenny: Statistical mediation analysis in the new millennium. Communication Monographs. 2009;76:408–420. doi: 10.1080/03637750903310360. [DOI] [Google Scholar]
- Herbert JS, Eckerman CO, Stanton ME. The ontogeny of human learning in delay, long-delay, and trace eyeblink conditioning. Behavioral Neuroscience. 2003;117:1196–1210. doi: 10.1037/0735-7044.117.6.1196. [DOI] [PubMed] [Google Scholar]
- Huizenga HM, Crone EA, Jansen BJ. Decision-making in healthy children, adolescents and adults explained by the use of increasingly complex proportional reasoning rules. Developmental Science. 2007;10:814–825. doi: 10.1111/j.1467-7687.2007.00621.x. [DOI] [PubMed] [Google Scholar]
- Humphreys KL, Lee SS. Risk taking and sensitivity to punishment in children with ADHD, ODD, ADHD+ODD, and Controls. Journal of Psychopathology and Behavioral Assessment. 2011;33(3):299–307. doi: 10.1007/s10862-011-9237-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Humphreys KL, Lee SS, Telzer EH, Gabard-Durnam LJ, Goff B, Flannery J, Tottenham N. Exploration—exploitation strategy is dependent on early experience. Developmental Psychobiology. 2015 doi: 10.1002/dev.21293. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Humphreys KL, Lee SS, Tottenham N. Not all risk taking behavior is bad: Associative sensitivity predicts learning during risk taking among high sensation seekers. Personality and Individual Differences. 2013;54:709–715. doi: 10.1016/j.paid.2012.11.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kahneman D, Tversky A. Prospect Theory: An analysis of decision under risk. Econometrica. 1979;47(2):263–292. doi: 10.1111/j.1536-7150.2011.00774.x. [DOI] [Google Scholar]
- Lejuez CW, Aklin WM, Jones HA, Richards JB, Strong DR, Kahler CW, Read JP. The Balloon Analogue Risk Task (BART) differentiates smokers and nonsmokers. Experimental and Clinical Psychopharmacology. 2003;11:26–33. doi: 10.1037/1064-1297.11.1.26. [DOI] [PubMed] [Google Scholar]
- Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, Stuart GL, Brown RA. Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART) Journal of Experimental Psychology: Applied. 2002;8:75–84. doi: 10.1037/1076-898X.8.2.75. [DOI] [PubMed] [Google Scholar]
- Levin IP, Hart SS, Weller JA, Harshman LA. Stability of choices in a risky decision-making task: A 3-year longitudinal study with children and adults. Journal of Behavioral Decision Making. 2007;20:241–252. doi: 10.1002/bdm. [DOI] [Google Scholar]
- MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annual Review of Psychology. 2007;58:593–614. doi: 10.1146/annurev.psych.58.110405.085542. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maddox WT, Baldwin GC, Markman AB. A test of the regulatory fit hypothesis in perceptual classification learning. Memory & Cognition. 2006;34:1377–1397. doi: 10.3758/BF03195904. [DOI] [PubMed] [Google Scholar]
- Marks I. The development of normal fear: A review. Journal of Child Psychology and Psychiatry, and Allied Disciplines. 1987;28:667–697. doi: 10.1111/j.1469-7610.1987.tb01552.x. [DOI] [PubMed] [Google Scholar]
- Peper JS, Koolschijn PCMP, Crone EA. Development of risk taking: Contributions from adolescent testosterone and the orbito-frontal cortex. Journal of Cognitive Neuroscience. 2013;25(12):1–10. doi: 10.1162/jocn_a_00445. [DOI] [PubMed] [Google Scholar]
- Perlman SB, Pelphrey KA. Developing connections for affective regulation: Age-related changes in emotional brain connectivity. Journal of Experimental Child Psychology. 2011;108(3):607–620. doi: 10.1016/j.jecp.2010.08.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rangel A, Camerer C, Montague PR. A framework for studying the neurobiology of value-based decision making. Nature Reviews Neuroscience. 2008;9:545–556. doi: 10.1038/nrn2357. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schonberg T, Fox CR, Poldrack RA. Mind the gap: bridging economic and naturalistic risk-taking with cognitive neuroscience. Trends in Cognitive Sciences. 2011;15:11–19. doi: 10.1016/j.tics.2010.10.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Slovic P. Risk-taking in children: Age and sex differences. Child Development. 1966;37:169–176. [Google Scholar]
- Steinberg L. Risk taking in adolescence: New perspectives from brain and behavioral science. Current Directions in Psychological Science. 2007;16(2):55–59. doi: 10.1111/j.1467-8721.2007.00475.x. [DOI] [Google Scholar]
- Swartz JR, Carrasco M, Wiggins JL, Thomason ME, Monk CS. Age-related changes in the structure and function of prefrontal cortex–amygdala circuitry in children and adolescents: A multi-modal imaging approach. Neuro Image. 2014;86:2120229. doi: 10.1016/j.neuroimage.2013.08.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Tottenham N, Phuong J, Flannery J, Gabard-Durnam L, Goff B. A negativity bias for ambiguous facial-expression valence during childhood: Converging evidence from behavior and facial corrugator muscle responses. Emotion. 2013;13(1):92–103. doi: 10.1037/a0029431. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Den Bos W, Cohen MX, Kahnt T, Crone EA. Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. Cerebral Cortex. 2012;22(6):1247–55. doi: 10.1093/cercor/bhr198. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van den Bos W, Guroglu B, van den Bulk BG, Rombouts SARB, Crone EA. Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing. Frontiers in Human Neuroscience. 2009;3:1–11. doi: 10.3389/neuro.09.052.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Der Schaaf ME, Warmerdam E, Crone EA, Cools R. Distinct linear and non-linear trajectories of reward and punishment reversal learning during development: Relevance for dopamine’s role in adolescent decision making. Developmental Cognitive Neuroscience. 2011;1:578–590. doi: 10.1016/j.dcn.2011.06.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Duijvenvoorde ACK, Crone EA. The teenage brain: A neuroeconomic approach to adolescent decision making. Current Directions in Psychological Science. 2013;22(2):108–113. doi: 10.1177/0963721413475446. [DOI] [Google Scholar]
- van Leijenhorst L, Crone EA, Bunge SA. Neural correlates of developmental differences in risk estimation and feedback processing. Neuropsychologia. 2006;44:2158–2170. doi: 10.1016/j.neuropsychologia.2006.02.002. [DOI] [PubMed] [Google Scholar]
- Van Leijenhorst L, Westenberg PM, Crone EA. A developmental study of risky decisions on the cake gambling task: Age and gender analyses of probability estimation and reward evaluation. Developmental Neuropsychology. 2008;33:179–196. doi: 10.1080/87565640701884287. [DOI] [PubMed] [Google Scholar]
- Vink M, Derks JM, Hoohendam JM, Hillegers M, Kahn RS. Functional differences in emotion processing during adolescence and early adulthood. Neuro Image. 2014;91:70–76. doi: 10.1016/j.neuroimage.2014.01.035. [DOI] [PubMed] [Google Scholar]