Abstract
Childhood obesity is associated with medical and psychological comorbidities, and interventions targeting overeating could be pragmatic and have a significant impact on weight. Calorically dense foods are easily available, variable, and tasty which allows for effective opportunities to learn to associate behaviors and cues in the environment with food through fundamental conditioning processes, resulting in measurable psychological and physiological food cue reactivity in vulnerable children. Basic research suggests that initial learning is difficult to erase, and that it is vulnerable to a number of phenomena that will allow the original learning to re-emerge after it is suppressed or replaced. These processes may help explain why it may be difficult to change food cue reactivity and overeating over the long term. Extinction theory may be used to develop effective cue-exposure treatments to decrease food cue reactivity through inhibitory learning, although these processes are complex and require an integral understanding of the theory and individual differences. Additionally, learning theory can be used to develop other interventions that may prove to be useful. Through an integration of learning theory, basic and translational research, it may be possible to develop interventions that can decrease the urges to overeat, and improve the weight status of children.
Keywords: child, obesity, learning, food cue, extinction
Obesity is a serious and refractory problem that is associated with multiple medical and psychological comorbities and risks. Recent data suggest that 4–5 million children are overweight or obese, representing 33% of children ages 6–19 years in the United States (Ogden, Carroll, Kit, & Flegal, 2014). Overweight and obese children are at an increased risk for many negative health complications in childhood and adulthood, including orthopedic and endocrine conditions, cardiovascular disease, cancer and all-cause mortality (Dietz, 1998; Dixon, 2010; Flegal & Kalantar-Zadeh, 2013; Key et al., 2004; Micic, 2001; Must et al., 1999). Obesity tracks well from childhood to adulthood, as 80% of overweight youth will be overweight as adults (Guo, Roche, Chumlea, Gardner, & Siervogel, 1994; Guo, Wu, Chumlea, & Roche, 2002). As a consequence of rising obesity rates, obesity-related medical costs in the United States are expected to increase by $48–66 billion per year by the year 2030 (Wang, McPherson, Marsh, Gortmaker, & Brown, 2011). Considering the high prevalence rates, escalating medical costs, and significant health consequences, it is of utmost importance that more potent models are developed to intervene on behaviors that contribute to obesity.
Family-based behavioral treatment (FBT) is considered the standard weight loss treatment program for overweight and obese children. FBT for childhood obesity is provided to parents and the target child, and includes nutrition and physical activity education, in addition to behavior therapy strategies and parent management skills (Epstein, 1996). The behavior therapy component incorporates techniques to assist the children and their parents in changing the energy balance equation, including goal-setting, self-monitoring food intake and activity, stimulus control, problem solving, cognitive restructuring and relapse prevention. Reviews suggest that interventions such as FBT can result in weight reduction for overweight and obese children (Altman & Wilfley, 2014; Ho et al., 2012; Whitlock, O’Connor, Williams, Beil, & Lutz, 2010). Additionally, sustained weight loss is observed in a proportion of children completing FBT, with 1/3 of children no longer being overweight in adulthood (Epstein, Valoski, Wing, & McCurley, 1994). However two thirds of children do not respond over the long-term. This lack of response could be due to underlying mechanisms that remain unaddressed by FBT, such as the retention of previously-learned behavior patterns. We believe that a more integrated understanding of learning theory and how it relates to appetite and overeating could allow for the development of effective interventions that target the etiological and maintenance mechanisms that drive overeating.
Societal advances have created the “obesogenic” environment (Brownell, 2004; Kessler, 2009; Lowe, 2003) that encourages excess energy intake (Berthoud, 2004). Calorically dense foods are easily available, highly variable, tasty, relatively inexpensive and portable (Drewnowski, 2004, 2010; Duffey & Popkin, 2013; Nielsen & Popkin, 2003; Popkin, Duffey, & Gordon-Larsen, 2005). Excessive caloric intake is one of the most proximal causes of rising obesity rates during the past three decades (Jeffery & Harnack, 2007; Swinburn et al., 2009). Overweight and obese children, compared to healthy weight children, have higher levels of eating in the absence of hunger in the laboratory (Fisher & Birch, 2002) and at home (Hill et al., 2008; Moens & Braet, 2007). Thus, from a pragmatic intervention perspective, in terms of weight loss, it could be easier to focus on reduction of caloric intake, especially when sated, than it is to exercise enough to burn off the extra calories.
Unfortunately, neurophysiological and higher order cognitive systems do not effectively decrease food intake under conditions of food abundance (Ahima et al., 1996). The motivation to eat is not only influenced by the basic internal, physiological signals from the body, such as perceptions of hunger or hormone systems, but also by other factors that are not directly related to nutrient homeostasis, including sensory experiences, cravings, reward expectations, emotional and social factors (Berthoud, 2004, 2007; Grill & Kaplan, 2002; Lutter & Nestler, 2009; Nogueiras et al., 2012; Saper, Chou, & Elmquist, 2002; Schachter, 1968; Schwartz, Woods, Porte, Seeley, & Baskin, 2000; Small, 2009). The stronger the non-homeostatic influences, the harder it is to maintain body weight. Eating beyond energy requirements, i.e. overeating, is believed to drive the obesity epidemic to a much greater extent than metabolic changes (Berthoud, 2011; Small, 2009; Volkow & Wise, 2005). Recent estimates suggest that a moderate reduction of only 220 calories per day could sufficiently result in successful weight loss over time (Hall et al., 2011).
Learning opportunities in the obesogenic environment
Energy intake in humans is a reflection of homeostatic, hedonic and cognitive mechanisms (Hall, Hammond, Rahmandad, 2014). Hedonic eating, which depends on basic learning processes, is a significant contributor to eating past physiological needs (Petrovich & Gallaher, 2007; Berridge, Ho, Richard, DiFeliceantonio. 2010). Today’s food environment is full of effective opportunities to overeat through associations of cues in the environment with food. Pavlovian conditioning occurs when a neutral stimulus (e.g., a couch) is paired with a biologically significant stimulus (i.e. food), causing the neutral stimulus to acquire eliciting functions (e.g. salivation and/or cravings when sitting on the couch). Such “food cues” are thought to become directly associated with the food outcome (a cue-food association) and elicit the kinds of responses discussed above. However, today’s food environment is also full of opportunities to learn to associate eating or food-seeking actions with the reinforcing effects of eating (operant action-outcome learning). Such operant learning can also play a role in increasing consumption in an obesogenic environment (e.g., Bouton, 2011). It is important to recognize that these two learning processes act in concert: Pavlovian and operant conditioning are constantly occurring at the same time (e.g., see Bouton, 2009 for one overview). In addition to eliciting the many kinds of responses described above, the presentation of Pavlovian food cues can increase the rate or vigor of operant eating or food-seeking through a process known as “Pavlovian-Instrumental Transfer” (Holmes, Marchand, & Coutureau, 2010; Rescorla & Solomon, 1967). Presentation of food cues can make humans work faster and harder for food (e.g. Lovibond & Colagiuri, 2013) by either increasing general arousal or by creating the expectancy of a specific food and consequently biasing choice toward actions that earn the same food (e.g., Watson, Wiers, Hommel, & de Wit, 2014).
Food cues can also acquire secondary reinforcing properties through their direct association with food (e.g., Williams, 1994). According to basic behavior principles, individuals may therefore be motivated to work in order to earn them. Stimuli that are present when operant actions are reinforced can further function as so-called “discriminative stimuli”; in this case, they increase operant responding by “setting the occasion” for the action-outcome relation (cue: action-outcome) rather than eliciting or motivating behavior through their simple direct association with food (see Hogarth et al., 2014 for a recent demonstration). Finally, with extended and repetitive practice, stimuli associated with operant responding can eventually elicit the operant behavior directly—as they do when they control mindless stimulus-response habits that can develop with extensive repetition and practice (Balleine & O’Doherty, 2010; Thrailkill & Bouton, 2015a; Dickinson, 1985; Tricomi, Balleine, & O’Doherty, 2009). Thus, there are many ways in which stimuli associated with snacks and meals can augment future eating: They can elicit approach behaviors, increase motivation to eat, guide choice, provide conditioned reinforcement, set the occasion for eating, and elicit mindless eating out of habit.
Food cues can stimulate feeding in animals and humans in a manner that is independent of physiological hunger. In animals, specific cues, such as a sound or light paired with food, and contextual cues, such as a feeding environment, have been shown to potentiate feeding in sated states (Holland, Petrovich, & Gallagher, 2002; Petrovich, Ross, Holland, & Gallagher, 2007; Petrovich, Setlow, Holland, & Gallagher, 2002; Weingarten, 1983). In these settings food cues drive consumption of the signaled food (Delamater & Holland, 2008; Galarce, Crombag, & Holland, 2007; Petrovich, Ross, Gallagher, & Holland, 2007; Petrovich, Ross, Holland, et al., 2007). In humans exposure to food cues can prime an individual to engage in eating behavior and it can increase the amount of food that is selected and subsequently consumed (Ferriday & Brunstrom, 2008). Research shows that exposure to the sight and smell of food increases reported cravings (Ferriday & Brunstrom, 2008; Nederkoorn, Smulders, & Jansen, 2000; Oakes & Slotterback, 2000) and initiates cephalic phase responses, including release of insulin and changes in salivation, heart rate, gastric activity and blood pressure (Nederkoorn, Smulders, Havermans, & Jansen, 2004; Nederkoorn et al., 2000; Nirenberg & Miller, 1982; Overduin, Jansen, & Eilkes, 1997). Enhanced cephalic phase responses are associated with perceived food cravings and eating in adults (Nederkoorn et al., 2000) and with overeating in 8–12 year old obese children (Jansen et al., 2003). Reactivity to food cues has been shown to be heightened in obese subjects compared to lean subjects (Ferriday & Brunstrom, 2010). Food responsiveness, along with satiety responsiveness, differentiated three latent profiles of overweight and obese children, and those with the highest levels of food responsiveness had a higher BMI (Boutelle, Peterson, et al., 2014).
Food cue reactivity can be evaluated by assessing attentional bias and neural changes to food cues, in addition to self-report measures. Attentional bias is a measurement of how quickly and how much attentional resources are devoted to a cue. In general, these studies suggest that overweight and obese people have differential processing of food cues compared to healthy weight people; they initially orient to food cues more and then sustain their attention to them longer (Castellanos et al., 2009; Graham, Hoover, Ceballos, & Komogortsev, 2011; Loeber et al., 2012; Nijs, Muris, Euser, & Franken, 2010; Werthmann et al., 2011). Attention bias is correlated with increased craving and food consumption (Werthmann et al., 2011) and predicts increases in BMI in college students over one year (Calitri, Pothos, Tapper, Brunstrom, & Rogers, 2010). Attention bias to food pictures is associated with activation in brain regions related to attention and food reward and changes in BMI in adolescent girls (Yokum, Ng, & Stice, 2011). A one-session attention bias training program, compared to a control training program, differentially decreased how much overweight and obese children ate in the laboratory (Boutelle, Kuckertz, Carlson, & Amir, 2014). Additionally, a recent case series with 9 overweight and obese adults who endorsed binge eating showed that a 12-week attention bias training program resulted in weight loss (Boutelle, Monreal, Strong, & Amir, under review). However, the previous study needs to be replicated with a control group before conclusions can be drawn.
Neural food cue reactivity, as measured by electroencephalography (EEG) and functional MRI (fMRI), has also been shown to differentiate overweight and obese individuals from lean individuals. A recent study using EEG showed that overweight and obese women, compared to healthy weight women, showed greater right parietal ERP P200 amplitude (early attentional processes) and shorter right parietal ERP P300 (enhanced maintenance of attentional processes; Hume, Howells, Rauch, Kroff, & Lambert, 2015). Imaging research, using fMRI, suggests that obese individuals, compared to lean individuals, show increased responsiveness in the gustatory (insula, frontal operculum), reward valuation regions (amgydala, ventralmedial prefrontal cortex, striatum) and cognitive control regions (orbitofrontal cortex) in response to images of palatable food (Bruce et al., 2010; Martin et al., 2010; Nummenmaa et al., 2012; Rothemund et al., 2007; Stice, Yokum, Blum, & Bohon, 2010; Stoeckel et al., 2009), cues that predict delivery of food (Stice, Spoor, Bohon, Veldhuizen, & Small, 2008), and to palatable food receipt (Boutelle et al., 2014; Ng, Stice, Yokum, & Bohon, 2011; Stice, Spoor, Bohon, Veldhuizen, et al., 2008). Neural activation to food cues has been associated with BMI in several studies (Rothemund et al., 2007; Stice, Spoor, Bohon, & Small, 2008) and with food intake (Burger & Stice, 2013).
As can be imagined, psychological and physiological food cue reactivity can be challenging for adults to manage, let alone children, and can stimulate overeating even in the sated state. Successful dieting is characterized by resisting tempting foods and food cues over and over again throughout the day. This resistance requires either the reduction of food cue reactivity (possibly through Pavlovian extinction) or inhibition of operant behaviors that typically occur when exposed to these foods (resisting the urge to eat, even in the presence of continued urges). In general, FBT recommends supporting overweight and obese children in losing weight by having healthy foods at home and reducing exposure to highly palatable, calorically dense foods. However, this is close to impossible in obesogenic environments. Children are exposed to highly palatable foods or food cues at school, at events, at birthday parties and holidays, at friend’s houses, etc. Considering that self-control and executive functioning are developing throughout childhood (see for review Best & Miller, 2010), and that parents can not always supervise their child in every situation, it is important to develop interventions to reduce food cue reactivity, to give children tools for managing their cravings and motivation to eat.
One question that is pertinent to this discussion is can neural food cue reactivity be changed, or is it fixed? Cross-sectional neuroimaging studies of successful dieters, compared to healthy weight individuals, have shown mixed results to date regarding responses of the reward system to food cues (Cornier et al., 2009; DelParigi et al., 2007). However, one study showed that successful dieters, compared to currently obese and healthy weight controls, had greater activation to high-calorie food pictures in prefrontal regions implicated in inhibitory control (McCaffery et al., 2009). Studies that evaluated weight loss programs in overweight and obese adults have shown changes in neural responsivity for high-calorie vs. non-food pictures in regions involved in food reward and motivation, including the insula, thalamus, putamen, interior frontal gyrus, posterior cingulate, and cingulate gyrus (Murdaugh, Cox, Cook, & Weller, 2012; Nock, Dimitropolous, Tkach, Frasure, & von Gruenigen, 2012). In a small randomized controlled trial comparing participants in a 6-month weight loss intervention to a waitlist control, results showed changes in reward system activity (right ventral putamen and left dorsal putamen) in participants in the behavioral weight-loss program compared to the wait-listed control. Thus, food cue reactivity may change with weight loss, but further information is necessary. Additionally, it seems that inhibition may play a central role. Thus, interventions targeting a reduction in food cue reactivity have the opportunity to improve a child’s ability to manage their cravings for palatable food.
Using learning theory to reduce food cue reactivity
Given that weight gain and obesity are associated with differential food cue reactivity, and that food cue reactivity is developed through learning and conditioning processes, it seems natural to turn to learning phenomena to evaluate intervention options which can be used to reduce food cue reactivity. In Pavlovian learning, extinction occurs when the conditioned stimulus, which was previously associated with a biologically significant stimulus, is presented repeatedly without the significant stimulus. In operant learning, extinction similarly occurs when the action is allowed to occur without producing the rewarding significant stimulus. For example, after eating chips in front of the TV every night, the TV becomes a conditioned stimulus and elicits cravings or feelings of wanting to eat chips; it might also set the occasion for eating as an operant response. In extinction, one might repeatedly sit in front of the TV without eating chips. Although the TV will elicit cravings and an urge to eat at first, over trials these responses will decrease, potentially reaching zero. It is possible that directly altering food cue responsivity this way may have important implications for managing the omnipresent food cues for children who are trying to manage their weight.
Extinction theory can be applied in interventions to decrease food cue reactivity, to ultimately decrease overeating and weight. These interventions are typically referred to as Exposure and Response Prevention or Cue-Exposure Treatment (CET). Laboratory explorations showed that repeated cue exposure successfully reduced chocolate self-reported cravings and salivation in female chocolate cravers (Van Gucht, Vansteenwegen, Beckers, Hermans, et al., 2008). In another study with healthy weight college students, cravings for chocolate were acquired through cue-chocolate pairings, but these cravings did not extinguish over the duration of the study. However, expectations for chocolate were also acquired, and did in fact extinguish, suggesting potential differential effects of cue-exposure treatment on cravings and expectations (Van Gucht, Vansteenwegen, Beckers, & Van den Bergh, 2008).
We are in the process of developing a “cue-exposure treatment” for food (CET-Food) for overweight and obese children (Boutelle et al., 2011; Boutelle, N. Zucker, et al., 2014; Boutelle, Liang, et al., 2014). These methods were initially described decades ago in a pilot trial which showed that cue-exposure treatment led to abstinence as compared to self-control training with adults who binge eat and/or have bulimia nervosa (Jansen, Broekmate, & Heymans, 1992). CET-Food considers cravings for food a conditioned state or response that is amenable to extinction. The goal of CET-Food is to extinguish or decrease the strength of the relationship between the food cues and cravings, expectations and physiological urges to eat when sated. It is important to note that we focus on extinguishing these urges when the child is full, as it is important to teach growing children to eat when they are physically hungry. The goal of CET-Food is to extinguish the relationship between having an accessible highly craved food and consumption. In brief, CET-Food is based on experiential “exposure” exercises, during which children (and their parents) are exposed to their highly craved foods, while increasing both psychological and physiological cue reactivity by holding, smelling and taking a small taste of the food during the exposure session, but not consuming the food. Following the exposure session, the food is thrown away in a trashcan. Initial pilot studies suggest that CET-Food shows some efficacy in decreasing overeating in overweight and obese children (Boutelle et al., 2011) and we are currently in the process of conducting a series of studies based on extinction theory to enhance CET-Food with children (Boutelle, Liang, et al., 2014). Additionally, recent data suggest that this method may also have promise with adults. Results from a pilot study with 28 overweight and obese binge eaters who participated in a 4-month program that included CET-Food showed significant weight change from baseline to post-treatment and continued weight loss 3 months post-treatment, which is remarkable considering the lack of diet or physical activity involved in the program (Boutelle, Peterson, Carlson, Bergmann, Knatz, under review). Although we believe that this treatment program has promise, either as a stand-alone treatment or in conjunction with behavioral weight loss, we recognize that more work grounded in the founding mechanisms is needed to make CET-Food more effective.
Extinction is a well-known phenomenon, and its use in cognitive-behavior therapies has a history. However, to further improve extinction-based treatments, it will be important to drill deeper into the implications of what is known about extinction based on contemporary basic laboratory research. One of the most critical themes of modern research on extinction is that extinction does not erase the original learning (Bouton, 2004, 2011, 2014; Laborda, McConnell, & Miller, 2011; Quirk & Mueller, 2008; Todd, Vurbic, & Bouton, 2014a; Vurbic & Bouton, 2014), which will present inherent challenges in managing food cue reactivity. That is, even after the successful elimination of a craving or behavior in extinction, the original learning continues to exist, and the response can reappear under many circumstances (see below). In either Pavlovian or operant learning, the reduction in behavior that occurs during extinction is the result of a form of context-specific retroactive inhibition process rather than unlearning. To extend our previous illustration, when seeing the TV, the child may indeed feel cravings and an urge to eat potato chips. However, after extinction/inhibition learning, cravings and urges would be reduced, but not erased; something akin to resisting eating has been learned in the presence of the TV.
The modern view that extinction depends specifically on a context-specific form of inhibition stems from several important response-recovery or “relapse” phenomena that are now considered central to the understanding of extinction (see (Bouton, 2004, 2014; Vurbic & Bouton, 2014) for reviews). In renewal, extinguished responding returns when the CS or the response is tested in a different context. Several forms of renewal have been demonstrated (ABA, ABC, and AAB, where the three letters refer to the contexts of original learning, extinction, and testing, respectively; e.g. Bouton, Todd, Vurbic, & Winterbauer, 2011). This means that even though a child has learned to resist eating in front of the TV, when she sees one in someone else’s home, craving and urges to eat in front of the TV might return. In spontaneous recovery, extinguished responding returns after a period of time has elapsed after extinction (e.g., Brooks & Bouton, 1993; Rescorla, 2004). Thus, extinguished cravings and urges to eat can return if the TV is visited sometime later; the passage of time is considered a change in temporal context. In resurgence, an extinguished behavior that has been replaced by a new behavior returns when the new behavior is itself extinguished (e.g., Bouton & Schepers, 2014; (Shahan & Sweeney, 2011; Winterbauer & Bouton, 2010). Thus, when eating is extinguished and replaced with a new activity such as exercise, not exercising one day can cause cravings and urges to eat to return. In reinstatement, simple exposure to the biologically-significant stimulus after extinction can cause responding to a food cue to recover. This effect depends at least in part on receiving the significant stimulus in the context where testing then occurs; one way to think of it is that when the context (e.g., the family room) has been recently associated with food again, it arouses an expectancy of food that allows the food cue to trigger eating again. Finally, in rapid reacquisition, extinguished responding can quickly return when the food cue or action is paired with the reinforcer again. Thus, extinguished cravings and urges can quickly return with full force if one eats in front of the TV again after extinction. Rapid reacquisition may be especially important in understanding the persistence of overeating, because although phenomena like renewal and spontaneous recovery can cause an initial lapse in behavior, individuals who lapse necessarily expose themselves to new cue-food and action-food pairings, and begin the “spiral” into true relapse. Rapid reacquisition can also be considered a context effect because recent cue-food (or action-food) pairings were part of the background “context” during the original learning. Thus, resuming cue-food and/or action-food pairings will return the individual to the original context of eating (Bouton, 2011). Context can thus be conceptualized as the immediate environment, or any “background stimuli”, including other behaviors, emotions, time, physiological states, and recent events (Bouton, 2011; Vurbic & Bouton, 2014).
Because behavior is suppressed in extinction in a context-specific way, rather than being unlearned, there is an inherent bias or asymmetry in how strongly craving and the urge to eat will be evoked across contexts. Conditioned responding (especially operant responding) may itself be context-specific to a degree (see Bouton, Todd, & Leon, 2014; Bouton et al., 2011; Thrailkill & Bouton, 2015a), but extinction learning is demonstrably even more so (Bouton & Todd, 2014). The same asymmetry seems to be true of many learning paradigms in which new learning is used to replace old. For example, in counterconditioning, responding based on cue-food learning can be suppressed by pairing the cue with a different significant stimulus instead of a lack of reinforcement. Animal experiments suggest that renewal, spontaneous recovery, and reinstatement can occur after counterconditioning, in which a tone was first paired with food and then with shock or vice versa (Bouton & Peck, 1992; Brooks, Hale, Nelson, & Bouton, 1995; Peck & Bouton, 1990). Thus, like simple extinction, counterconditioning can leave the individual vulnerable to lapse and relapse. However, it is worth noting that in some human studies, counterconditioning has shown some preliminary promise in impacting cue-induced cravings (Van Gucht, Baeyens, Vansteenwegen, Hermans, & Beckers, 2010). In the Van Gucht study, extinction of the relationship between a cue and chocolate consumption did not impact cravings for chocolate, however, cravings were reduced after counterconditioning (pairing the cue that was previously paired with chocolate with an aversive liquid instead). Notably, this effect persisted (and did not spontaneously recover) after one week. However, counterconditioning with children is an ethical dilemma, and more research is needed before studies using counterconditioning will be conducted with children. And as just noted, the basic animal research suggests that counterconditioning can be context-specific and prone to relapse over sufficient time, like extinction.
In operant conditioning, recent experiments have similarly shown that responding reinforced by food can be renewed after it has been suppressed by response-contingent punishment (Bouton & Schepers, 2015). Punished responding recovered when the context was changed (both ABA and ABC renewal were demonstrated), and the results suggested that, as in operant extinction, the organism learns to inhibit a specific response in a specific context. Thus, suppression of behavior by punishment, like by extinction, is specific to its context. Finding renewal after punishment (see also Marchant, Khuc, Pickens, Bonci, & Shaham, 2013) is important as it relates to eating behavior, because people may often stop overeating because they begin to appreciate its aversive consequences rather than extinction. The phenomenon also suggests that nagging a child about overeating (a form of punishment that is used by many parents) might not be effective at suppressing the child’s overeating in other contexts.
Overall, the results of basic research thus suggest that several strategies that can be used to suppress or inhibit learned performance (extinction, counterconditioning, punishment) do not produce unlearning, but instead cause a context-specific suppression of behavior. We suggest that this might be one important but overlooked reason why assisting children in losing weight and maintaining healthy eating is so challenging. The behavioral power of a food cue (as a stimulus controlling physiological arousal, craving and approach, motivation, conditioned reinforcement, or setting the occasion for an operant) is always ready to return.
Although research suggests that behavior change can be impermanent and context-dependent, recent research suggests a little good news. One finding is that extinction (inhibition of responding) in the presence of one cue can sometimes inhibit responding in the presence of other very different cues (Vurbic & Bouton, 2011). The case in operant conditioning seems especially instructive. First, in laboratory experiments, when an operant behavior is occasioned by two separate and distinct stimuli (e.g., a tone and a light), extinction of the behavior in the presence of one of the stimuli transfers and suppresses behavior in the presence of the other stimulus, too (Bouton, Carranza-Jasso, & Trask, in preparation). Although this transfer is not necessarily complete (there is still a little responding to the alternate stimulus), far less transfer of inhibition occurs when the alternate stimulus occasions a different operant behavior. Thus, operant extinction learning involves the suppression of the specific response. Translated to the overeating child, a boy who learns to resist eating in the presence of a bag of chips might also inhibit responding when given the opportunity to eat them out of a bowl. Thus, it might not be necessary to extinguish all stimulus-response combinations to suppress overeating somewhat generally. A second recent finding is that when different behaviors are linked together in a “behavior chain,” extinction of one response can also weaken the other. For example, a person may buy junk food at a convenience store (a procurement response) and then eat it later (a consumption response); the two behaviors are different but linked. Recent laboratory research suggests that extinction of procurement alone can weaken a linked consumption response, and that extinction of consumption alone can weaken a linked procurement response, when the consumption and procurement responses are tested in isolation (Olmstead, Lafond, Everitt, & Dickinson, 2001; Thrailkill & Bouton, 2015b). However, we should note that responses can still return (be renewed) if the corresponding cues are presented in a different context (Todd, Vurbic, & Bouton, 2014b).
How to improve extinction learning
These facts about extinction (and related behavior change paradigms) suggest that we need to be realistic about what extinction treatments can accomplish. However, there are ways to improve extinction learning that can be applied in behavioral weight loss treatments (Bouton, 2007). In general, in order to improve extinction outcomes, we can theoretically either (1.) strengthen inhibition learning that occurs in extinction, or (2.) try to increase the generalization of learning from the extinction context to other potential relapse (Bouton, Woods, Moody, Sunsay, & Garcia-Gutierrez, 2006). Each of these strategies is discussed below.
Strengthening inhibition learning
One way to optimize extinction learning is to strengthen the inhibition learning that is thought to occur in extinction. Extinction is now widely understood to result, at least in part, from the correction of prediction error. According to most models of conditioning (Pearce & Hall, 1980; Rescorla & Wagner, 1972; Wagner, 1981; 2003), learning occurs on a conditioning trial when there is a discrepancy between what is predicted to occur on that trial and what actually occurs; this discrepancy is often called a prediction error. Learning is viewed as a means of reducing such prediction error; on every trial, the associative strength of cues is adjusted to bring what is predicted and what actually occurs into alignment. In extinction, we learn inhibition because the cues present on a trial predict that a significant stimulus will occur, and yet one does not. Over trials, the prediction is gradually corrected until what is predicted (“nothing”) is aligned with what actually occurs. The importance of prediction error has been supported by a great deal of research on both acquisition and extinction. In a number of extinction experiments, cues that were separately conditioned have then been combined and presented together on extinction trials (Janak & Corbit, 2011; Kearns, Tunstall, & Weiss, 2012; Rescorla, 2006; Thomas & Ayres, 2004). Because the prediction made by separate cues are thought to summate, the compound created an even larger prediction and hence, a larger prediction error. For that reason, compounding separately-conditioned cues can increase the amount of inhibition that is learned to them in extinction. In the extinction of overeating, we might present separate food cues simultaneously while conducting extinction. It is worth mentioning that a role for prediction error has received especially strong support from experiments in which two cues have been separately conditioned and then combined and paired with the same significant stimulus on compound conditioning trials (Kremer, 1978; Lattal & Nakajima, 1998; Rescorla, 2007). During the latter compound trials, even though the stimuli are still paired with the significant stimulus, the compound predicts a larger event than actually occurs, and partial extinction therefore occurs. Such “overexpectation” has further implications for the extinction of overeating. Of note, anecdotally, adult participants in CET-Food remark how the food doesn’t taste as good as they thought it would. If the expectation of food created by cues is more positive than what is actually experienced when eating is slowed, prediction error and overexpectation lead us to hypothesize that focusing on taste or slowing eating may be another way to allow the development of inhibition.
Extinction learning might also be further optimized by manipulating the spacing of extinction trials. It is widely known that trials that are spaced over a period of time result in stronger learning than temporally massed trials; this is true for appetitive (food) conditioning (e.g., Sunsay & Bouton, 2008; Sunsay et al., 2004) as well as other kinds of conditioning (e.g., Barela, 1999; Domjan, 1980). At a theoretical level, spaced trials may enhance learning by increasing the novelty or surprisingness of the cue and the significant outcome (Sunsay & Bouton, 2008); they might also improve memory strength if it is partially forgotten between learning episodes (Bjork & Bjork, 1992) or the learning in extinction of inhibition if error correction (like responding itself) spontaneously recovers over time (e.g., Leung & Westbrook, 2008). Although there is ample theory to suggest that spaced extinction trials would improve extinction learning, trial spacing during extinction training has produced inconsistent results in animal experiments (e.g., compare results of Cain, Blouin, & Barad, 2003; Moody, Sunsay, & Bouton, 2006b; Urcelay, Wheeler, & Miller, 2009).
Variability during exposure could also potentially enhance inhibition of responding to food cues through enhanced generalization. Our understanding of the impact of variability on exposure are mainly drawn from anxiety disorders at this time, although the basic behavioral processes involved in fear and appetitive extinction do not appear to be different; for example, the basic extinction and recovery phenomena emphasized in this article have been repeatedly demonstrated in both (e.g., see Bouton, 2004; Vurbic & Bouton, 2014, for reviews). Variability may increase the strength of the inhibitory learning through several mechanisms (see for review Craske, 2008; Bjork, 1988). For example, it would increase the number of cues associated with the lack of eating, with more cues making the likelihood that these cues will be present (retrieval cues, see below) when this learning is needed. Variation might also promote the development and application of rules that capture the commonalities between tasks (Schmidt & Bjork, 1992). Studies in phobic samples have shown that exposure to varied phobic stimuli led to better maintenance of treatment gains (in terms of spontaneous recovery) at follow-up than did exposure to a constant stimulus (Lang & Craske, 2000; Rowe & Craske, 1998). Additionally, greater variability in fear levels throughout exposure enhanced outcomes in anxiety about contaminants and public speaking (Culver, Stoyanova, & Craske, 2012; Kircanski et al., 2012).
Extinction in multiple contexts may also improve the effectiveness of extinction learning (Bouton, Woods, Moody, Sunsay, & Garcia-Gutierrez, 2006). Since extinction learning is context-dependent, changing contexts repeatedly during extinction would repeatedly renew responding and hence prediction error, facilitating further inhibitory learning (Holmes & Westbrook, 2013; as we note below, extinction in multiple contexts might also increase the generalization to new contexts.). It is possible that exposure in multiple contexts can also be done by video or online (Vansteenwegen et al., 2007). Unfortunately, humans have numerous pairings between food cues and eating, which results in cravings in many different contexts, with many different cues in each context; original learning experiences in many contexts may enhance renewal effects when in new contexts (Gunther, Denniston, & Miller, 1998; Todd, Winterbauer, & Bouton, 2012b).
Another method that might enhance learning in an “extinction” phase might be to pair the food cue or operant behavior with an aversive stimulus (counterconditioning or punishment, respectively). Such treatments can be highly effective at suppressing performance in the short run. But as we noted earlier, administering aversive events raises certain ethical questions that might be difficult to justify in the sense that both counterconditioning and punishment, like simple extinction, can still be vulnerable to lapse and relapse after temporal and physical context change (e.g., Bouton & Peck, 1992; Bouton & Schepers, 2015; Peck & Bouton, 1990).
New technologies might also eventually provide new ways to enhance extinction and eliminate undesirable learned behavior. For example, drugs that are known to facilitate learning could plausibly enhance extinction learning. D-cycloserine (DCS), a partial agonist of the NMDA receptor that is involved in long-term potentiation, a cellular model of learning, has been shown to increase the rate at which Pavlovian fear extinction is learned (e.g., Walker, Ressler, Lu, & Davis, 2002), although it might not qualitatively change the nature of extinction learning or eliminate its inherent context-dependency (Bouton, Vurbic, & Woods, 2008; Woods & Bouton, 2006). Thus, relapse effects might still occur. DCS can also facilitate the extinction of operant food-seeking (e.g., Leslie, Norwood, Kennedy, Begley, & Shaw, 2012), although the evidence here to date may be less consistent (e.g., see Vurbic, Gold, & Bouton, 2011; Thanos et al., 2011). A second type of new technology is suggested by a phenomenon known as reconsolidation (e.g., Nader, Schafe, & LeDoux, 2000). Here, the claim is that when a memory is retrieved, it becomes temporarily vulnerable to disruption by certain drugs if they are administered before the memory returns to a stable state (e.g., Nader et al., 2000; Kindt, Soeter, & Vervliet, 2009). A review of the reconsolildation literature is beyond the scope of this article, but it is worth noting that in fear conditioning (cue-shock learning), where the phenomenon has been studied most extensively, drugs seem most effective at weakening memories that are old or have been conditioned with only a small number of cue-shock trials (e.g., Wang, de Oliveira Alvares, & Nader, 2009; in contrast, food-cue learning can presumably involve a very large number of repeated conditioning trials.) Conducting extinction soon after a memory is retrieved might also disrupt memory reconsolidation (Monfils, Cowansage, Klann, & LeDoux, 2009; Xue et al., 2012), but this effect is poorly understood, and there have been published failures to replicate it (e.g., see Chan, Leung, Westbrook, & McNally, 2010; Kindt & Soeter, 2013; Soeter & Kindt, 2011).
Bridges to other contexts
The second general way to optimize learning is to provide a bridge from the extinction context to other contexts. The simplest way to accomplish this is to conduct exposure treatments in the context(s) where overeating is most probable and therefore problematic. For example, extinction could focus on the major contexts in which food cues are most likely to be encountered-- the kitchen, dining room, favorite restaurant or time (evening), or mood (bored). But in addition to this, as noted above, another method to create bridging might be to conduct extinction in multiple contexts. Contexts are complex stimuli composed of many features; by conducting extinction in multiple contexts, one increases the range of features that are connected with extinction—and might be encountered again in a new context.
Still another way to bridge across contexts is by providing objects that serve as retrieval cues (Bouton et al., 2006). In animals, retrieval cues that were present during extinction trials attenuate context-based renewal effects if they are presented again at the time of testing (Brooks & Bouton, 1993, 1994), and they are more effective than relatively novel cues or cues that were present during conditioning rather than extinction. Collins and Brandon (2002) showed that the return of alcohol cue reactivity after extinction due to a context-change could be reduced by the use of retrieval cues that were present during extinction. A related possibility is to mentally reinstate the extinction context. Some research suggests that individuals can “mentally reinstate” extinction contexts (i.e. the physical surroundings where exposure took place, word that therapist said to them; Craske, 1999). One study suggested that remembering the environmental context in which the exposure treatment was conducted resulted in less renewal of spider fear in a different context (Mystkowski, Craske, Echiverri, & Labus, 2006).
A less intuitive, but interesting way to provide better bridging between extinction and possible relapse contexts is to occasionally reinforce the food cue or the operant response during extinction (Bouton, Woods, & Pineno, 2004; Woods & Bouton, 2007). This method might provide especially effective protection against relapse in the form of rapid reacquisition. As noted earlier, resuming cue-food or action-food pairings after extinction could cause behavior to return quite rapidly because recent cue-food or action-food pairings were part of the context of original conditioning (Ricker & Bouton, 1996). By including occasional cue-food or action-food pairings among a very large number of extinction trials, one can suppress behavior while at the same time associating these contextual cues with extinction or behavioral suppression rather than just conditioning. Consistent with this idea, occasional reinforced trials have slowed relapse in the form of rapid reacquisition in both Pavlovian cue-food (Bouton, 2004) and operant action-food (Woods & Bouton, 2007) learning in animals. In a perhaps related way, cigarette smoking in humans has been reduced by giving smokers the opportunity to smoke only occasionally at predetermined intervals (Cinciripini et al., 1994; Cinciripini et al., 1995). The idea is to associate a reinforced trial (a minor lapse) with further suppression or even abstinence from the behavior. In the long run, this may promote the persistence of extinction by (in the case of eating) protecting it against the pernicious effects of new cue-food or action-food pairings.
The possible clinical effectiveness of using partial reinforcement in extinction is not to be confused with another well-known phenomenon in learning theory, the so-called Partial Reinforcement Extinction Effect (PREE). In this phenomenon, subjects who are reinforced only occasionally (“partially”) during conditioning are slower to later extinguish their responding than subjects who are consistently reinforced (see van den Akker, Havermans, Bouton, & Jansen, 2014) for a recent demonstration in food conditioning with humans). The focus of the PREE is on the persistence of conditioned performance in extinction rather than the persistence of extinction performance in reacquisition, which we were discussing immediately above. But the PREE may have its own important implications for overeating. As recently noted by Van den Akker et al. (2014), when an individual (for example) goes on and off a diet repeatedly, he or she may be exposed to a partial reinforcement schedule in which repeated extinction trials (not eating in the presence of food cues while dieting) are intermixed with reinforced trials eating in the presence of food cues while not dieting. By creating a PREE, such a schedule would only make the suppression of eating more difficult during a longer run of extinction trials. Because people can never be fully “abstinent” from eating, eating can always occur in the presence of a given food cue at least some of the time. The PREE may thus be very difficult to avoid, which might be one of the reasons why inhibitory learning with food is so challenging.
Role of individual differences
Although this discussion describes opportunities to apply learning theory to interventions designed to reduce overeating in children, it would not be complete without the recognition that there may be individual differences that play a role in learning relationships with food cues. At this time, we are just beginning to understand the role of individual differences in food cue reactivity. For example, recent studies suggest that some animals have especially strong tendencies to approach and attribute “incentive salience” to cues that are associated with food (e.g., Flagel et al., 2010; Saunders & Robinson, 2013). The same animals appear to be prone to drug addiction-related processes in that they are also strongly affected by cues associated with cocaine (Saunders & Robinson, 2010, 2011; Yager & Robinson, 2013; see Saunders & Robinson, 2013 for review). Interestingly, preliminary results suggest that a similar “cue-reactive phenotype” might also exist in humans. For example, the extent to which human smokers report craving in the presence of smoking cues correlates with the extent to which they also report cravings in the presence of food cues (Mahler & de Wit, 2010; Styn, Bovbjerg, Lipsky, & Erblich, 2013). Human traits, such as those that are driven toward reward, have been shown to be associated with neural activation to food cues in a fronto–striatal–amygdala–midbrain network (Beaver et al., 2006). In another study examining a weight loss in a 12-week weight loss program, obese individuals who had higher levels of activation in brain regions implicated in reward, such as the nucleus accumbens, anterior cingulate, and insula, were less successful in losing weight (Murdaugh, Cox, Cook, & Weller, 2012). These brain responses seem to interact with genetics to predict overeating and weight gain (Stice, Spoor, Bohon, & Small, 2008). Furthermore, neural activity in response to food cues in the ventralmedial prefrontal cortex and the dorsolateral prefrontal cortex at baseline, and a stronger functional connectivity in these regions is associated with dietary success, impulse control and weight loss (Weygandt et al., 2013). Finally, other recent studies suggest that metabolic factors may mediate the relationship between ventral striatal activity in response to food cues and body weight (Malik, McGlone, Bedrossian, & Dagher, 2008; Simon et al., 2014).
Although there may be individual differences that could moderate or mediate learning and weight gain, there also could be individual differences in learning itself. A recent study showed that obese women, compared to healthy weight women, had difficulties learning to inhibit their responses to food cues, even in the presence of signals for nonreward (Zhang, Manson, Schiller, & Levy, 2014). Another study showed that overweight college students, compared to healthy-weight college students, swallowed more to an innocuous cue paired with chocolate milk, compared to cues paired with water or no liquid after only 9 pairings (Meyer, Risbrough, Liang, & Boutelle, 2014). Notably, the healthy weight students did not acquire a response to the innocuous cues paired with chocolate or water. Neuroimaging data also support the role of individual differences, as one study showed that adolescents who have the greatest escalation in the ventral pallidum to innocuous cues paired with a taste of food and the greatest decrease in the caudate to the taste of food had significantly larger increases in BMI over two years (Burger & Stice, 2014). From this small body of literature, it seems that individual traits, cognitive skills, differential learning rates or abilities, metabolic factors, genetics and neural responsivity may all impact food cue reactivity on an individual level. Understanding these individual differences, and the impact on food cue reactivity, will require further research, and will be key to developing interventions.
Other learning mechanisms relevant to overeating
We have emphasized extinction processes as one method from learning theory for addressing overeating. It is worth mentioning that a learning-theory perspective also recommends other kinds of treatments. The following review of other lines of research using learning theory may not be exhaustive, but will highlight some areas of research that could offer potential avenues for intervention development. As one example, Epstein and colleagues have emphasized the effects of habituation to foods in the control of eating (e.g., see Epstein, Temple, Roemmich, & Bouton, 2009 for a review). In habituation, repeated exposures to a stimulus (in this case, a food), decreases the amount of responding the stimulus elicits or controls. Thus, when given the opportunity to earn bites of food by playing a simple game on a computer, children’s rate of responding for the food decreases as more and more food is eaten. Habituation is a well-studied phenomenon, and it has many well-known characteristics (Epstein, Temple, Roemmich, & Bouton, 2009; Rankin et al., 2009). For example, the effect is stimulus-specific; responding recovers when the habituated stimulus is changed. Thus, children whose responding had habituated for bites of cheeseburger worked hard again when they were offered bites of apple pie (Epstein et al., 2003)—the familiar dessert effect. Another related phenomenon in the habituation literature is the variety effect. When a participant is exposed to stimuli that vary from trial to trial, habituation is slower than when he/she is exposed to the same stimulus repeatedly. Thus, responding for food in children given a mixture of foods is slower to decrease than that in children repeatedly given the same food (Temple, Giacomelli, Roemmich, & Epstein, 2008). Epstein et al. (2009) framed the findings within the terms of a comprehensive memory model of conditioning and habituation (Wagner & Brandon, 1989) which emphasizes that responsivity to food declines to the extent that the food is still remembered in short-term memory when it is presented again on the next trial.
The idea that eating is affected by habituation processes has led to a number of important insights about eating and overeating. As one example, in overweight children, eating in both the laboratory and in the home can be suppressed by repeated exposure to the same food instead of a variety of foods (Epstein et al., 2013). Other research suggests that children are slower to habituate to food (and consequently eat more of it) while watching TV or listening to audibooks (Epstein, Saad, Giacomelli, & Roemmich, 2005; Temple, Giacomelli, Kent, Roemmich, & Epstein, 2007). Theoretically, this effect occurs because watching or book listening takes up more space in short-term memory, which has a limited capacity, making it more difficult for the memory of food to persist from trial to trial and cause habituation. Research has shown that children who are slower to habituate to food in a laboratory task, compared to those who habituate faster, gain more weight over one year (Epstein, Robinson, Roemmich, & Marusewski, 2011). And recent evidence suggests that the rate of a child’s habituation to food is correlated with the child’s short-term memory capacity; children with better short-term memory habituate to food faster (Epstein, Carr, Scheid, Gebre, O’Brien, Temple, & Bouton, under review). One might imagine the engineering of a healthy diet in which consumption of unhealthy high-energy-dense foods is reduced by decreasing their variety and the consumption of healthier low-energy-dense foods is conversely enhanced by increasing their variety.
The role of memory in habituation fits nicely with other work focusing on the role of memory processes and encoding of food memories. Episodic memories of the ingestive consequences of eating (memory for earlier eating episodes) affect decisions regarding future food consumption (Higgs, 2005; Robinson, Aveyard, et al., 2013). A number of studies have provided evidence that the inhibition of food intake is influenced by the memory of a recent meal. In these studies, healthy weight participants are asked to recall what they had for lunch, and the impact on eating later in the day is measured. Those who recalled the lunch they ate decreased snack consumption a few hours later compared to subjects in the control condition (Higgs, 2002, 2008). Additionally, studies evaluating the impact of food memories have shown that those who are distracted during a lunch meal ate more at a later afternoon snack compared to those that were not distracted (Higgs & Woodward, 2009). In healthy weight college students, deliberately holding food items in working memory, as opposed to just attending to food items, showed facilitated detection of food items (Higgs, Rutters, Thomas, Naish, & Humphreys, 2012). Considering the importance of encoding food memories, college students who were instructed to focus on the sensory properties of the food they were eating after consuming a lunch showed greater suppression of intake when given a snack a few hours later compared to subjects that read an article about food or were not given any specific task after eating the same lunch (Higgs & Donohoe, 2011). Interestingly, memory of a recent lunch exerts a stronger influence on subsequent intake suppression than does the actual energetic content of the meal itself (Brunstrom et al., 2012). Additionally, a recent pilot study suggested that a smart-phone app that trains both eating attentively and reviewing previous eating events before meals reduced weight in the 12 overweight participants in the pilot study (Robinson, Higgs, et al., 2013).
Considering that memory of a recent meal has been shown to reduce subsequent intake, it is possible that memory problems might be linked to overeating. Recent findings suggest that hippocampal-dependent learning and memory mechanisms contribute to the control of food intake (Davidson, Kanoski, Schier, Clegg, & Benoit, 2007). The hippocampus is important in spatial memory, declarative memory (formation and recall of memories about events and facts) and to resolve predictable ambiguities that exist when a stimulus signals different outcomes dependent on the presence/absence of other cues (such as the relationships between food cues and satiety signals). For example, the hippocampus functions in learning that satiety signals predict when food cues will not be followed by an appetitive postingestive outcome (Davidson, Kanoski, Walls, & Jarrard, 2005).
Davidson and colleagues have demonstrated in animal experiments that eating a “Western diet”, specifically diets high in saturated fats and refined carbohydrates, interferes with hippocampal functioning. Thus, they have pointed to a “vicious cycle of obesity and cognitive decline” (Davidson et al., 2005; Kanoski & Davidson, 2011) in which eating a Western diet disrupts hippocampal functioning, and this disruption impairs the individual’s ability to inhibit memories of the relationships between postingestive consequences of energy intake and environmental food cues. This impairment would increase the likelihood that those cues would evoke additional cravings and overeating of the Western diet, which will further decrease functioning of the hippocampus. Studies also suggest that diet-induced hippocampal deficits precede weight gain (Davidson, Sample, Swithers, 2014). Additionallly, Kanoski and colleagues (Kanoski et al., 2011) showed that consumption of added sugars, particularly high fructose corn syrup, negatively impacted hippocampal functioning and metabolic outcomes in animals.
Other variations in what foods are consumed can lead to increased overeating through learning, including non-caloric sweeteners and non-caloric fat substitutes. In a normal environment, the perception of a sweet taste or fat taste on the tongue would be correlated with (and thus potentially predict) the intake of calories. But this natural connection between sweet tastes and calories has been weakened by the addition of noncaloric sweeteners in animals in the modern Western diet (e.g., Davidson, Tracy, Schier, & Swithers, 2014). That is, children who consume foods with noncaloric sweeteners could experience extinction or partial reinforcement trials in which sweet tastes are not associated with an increase in calories, which can create a number of negative consequences. Evidence suggests that animals given yogurt snacks flavored with saccharin (rather than glucose), so that the sweet taste had a weaker predictive relationship with the intake of calories, wind up eating more and gaining more weight over time (Swithers & Davidson, 2008). Their ability to suppress intake of their maintenance chow after they were given a different, but sweet, snack was also compromised. Similar results have been reported with animals exposed to non-caloric fat substitutes (Swithers, Doerflinger, & Davidson, 2006). Such results continue to reinforce the idea that fundamental learning processes can play a role in increasing food consumption in the contemporary food environment. However, to date, similar human studies have not been conducted.
Concluding comment
While addressing these problematic features of the Western diet and promoting primary prevention of obesity will require tremendous changes to today’s food and physical activity environment, it will be decades before such changes are realized. Thus, it is necessary to develop more potent intervention strategies to assist children in managing the current toxic food environment. In this article, we have attempted to document some of the many learning mechanisms and processes that can contribute to overeating—and perhaps its suppression and inhibition. We expect that extinction might be an especially useful therapeutic tool to help decrease the impact of food cue reactivity and ultimately decrease overeating and weight gain. However, extinction theory is not simply implemented, and a number of factors play a role in individual’s learning to food cues, and their ability to manage their food cue reactivity in today’s environment. Moreover, our understanding of basic learning and extinction processes will continue to advance and evolve. Further research to translate learning mechanisms to interventions, utilizing an in-depth and up-to-date understanding of learning theory, will provide additional knowledge on how to help children decrease overeating and weight.
Highlights.
Learning theory can be used to develop interventions to decrease overeating
We discuss a modern view of extinction and mechanisms to enhance extinction
We also review other learning mechanisms relevant to overeating
Acknowledgments
Supported by grants to KB (R01DK094475; R01 DK075861; K02HL112042) and MB (RO1 DA033123).
Footnotes
Disclaimer statement: Authors have no conflicts to declare
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
- Ahima RS, Prabakaran D, Mantzoros C, Qu D, Lowell B, Maratos-Flier E, Flier JS. Role of leptin in the neuroendocrine response to fasting. Nature. 1996;382(6588):250–252. doi: 10.1038/382250a0. [DOI] [PubMed] [Google Scholar]
- Altman M, Wilfley DE. Evidence Update on the Treatment of Overweight and Obesity in Children and Adolescents. J Clin Child & Adol Psych. 2014 doi: 10.1080/15374416.2014.963854. [DOI] [PubMed] [Google Scholar]
- Balleine BW, O’Doherty JP. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology. 2010;35(1):48–69. doi: 10.1038/npp.2009.131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barela PB. Theoretical mechanisms underlying the trial spacing effect in Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes. 1999;25:177–193. doi: 10.1037//0097-7403.25.2.177. [DOI] [PubMed] [Google Scholar]
- Beaver JD, Lawrence AD, Van Ditzhuijzen J, Davis MH, Woods A, Calder AJ. Individual differences in reward drive predict neural responses to images of food. Journal of Neuroscience. 2006;26(19):5160–5166. doi: 10.1523/Jneurosci.0350-06.2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berthoud HR. Neural control of appetite: cross-talk between homeostatic and non-homeostatic systems. Appetite. 2004;43(3):315–317. doi: 10.1016/j.appet.2004.04.009. S0195-6663(04)00109-6. [DOI] [PubMed] [Google Scholar]
- Berthoud HR. Metabolic and hedonic drives in the neural control of appetite: who is the boss? Curr Opin Neurobiol. 2011;21(6):888–896. doi: 10.1016/j.conb.2011.09.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berthoud HR, Morrison C. The brain, appetite, and obesity. Annu Rev Psychol. 2008;59:55–92. doi: 10.1146/annurev.psych.59.103006.093551. [DOI] [PubMed] [Google Scholar]
- Berridge KD, Ho CY, Richard JM, DiFeliceantonio AG. The tempted brain eats: pleasure and desire circuits in obesity and eating disorders. Brain Res. 2010;1350:43–64. doi: 10.1016/j.brainres.2010.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Best JR, Miller PH. A developmental perspective on executive function. Child Dev. 2010;81(6):1641–1660. doi: 10.1111/j.1467-8624.2010.01499.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bjork RA. Retrieval practice and the maintenance of knowledge. In: Gruneberg MM, Morris PE, Sykes RN, editors. Practical aspects of memory: Current research and issues: Memory in everyday life. Vol. 1. Oxford, England: Wiley; 1988. pp. 196–401. [Google Scholar]
- Bjork RA, Bjork EL. A new theory of disuse and an old theory of stimulus fluctuatio. In: Healy AF, Kosslyn SM, Shiffrin RM, editors. From learning processes to cognitive processes: Essays in honor of William K. Estes. Vol. 2. Hillsdale, NJ: Erlbaurn; 1992. pp. 35–67. [Google Scholar]
- Boutelle KN, Kuckertz JM, Carlson J, Amir N. A pilot study evaluating a one-session attention modification training to decrease overeating in obese children. Appetite. 2014;76:180–185. doi: 10.1016/j.appet.2014.01.075. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Liang J, Knatz S, Matheson B, Risbrough V, Strong D, Bouton ME. Design and implementation of a study evaluating extinction processes to food cues in obese children: The Intervention for Regulations of Cues Trial (iROC) Contemp Clin Trials. 2014;40C:95–104. doi: 10.1016/j.cct.2014.11.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Monreal T, Strong D, Amir N. A case series evaluating an attention modification program for overweight adults with binge eating. under review. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Peterson CB, Crosby RD, Rydell SA, Zucker N, Harnack L. Overeating phenotypes in overweight and obese children. Appetite. 2014;76:95–100. doi: 10.1016/j.appet.2014.01.076. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Zucker NL, Peterson CB, Rydell SA, Cafri G, Harnack L. Two novel treatments to reduce overeating in overweight children: a randomized controlled trial. J Consult Clin Psychol. 2011;79(6):759–771. doi: 10.1037/a0025713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Zucker N, Peterson CB, Rydell S, Carlson J, Harnack LJ. An intervention based on Schachter’s externality theory for overweight children: the regulation of cues pilot. J Pediatr Psychol. 2014;39(4):405–417. doi: 10.1093/jpepsy/jst142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle K, Wierenga CE, Bischoff-Grethe A, Melrose AJ, Grenesko-Stevens E, Paulus MP, Kaye WH. Increased brain response to appetitive tastes in the insula and amygdala in obese compared to healthy weight children when sated. International Journal of Obesity. 2014 doi: 10.1038/ijo.2014.206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Boutelle KN, Peterson CB, Carlson J, Bergmann K, Knatz S. Targeting food cue reactivity and satiety sensitivity in overweight and obese binge eaters: A pilot study. under review. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME. Context and behavioral processes in extinction. Learn Mem. 2004;11(5):485–494. doi: 10.1101/lm.78804\. [DOI] [PubMed] [Google Scholar]
- Bouton ME. Learning and Behavior: A Contemporary Synthesis. Sunderland, MA: Sinauer Associates, Inc; 2007. [Google Scholar]
- Bouton ME. Learning theory. In: Sadock BJ, Sadock VA, Ruiz P, editors. Kaplan & Sadock’s Comprehensive textbook of psychiatry. New York: Lippincott Williams & Wilkins; 2009. pp. 647–658. [Google Scholar]
- Bouton ME. Learning and the persistence of appetite: extinction and the motivation to eat and overeat. Physiol Behav. 2011;103(1):51–58. doi: 10.1016/j.physbeh.2010.11.025. [DOI] [PubMed] [Google Scholar]
- Bouton ME. Why behavior change is difficult to sustain. Prev Med. 2014;68C:29–36. doi: 10.1016/j.ypmed.2014.06.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Carranza-Jasso, Trask S. Role of response inhibition in the extinction of discriminated operant behavior. in preparation. [Google Scholar]
- Bouton ME, Peck CA. Spontaneous recovery in cross-motivational transfer (counter-conditioning) Animal Learning & Behavior. 1992;20:313–321. [Google Scholar]
- Bouton ME, Schepers ST. Resurgence of instrumental behavior after an abstinence contingency. Learning & Behavior. 2014;42:131–143. doi: 10.3758/s13420-013-0130-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Schepers ST. Renewal after the punishment of free operant behavior. Journal of Experimental Psychology: Animal Learning and Cognition. 2015 doi: 10.1037/xan0000051. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Todd TP. A fundamental role for context in instrumental learning and extinction. Behav Processes. 2014;104:13–19. doi: 10.1016/j.beproc.2014.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Todd TP, Leon SP. Contextual control of discriminated operant behavior. J Exp Psychol Anim Learn Cogn. 2014;40(1):92–105. doi: 10.1037/xan0000002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Todd TP, Vurbic D, Winterbauer NE. Renewal after the extinction of free operant behavior. Learn Behav. 2011;39(1):57–67. doi: 10.3758/s13420-011-0018-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Vurbic D, Woods AM. D-cycloserine facilitates context-specific fear extinction learning. Neurobiology of Learning and Memory. 2008;90:504–510. doi: 10.1016/j.nlm.2008.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Woods AM, Pineno O. Occasional reinforced trials during extinction can slow the rate of rapid reacquisition. Learn Motiv. 2004;35(4):371–390. doi: 10.1016/j.lmot.2004.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouton ME, Woods AM, Moody EW, Sunsay C, Garcia-Gutierrez A. Counteracting the context-dependence of extinction: Relapse and tests of some relapse prevention methods. In: Craske MG, Hermans D, Vansteenwegen, editors. Fear and learning; From basic processes to clinical implications. Washington, D.C: American Psychological Association; 2006. [Google Scholar]
- Brooks DC, Bouton ME. A retrieval cue for extinction attenuates spontaneous recovery. J Exp Psychol Anim Behav Process. 1993;19(1):77–89. doi: 10.1037//0097-7403.19.1.77. [DOI] [PubMed] [Google Scholar]
- Brooks DC, Bouton ME. A Retrieval Cue for Extinction Attenuates Response Recovery (Renewal) Caused by a Return to the Conditioning Context. Journal of Experimental Psychology-Animal Behavior Processes. 1994;20(4):366–379. doi: 10.1037/0097-7403.20.4.366. [DOI] [PubMed] [Google Scholar]
- Brooks DC, Hale B, Nelson JB, Bouton ME. Reinstatement after Counterconditioning. Animal Learning & Behavior. 1995;23(4):383–390. doi: 10.3758/Bf03198938. [DOI] [Google Scholar]
- Brownell KD. Fast food and obesity in children. Pediatrics. 2004;113(1 Pt 1):132. doi: 10.1542/peds.113.1.132. [DOI] [PubMed] [Google Scholar]
- Bruce AS, Holsen LM, Chambers RJ, Martin LE, Brooks WM, Zarcone JR, Butler MG, Savage CR. Obese children show hyperactivation to food pictures in brain networks linked to motivation, reward and cognitive control. Int J Obes. 2010;34(10):1494–1500. doi: 10.1038/ijo.2010.84. doi:ijo20108410.1038/ijo.2010.84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunstrom JM, Burn JF, Sell NR, Collingwood JM, Rogers PJ, Wilkinson LL, Hinton EC, Maynard OM, Ferriday D. Episodic Memory and Appetite Regulation in Humans. PLoS One. 2012;7(12) doi: 10.1371/journal.pone.0050707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burger KS, Stice E. Elevated energy intake is correlated with hyperresponsivity in attentional, gustatory, and reward brain regions while anticipating palatable food receipt. Am J Clin Nutr. 2013;97(6):1188–1194. doi: 10.3945/ajcn.112.055285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Burger KS, Stice E. Greater striatopallidal adaptive coding during cue-reward learning and food reward habituation predict future weight gain. Neuroimage. 2014;99:122–128. doi: 10.1016/j.neuroimage.2014.05.066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cain CK, Blouin AM, Barad M. Temporally massed CS presentations generate more fear extinction than spaced presentations. J Exp Psychol Anim Behav Process. 2003;29(4):323–333. doi: 10.1037/0097-7403.29.4.323. [DOI] [PubMed] [Google Scholar]
- Calitri R, Pothos EM, Tapper K, Brunstrom JM, Rogers PJ. Cognitive biases to healthy and unhealthy food words predict change in BMI. Obesity. 2010;18(12):2282–2287. doi: 10.1038/oby.2010.78. oby201078 [pii] [DOI] [PubMed] [Google Scholar]
- Castellanos EH, Charboneau E, Dietrich MS, Park S, Bradley BP, Mogg K, Cowan RL. Obese adults have visual attention bias for food cue images: evidence for altered reward system function. Int J Obes. 2009;33(9):1063–1073. doi: 10.1038/ijo.2009.138. ijo2009138 [pii] [DOI] [PubMed] [Google Scholar]
- Chan WY, Leung HT, Westbrook RF, McNally GP. Effects of recent exposure to a conditioned stimulus on extinction of Pavlovian fear conditioning. Learning & Memory. 2010;17:512–521. doi: 10.1101/lm.1912510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cinciripini PM, Lapitsky LG, Wallfisch A, Mace R, Nezami E, Van Vunakis H. An evaluation of a multicomponent treatment program involving scheduled smoking and relapse prevention procedures: initial findings. Addict Behav. 1994;19(1):13–22. doi: 10.1016/0306-4603(94)90047-7. [DOI] [PubMed] [Google Scholar]
- Cinciripini PM, Lapitsky L, Seay S, Wallfisch A, Kitchens K, Van Vunakis H. The effects of smoking schedules on cessation outcome: can we improve on common methods of gradual and abrupt nicotine withdrawal? J Consult Clin Psychol. 1995;63(3):388–399. doi: 10.1037//0022-006x.63.3.388. [DOI] [PubMed] [Google Scholar]
- Collins BN, Brandon TH. Effects of extinction context and retrieval cues on alcohol cue reactivity among nonalcoholic drinkers. Journal of Consulting and Clinical Psychology. 2002;70:390–397. [PubMed] [Google Scholar]
- Cornier MA, Salzberg AK, Endly DC, Bessesen DH, Rojas DC, Tregellas JR. The effects of overfeeding on the neuronal response to visual food cues in thin and reduced-obese individuals. PLoS One. 2009;4(7):e6310. doi: 10.1371/journal.pone.0006310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Craske MG. Anxiety Disorders: Psychological approaches to theory and treatment. Boulder, CO: Westview Press; 1999. [Google Scholar]
- Craske MG, Kircanski K, Zelikowsky M, Mystkowski J, Chowdhury N, Baker A. Optimizing inhibitory learning during exposure therapy. Behav Res Ther. 2008;46 (1):5–27. doi: 10.1016/j.brat.2007.10.003. [DOI] [PubMed] [Google Scholar]
- Culver NC, Stoyanova M, Craske MG. Emotional variability and sustained arousal during exposure. J Behav Ther Exp Psychiatry. 2012;43(2):787–793. doi: 10.1016/j.jbtep.2011.10.009. [DOI] [PubMed] [Google Scholar]
- Davidson TL, Kanoski SE, Schier LA, Clegg DJ, Benoit SC. A potential role for the hippocampus in energy intake and body weight regulation. Curr Opin Pharmacol. 2007;7(6):613–616. doi: 10.1016/j.coph.2007.10.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davidson TL, Kanoski SE, Walls EK, Jarrard LE. Memory inhibition and energy regulation. Physiol Behav. 2005;86(5):731–746. doi: 10.1016/j.physbeh.2005.09.004. [DOI] [PubMed] [Google Scholar]
- Davidson TL, Sample CH, Swithers SE. An application of Pavlovian principles to the problems of obesity and cognitive decline. Neurobiol Learn Mem. 2014;108C:172–84. doi: 10.1016/j.nlm.2013.07.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Davidson TL, Tracy AL, Schier LA, Swithers SE. A view of obesity as a learning and memory disorder. J Exp Psychol Anim Learn Cogn. 2014;40(3):261–279. doi: 10.1037/xan0000029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Delamater AR, Holland PC. The influence of CS-US interval on several different indices of learning in appetitive conditioning. Journal of Experimental Psychology-Animal Behavior Processes. 2008;34(2):202–222. doi: 10.1037/0097-7403.34.2.202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- DelParigi A, Chen K, Salbe AD, Hill JO, Wing RR, Reiman EM, Tataranni PA. Successful dieters have increased neural activity in cortical areas involved in the control of behavior. International Journal of Obesity. 2007;31(3):440–448. doi: 10.1038/sj.ijo.0803431. [DOI] [PubMed] [Google Scholar]
- Dickinson A. Actions and habits: The development of behavioral autonomy. Philosophical Transactions of the Royal Society of London Series B, Biological Sciences. 1985;308:67–78. http://dx.doi.org/10.1098/rstb.1985.0010. [Google Scholar]
- Dietz WH. Childhood weight affects adult morbidity and mortality. J Nutr. 1998;128(2 Suppl):411S–414S. doi: 10.1093/jn/128.2.411S. [DOI] [PubMed] [Google Scholar]
- Dixon JB. The effect of obesity on health outcomes. [Review] Mol Cell Endocrinol. 2010;316(2):104–108. doi: 10.1016/j.mce.2009.07.008. [DOI] [PubMed] [Google Scholar]
- Domjan M. Effects of intertrial interval on taste aversion learning in rats. Physiology & Behavior. 1980;25:117–125. doi: 10.1016/0031-9384(80)90191-2. [DOI] [PubMed] [Google Scholar]
- Drewnowski A. Obesity and the food environment: dietary energy density and diet costs. Am J Prev Med. 2004;27(3 Suppl):154–162. doi: 10.1016/j.amepre.2004.06.011. [DOI] [PubMed] [Google Scholar]
- Drewnowski A. The cost of US foods as related to their nutritive value. Am J Clin Nutr. 2010;92(5):1181–1188. doi: 10.3945/ajcn.2010.29300. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duffey KJ, Popkin BM. Causes of increased energy intake among children in the U.S., 1977–2010. Am J Prev Med. 2013;44(2):e1–8. doi: 10.1016/j.amepre.2012.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein LH, Carr KA, Scheid J, Gebre E, O’Brien A, Temple JL, Bouton ME. Habituation to food: Relationships with taste and working memory in children. 2015. Under review. [Google Scholar]
- Epstein LH, Fletcher KD, O’Neill J, Roemmich JN, Raynor H, Bouton ME. Food characteristics, long-term habituation and energy intake. Laboratory and field studies. Appetite. 2013;60(1):40–50. doi: 10.1016/j.appet.2012.08.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein LH, Robinson JL, Roemmich JN, Marusewski A. Slow rates of habituation predict greater zBMI gains over 12 months in lean children. Eat Behav. 2011;12(3):214–218. doi: 10.1016/j.eatbeh.2011.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein LH, Saad FG, Giacomelli AM, Roemmich JN. Effects of allocation of attention on habituation to olfactory and visual food stimuli in children. Physiol Behav. 2005;84(2):313–319. doi: 10.1016/j.physbeh.2004.12.009. [DOI] [PubMed] [Google Scholar]
- Epstein LH, Saad FG, Handley EA, Roemmich JN, Hawk LW, McSweeney FK. Habituation of salivation and motivated responding for food in children. Appetite. 2003;41(3):283–289. doi: 10.1016/S0195-6663(03)00106-5. [DOI] [PubMed] [Google Scholar]
- Epstein LH, Temple JL, Roemmich JN, Bouton ME. Habituation as a Determinant of Human Food Intake. Psychological Review. 2009;116(2):384–407. doi: 10.1037/A0015074. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Epstein LH. Family-based behavioural intervention for obese children. Int J Obes Relat Metab Disord. 1996;20(Suppl 1):S14–21. [PubMed] [Google Scholar]
- Epstein LH, Valoski A, Wing RR, McCurley J. Ten-year outcomes of behavioral family-based treatment for childhood obesity. Health Psychol. 1994;13(5):373–383. doi: 10.1037//0278-6133.13.5.373. [DOI] [PubMed] [Google Scholar]
- Ferriday D, Brunstrom JM. How does food-cue exposure lead to larger meal sizes? Br J Nutr. 2008;100(6):1325–1332. doi: 10.1017/S0007114508978296. S0007114508978296 [pii] [DOI] [PubMed] [Google Scholar]
- Ferriday D, Brunstrom JM. ‘I just can’t help myself’: effects of food-cue exposure in overweight and lean individuals. Int J Obes. 2010 doi: 10.1038/ijo.2010.117. ijo2010117 [pii] [DOI] [PubMed] [Google Scholar]
- Fisher JO, Birch LL. Eating in the absence of hunger and overweight in girls from 5 to 7 y of age. Am J Clin Nutr. 2002;76(1):226–231. doi: 10.1093/ajcn/76.1.226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flagel SB, Robinson TE, Clark JJ, Clinton SM, Watson SJ, Seeman P, Phillips PEM, Akil H. An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: Implications for addiction. Neuropsychopharmacology. 2010;35:388–400. doi: 10.1038/npp.2009.142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Flegal KM, Kalantar-Zadeh K. Overweight, mortality and survival. Obesity. 2013;21(9):1744–1745. doi: 10.1002/oby.20588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Galarce EM, Crombag HS, Holland PC. Reinforcer-specificity of appetitive and consummatory behavior of rats after Pavlovian conditioning with food reinforcers. Physiol Behav. 2007;91(1):95–105. doi: 10.1016/j.physbeh.2007.01.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Graham R, Hoover A, Ceballos NA, Komogortsev O. Body mass index moderates gaze orienting biases and pupil diameter to high and low calorie food images. Appetite. 2011;56(3):577–586. doi: 10.1016/j.appet.2011.01.029. [DOI] [PubMed] [Google Scholar]
- Grill HJ, Kaplan JM. The neuroanatomical axis for control of energy balance. Front Neuroendocrinol. 2002;23(1):2–40. doi: 10.1006/frne.2001.0224. [DOI] [PubMed] [Google Scholar]
- Gunther LM, Denniston JC, Miller RR. Conducting exposure treatment in multiple contexts can prevent relapse. Behav Res Ther. 1998;36(1):75–91. doi: 10.1016/s0005-7967(97)10019-5. [DOI] [PubMed] [Google Scholar]
- Guo SS, Roche AF, Chumlea WC, Gardner JD, Siervogel RM. The predictive value of childhood body mass index values for overweight at age 35 y. Am J Clin Nutr. 1994;59(4):810–819. doi: 10.1093/ajcn/59.4.810. [DOI] [PubMed] [Google Scholar]
- Guo SS, Wu W, Chumlea WC, Roche AF. Predicting overweight and obesity in adulthood from body mass index values in childhood and adolescence. Am J Clin Nutr. 2002;76(3):653–658. doi: 10.1093/ajcn/76.3.653. [DOI] [PubMed] [Google Scholar]
- Hall KD, Hammond RA, Rahmandad H. Dynamic Interplay Among Homeostatic, Hedonic, and Cognitive Feedback Circuits Regulating Body Weight. Am J Pub Health. 2014;104 (7):1169–1175. doi: 10.2105/AJPH.2014.301931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hall KD, Sacks G, Chandramohan D, Chow CC, Wang YC, Gortmaker SL, Swinburn BA. Quantification of the effect of energy imbalance on bodyweight. Lancet. 2011;378(9793):826–837. doi: 10.1016/S0140-6736(11)60812-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Higgs S. Memory for recent eating and its influence on subsequent food intake. Appetite. 2002;39(2):159–166. doi: 10.1006/appe.2002.0500. [DOI] [PubMed] [Google Scholar]
- Higgs S. Memory and its role in appetite regulation. Physiol Behav. 2005;85(1):67–72. doi: 10.1016/j.physbeh.2005.04.003. [DOI] [PubMed] [Google Scholar]
- Higgs S. Cognitive influences on food intake: the effects of manipulating memory for recent eating. Physiol Behav. 2008;94(5):734–739. doi: 10.1016/j.physbeh.2008.04.012. [DOI] [PubMed] [Google Scholar]
- Higgs S, Donohoe JE. Focusing on food during lunch enhances lunch memory and decreases later snack intake. Appetite. 2011;57(1):202–206. doi: 10.1016/j.appet.2011.04.016. [DOI] [PubMed] [Google Scholar]
- Higgs S, Rutters F, Thomas JM, Naish K, Humphreys GW. Top down modulation of attention to food cues via working memory. Appetite. 2012;59(1):71–75. doi: 10.1016/j.appet.2012.03.018. [DOI] [PubMed] [Google Scholar]
- Higgs S, Woodward M. Television watching during lunch increases afternoon snack intake of young women. Appetite. 2009;52(1):39–43. doi: 10.1016/j.appet.2008.07.007. [DOI] [PubMed] [Google Scholar]
- Hill C, Llewellyn CH, Saxton J, Webber L, Semmler C, Carnell S, van Jaarsveld CH, Boniface D, Wardle J. Adiposity and ‘eating in the absence of hunger’ in children. Int J Obes (Lond) 2008;32(10):1499–1505. doi: 10.1038/ijo.2008.113. [DOI] [PubMed] [Google Scholar]
- Ho M, Garnett SP, Baur L, Burrows T, Stewart L, Neve M, Collins C. Effectiveness of lifestyle interventions in child obesity: systematic review with meta-analysis. Pediatrics. 2012;130(6):e1647–1671. doi: 10.1542/peds.2012-1176. [DOI] [PubMed] [Google Scholar]
- Hogarth L, Retzler C, Munafo MR, Tran DM, Troisi JR, 2nd, Rose AK, Jone A, Field M. Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies. Behav Res Ther. 2014;59:61–70. doi: 10.1016/j.brat.2014.06.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holland PC, Petrovich GD, Gallagher M. The effects of amygdala lesions on conditioned stimulus-potentiated eating in rats. Physiol Behav. 2002;76(1):117–129. doi: 10.1016/s0031-9384(02)00688-1. [DOI] [PubMed] [Google Scholar]
- Holmes NM, Marchand AR, Coutureau E. Pavlovian to instrumental transfer: a neurobehavioural perspective. Neurosci Biobehav Rev. 2010;34(8):1277–1295. doi: 10.1016/j.neubiorev.2010.03.007. [DOI] [PubMed] [Google Scholar]
- Holmes NM, Westbrook RF. Extinction of reinstated or ABC renewed fear responses renders them resistant to subsequent ABA renewal. J Exp Psychol Anim Behav Process. 2013;39(3):208–220. doi: 10.1037/a0031986. [DOI] [PubMed] [Google Scholar]
- Hume DJ, Howells FM, Rauch HG, Kroff J, Lambert EV. Electrophysiological indices of visual food cue-reactivity. Differences in obese, overweight and normal weight women. Appetite. 2015;85C:126–137. doi: 10.1016/j.appet.2014.11.012. [DOI] [PubMed] [Google Scholar]
- Janak PH, Corbit LH. Deepened extinction following compound stimulus presentation: noradrenergic modulation. Learn Mem. 2011;18(1):1–10. doi: 10.1101/lm.1923211. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jansen A, Broekmate J, Heymans M. Cue-exposure vs self-control in the treatment of binge eating: a pilot study. Behav Res Ther. 1992;30(3):235–241. doi: 10.1016/0005-7967(92)90069-s. [DOI] [PubMed] [Google Scholar]
- Jansen A, Theunissen N, Slechten K, Nederkoorn C, Boon B, Mulkens S, Roefs A. Overweight children overeat after exposure to food cues. Eat Behav. 2003;4(2):197–209. doi: 10.1016/S1471-0153(03)00011-4. [DOI] [PubMed] [Google Scholar]
- Jeffery, Harnack Evidence implicating eating as a primary driver for the obesity epidemic. Diabetes. 2007;56:2673–2676. doi: 10.2337/db07-1029. [DOI] [PubMed] [Google Scholar]
- Kanoski SE, Davidson TL. Western diet consumption and cognitive impairment: links to hippocampal dysfunction and obesity. Physiol Behav. 2011;103(1):59–68. doi: 10.1016/j.physbeh.2010.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kanoski SE, Hayes MR, Greenwald HS, Fortin SM, Gianessi CA, Gilbert JR, Grill HJ. Hippocampal leptin signaling reduces food intake and modulates food-related memory processing. Neuropsychopharmacology. 2011;36(9):1859–1870. doi: 10.1038/npp.2011.70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kearns DN, Tunstall BJ, Weiss SJ. Deepened extinction of cocaine cues. Drug Alcohol Depend. 2012;124(3):283–287. doi: 10.1016/j.drugalcdep.2012.01.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kessler D. The end of overeating: Taking control of the insatiable American appetite. New York, NY: Rodale; 2009. [Google Scholar]
- Key TJ, Schatzkin A, Willett WC, Allen NE, Spencer EA, Travis RC. Diet, nutrition and the prevention of cancer. Public Health Nutr. 2004;7(1A):187–200. doi: 10.1079/phn2003588. S1368980004000205 [pii] [DOI] [PubMed] [Google Scholar]
- Kindt M, Soeter M. Reconsolidation in a human fear conditioning study: A test of extinction as updating mechanism. Biological Psychology. 2013;92:43–50. doi: 10.1016/j.biopsycho.2011.09.016. [DOI] [PubMed] [Google Scholar]
- Kindt M, Soeter M, Vervliet B. Beyond extinction: Erasing human fear responses and preventing the return of fear. Nature Neuroscience. 2009;12:256–258. doi: 10.1038/nn.2271. [DOI] [PubMed] [Google Scholar]
- Kircanski K, Mortazavi A, Castriotta N, Baker AS, Mystkowski JL, Yi R, Craske MG. Challenges to the traditional exposure paradigm: variability in exposure therapy for contamination fears. J Behav Ther Exp Psychiatry. 2012;43(2):745–751. doi: 10.1016/j.jbtep.2011.10.010. [DOI] [PubMed] [Google Scholar]
- Kremer EF. The Rescorla-Wagner model: losses in associative strength in compound conditioned stimuli. J Exp Psychol Anim Behav Process. 1978;4(1):22–36. doi: 10.1037//0097-7403.4.1.22. [DOI] [PubMed] [Google Scholar]
- Laborda ML, McConnell BL, Miller RR. Behavioral techniques to reduce relapse after exposure therapy: Applications of studies of experimental extinction. In: Schachtman TR, Reilly S, editors. Applications of conditioning theory. Oxford, UK: Oxford University Press; 2011. pp. 79–103. [Google Scholar]
- Lang AJ, Craske MG. Manipulations of exposure-based therapy to reduce return of fear: a replication. [Comparative Study] Behav Res Ther. 2000;38(1):1–12. doi: 10.1016/s0005-7967(99)00031-5. [DOI] [PubMed] [Google Scholar]
- Lattal KM, Nakajima S. Overexpectation in appetitive Pavlovian and instrumental conditioning. Animal Learning & Behavior. 1998;26:351–360. [Google Scholar]
- Leslie JC, Norwood K, Kennedy PJ, Begley M, Shaw D. Facilitation of extinction of operant behaviour in C57Bl/6 mice by chlordiazepoxide and D-cycloserine. Psychopharmacology. 2012;223:223–235. doi: 10.1007/s00213-012-2710-4. [DOI] [PubMed] [Google Scholar]
- Leung HT, Westbrook RF. Spontaneous recovery of extinguished fear responses deepens their extinction: a role for error-correction mechanisms. J Exp Psychol Anim Behav Process. 2008;34(4):461–474. doi: 10.1037/0097-7403.34.4.461. [DOI] [PubMed] [Google Scholar]
- Loeber S, Grosshans M, Korucuoglu O, Vollmert C, Vollstadt-Klein S, Schneider S, Wiers RW, Mann K, Kiefer F. Impairment of inhibitory control in response to food-associated cues and attentional bias of obese participants and normal-weight controls. International Journal of Obesity. 2012;36(10):1334–1339. doi: 10.1038/Ijo.2011.184. [DOI] [PubMed] [Google Scholar]
- Lovibond PF, Colagiuri B. Facilitation of voluntary goal-directed action by reward cues. Psychol Sci. 2013;24(10):2030–2037. doi: 10.1177/0956797613484043. [DOI] [PubMed] [Google Scholar]
- Lowe MR. Self-regulation of energy intake in the prevention and treatment of obesity: is it feasible? Obesity Research. 2003;11(Suppl):44S–59S. doi: 10.1038/oby.2003.223. [DOI] [PubMed] [Google Scholar]
- Lutter M, Nestler EJ. Homeostatic and hedonic signals interact in the regulation of food intake. J Nutr. 2009;139(3):629–632. doi: 10.3945/jn.108.097618. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mahler SV, de Wit H. Cue-reactors: individual differences in cue-induced craving after food or smoking abstinence. PLoS One. 2010;5(11):e15475. doi: 10.1371/journal.pone.0015475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Malik S, McGlone F, Bedrossian D, Dagher A. Ghrelin modulates brain activity in areas that control appetitive behavior. Cell Metab. 2008;7(5):400–409. doi: 10.1016/j.cmet.2008.03.007. [DOI] [PubMed] [Google Scholar]
- Marchant NJ, Khuc TN, Pickens CL, Bonci A, Shaham Y. Context-induced relapse to alcohol seeking after punishment in a rat model. Biol Psychiatry. 2013;73(3):256–262. doi: 10.1016/j.biopsych.2012.07.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin LE, Holsen LM, Chambers RJ, Bruce AS, Brooks WM, Zarcone JR, Butler MG, Savage CR. Neural mechanisms associated with food motivation in obese and healthy weight adults. Obesity. 2010;18(2):254–260. doi: 10.1038/oby.2009.220. oby2009220 [pii] [DOI] [PubMed] [Google Scholar]
- McCaffery JM, Haley AP, Sweet LH, Phelan S, Raynor HA, Del Parigi A, Wing RR. Differential functional magnetic resonance imaging response to food pictures in successful weight-loss maintainers relative to normal-weight and obese controls. Am J Clin Nutr. 2009;90(4):928–934. doi: 10.3945/ajcn.2009.27924. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meyer MD, Risbrough VB, Liang J, Boutelle KN. Pavlovian conditioning to hedonic food cues in overweight and lean individuals. Appetite. 2014;87C:56–61. doi: 10.1016/j.appet.2014.12.002. [DOI] [PubMed] [Google Scholar]
- Micic D. Obesity in children and adolescents--a new epidemic? Consequences in adult life. J Pediatr Endocrinol Metab. 2001;14(Suppl 5):1345–1352. discussion 1365. [PubMed] [Google Scholar]
- Moens E, Braet C. Predictors of disinhibited eating in children with and without overweight. Behav Res Ther. 2007;45(6):1357–1368. doi: 10.1016/j.brat.2006.10.001. [DOI] [PubMed] [Google Scholar]
- Monfils MH, Cowansage KK, Klann E, LeDoux JE. Extinction-reconsolidation boundaries: key to persistent attenuation of fear memories. Science. 2009;324:951–955. doi: 10.1126/science.1167975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moody EW, Sunsay C, Bouton ME. Priming and trial spacing in extinction: effects on extinction performance, spontaneous recovery, and reinstatement in appetitive conditioning. Q J Exp Psychol. 2006;59(5):809–829. doi: 10.1080/17470210500299045. [DOI] [PubMed] [Google Scholar]
- Murdaugh DL, Cox JE, Cook EW, 3rd, Weller RE. fMRI reactivity to high-calorie food pictures predicts short- and long-term outcome in a weight-loss program. Neuroimage. 2012;59(3):2709–2721. doi: 10.1016/j.neuroimage.2011.10.071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Must A, Spadano J, Coakley EH, Field AE, Colditz G, Dietz WH. The disease burden associated with overweight and obesity. JAMA. 1999;282(16):1523–1529. doi: 10.1001/jama.282.16.1523. [DOI] [PubMed] [Google Scholar]
- Mystkowski JL, Craske MG, Echiverri AM, Labus JS. Mental reinstatement of context and return of fear in spider-fearful participants. Behav Ther. 2006;37(1):49–60. doi: 10.1016/j.beth.2005.04.001. [DOI] [PubMed] [Google Scholar]
- Nader K, Schafe GE, LeDoux JE. Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature. 2000;406:722–726. doi: 10.1038/35021052. [DOI] [PubMed] [Google Scholar]
- Nederkoorn C, Smulders F, Havermans R, Jansen A. Exposure to binge food in bulimia nervosa: finger pulse amplitude as a potential measure of urge to eat and predictor of food intake. Appetite. 2004;42(2):125–130. doi: 10.1016/j.appet.2003.11.001. S019566630300182X [pii] [DOI] [PubMed] [Google Scholar]
- Nederkoorn C, Smulders FT, Jansen A. Cephalic phase responses, craving and food intake in normal subjects. Appetite. 2000;35(1):45–55. doi: 10.1006/appe.2000.0328. S0195-6663(00)90328-3 [pii] [DOI] [PubMed] [Google Scholar]
- Ng J, Stice E, Yokum S, Bohon C. An fMRI study of obesity, food reward, and perceived caloric density. Does a low-fat label make food less appealing? Appetite. 2011;57(1):65–72. doi: 10.1016/j.appet.2011.03.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nielsen SJ, Popkin BM. Patterns and trends in food portion sizes, 1977–1998. JAMA. 2003;289(4):450–453. doi: 10.1001/jama.289.4.450. [DOI] [PubMed] [Google Scholar]
- Nijs IM, Muris P, Euser AS, Franken IH. Differences in attention to food and food intake between overweight/obese and normal-weight females under conditions of hunger and satiety. Appetite. 2010;54(2):243–254. doi: 10.1016/j.appet.2009.11.004. [DOI] [PubMed] [Google Scholar]
- Nirenberg TD, Miller PM. Salivation: an assessment of food craving. Behav Res Ther. 1982;20:405–407. doi: 10.1016/0005-7967(82)90102-4. [DOI] [PubMed] [Google Scholar]
- Nock NL, Dimitropolous A, Tkach J, Frasure H, von Gruenigen V. Reduction in neural activation to high-calorie food cues in obese endometrial cancer survivors after a behavioral lifestyle intervention: a pilot study. BMC Neurosci. 2012;13:74. doi: 10.1186/1471-2202-13-74. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nogueiras R, Romero-Pico A, Vazquez MJ, Novelle MG, Lopez M, Dieguez C. The opioid system and food intake: homeostatic and hedonic mechanisms. Obes Facts. 2012;5(2):196–207. doi: 10.1159/000338163. [DOI] [PubMed] [Google Scholar]
- Nummenmaa L, Hirvonen J, Hannukainen JC, Immonen H, Lindroos MM, Salminen P, Nuutila P. Dorsal striatum and its limbic connectivity mediate abnormal anticipatory reward processing in obesity. PLoS One. 2012;7(2):e31089. doi: 10.1371/journal.pone.0031089. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oakes ME, Slotterback CS. Self-reported measures of appetite in relation to verbal cues about many foods. Curr Psychol. 2000;19:137–142. [Google Scholar]
- Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of childhood and adult obesity in the United States, 2011–2012. JAMA. 2014;311(8):806–814. doi: 10.1001/jama.2014.732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Olmstead MC, Lafond MV, Everitt BJ, Dickinson A. Cocaine seeking by rats is a goal-directed action. Behavioral Neuroscience. 2001;115:394–402. [PubMed] [Google Scholar]
- Overduin J, Jansen A, Eilkes H. Cue reactivity to food- and body-related stimuli in restrained and unrestrained eaters. Addict Behav. 1997;22(3):395–404. doi: 10.1016/s0306-4603(97)80002-0. S0306460397800020 [pii] [DOI] [PubMed] [Google Scholar]
- Pearce JM, Hall G. A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychol Rev. 1980;87(6):532–552. [PubMed] [Google Scholar]
- Peck CA, Bouton ME. Context and Performance in Aversive-to-Appetitive and Appetitive-to-Aversive Transfer. Learn Motiv. 1990;21(1):1–31. doi: 10.1016/0023-9690(90)90002-6. [DOI] [Google Scholar]
- Petrovich GD, Ross CA, Gallagher M, Holland PC. Learned contextual cue potentiates eating in rats. Physiol Behav. 2007;90(2–3):362–367. doi: 10.1016/j.physbeh.2006.09.031. S0031-9384(06)00429-X [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petrovich GD, Gallagher M. Control of food consumption by learned cues: a forebrain–hypothalamic network. Physiol Behav. 2007;91(4):397–403. doi: 10.1016/j.physbeh.2007.04.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petrovich GD, Ross CA, Holland PC, Gallagher M. Medial prefrontal cortex is necessary for an appetitive contextual conditioned stimulus to promote eating in sated rats. J Neurosci. 2007;27(24):6436–6441. doi: 10.1523/JNEUROSCI.5001-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Petrovich GD, Setlow B, Holland PC, Gallagher M. Amygdalo-hypothalamic circuit allows learned cues to override satiety and promote eating. J Neurosci. 2002;22(19):8748–8753. doi: 10.1523/JNEUROSCI.22-19-08748.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Popkin BM, Duffey K, Gordon-Larsen P. Environmental influences on food choice, physical activity and energy balance. Physiol Behav. 2005;86(5):603–613. doi: 10.1016/j.physbeh.2005.08.051. [DOI] [PubMed] [Google Scholar]
- Quirk GJ, Mueller D. Neural mechanisms of extinction learning and retrieval. Neuropsychopharmacology Reviews. 2008;33:56–72. doi: 10.1038/sj.npp.1301555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rankin CH, Abrams T, Barry RJ, Bhatnagar S, Clayton DF, Colombo J, Thompson RF. Habituation revisited: an updated and revised description of the behavioral characteristics of habituation. Neurobiol Learn Mem. 2009;92(2):135–138. doi: 10.1016/j.nlm.2008.09.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rescorla RA. Deepened extinction from compound stimulus presentation. J Exp Psychol Anim Behav Process. 2006;32(2):135–144. doi: 10.1037/0097-7403.32.2.135. [DOI] [PubMed] [Google Scholar]
- Rescorla RA. Spontaneous recovery. Learning and Memory. 2004;11:501–509. doi: 10.1101/lm.77504. [DOI] [PubMed] [Google Scholar]
- Rescorla RA. Renewal after overexpectation. Learn Behav. 2007;35(1):19–26. doi: 10.3758/bf03196070. [DOI] [PubMed] [Google Scholar]
- Rescorla RA, Solomon RL. Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning. Psychol Rev. 1967;74(3):151–182. doi: 10.1037/h0024475. [DOI] [PubMed] [Google Scholar]
- Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Classical Conditioning II. Appleton-Century-Crofts; 1972. pp. 64–99. [Google Scholar]
- Ricker ST, Bouton ME. Reacquisition following extinction in appetitive conditioning. Animal Learning & Behavior. 1996;24(4):423–436. doi: 10.3758/Bf03199014. [DOI] [Google Scholar]
- Robinson E, Aveyard P, Daley A, Jolly K, Lewis A, Lycett D, Higgs S. Eating attentively: a systematic review and meta-analysis of the effect of food intake memory and awareness on eating. American Journal of Clinical Nutrition. 2013;97(4):728–742. doi: 10.3945/ajcn.112.045245. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robinson E, Higgs S, Daley AJ, Jolly K, Lycett D, Lewis A, Aveyard P. Development and feasibility testing of a smart phone based attentive eating intervention. BMC Public Health. 2013;13:639. doi: 10.1186/1471-2458-13-639. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rothemund Y, Preuschhof C, Bohner G, Bauknecht HC, Klingebiel R, Flor H, Klapp BF. Differential activation of the dorsal striatum by high-calorie visual food stimuli in obese individuals. Neuroimage. 2007;37(2):410–421. doi: 10.1016/j.neuroimage.2007.05.008. [DOI] [PubMed] [Google Scholar]
- Rowe MK, Craske MG. Effects of varied-stimulus exposure training on fear reduction and return of fear. Behav Res Ther. 1998;36(7–8):719–734. doi: 10.1016/s0005-7967(97)10017-1. [DOI] [PubMed] [Google Scholar]
- Saper CB, Chou TC, Elmquist JK. The need to feed: homeostatic and hedonic control of eating. Neuron. 2002;36(2):199–211. doi: 10.1016/s0896-6273(02)00969-8. [DOI] [PubMed] [Google Scholar]
- Saunders BT, Robinson TE. A cocaine cue acts as an incentive stimulus in some but not others: implications for addiction. Biol Psychiatry. 2010;67(8):730–736. doi: 10.1016/j.biopsych.2009.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saunders BT, Robinson TE. Individual variation in the motivational properties of cocaine. Neuropsychopharmacology. 2011;36(8):1668–1676. doi: 10.1038/npp.2011.48. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Saunders BT, Robinson TE. Individual variation in resisting temptation: implications for addiction. Neurosci Biobehav Rev. 2013;37(9 Pt A):1955–1975. doi: 10.1016/j.neubiorev.2013.02.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schachter S. Obesity and eating. Internal and external cues differentially affect the eating behavior of obese and normal subjects. Science. 1968;161(3843):751–756. doi: 10.1126/science.161.3843.751. [DOI] [PubMed] [Google Scholar]
- Schmidt RA, Bjork RA. New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science. 1992;3:207–217. [Google Scholar]
- Schwartz MW, Woods SC, Porte D, Jr, Seeley RJ, Baskin DG. Central nervous system control of food intake. Nature. 2000;404(6778):661–671. doi: 10.1038/35007534. [DOI] [PubMed] [Google Scholar]
- Shahan TA, Sweeney MM. A model of resurgence based on behavioral momentum theory. Journal of the Experimental Analysis of Behavior. 2011;95:91–108. doi: 10.1901/jeab.2011.95-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Simon JJ, Skunde M, Hamze Sinno M, Brockmeyer T, Herpertz SC, Bendszus M, Herzog W, Friederich HC. Impaired Cross-Talk between Mesolimbic Food Reward Processing and Metabolic Signaling Predicts Body Mass Index. Front Behav Neurosci. 2014;8:359. doi: 10.3389/fnbeh.2014.00359. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Small DM. Individual differences in the neurophysiology of reward and the obesity epidemic. Int J Obes. 2009;33(Suppl 2):S44–48. doi: 10.1038/ijo.2009.71. ijo200971 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soeter M, Kindt M. Disrupting reconsolidation: pharmacological and behavioral manipulations. Learning & Memory. 2011;18:357–366. doi: 10.1101/lm.2148511. [DOI] [PubMed] [Google Scholar]
- Stice E, Spoor S, Bohon C, Small DM. Relation between obesity and blunted striatal response to food is moderated by TaqIA A1 allele. Science. 2008;322(5900):449–452. doi: 10.1126/science.1161550. 322/5900/449 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stice E, Spoor S, Bohon C, Veldhuizen MG, Small DM. Relation of reward from food intake and anticipated food intake to obesity: a functional magnetic resonance imaging study. J Abnorm Psychol. 2008;117(4):924–935. doi: 10.1037/a0013600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stice E, Yokum S, Blum K, Bohon C. Weight gain is associated with reduced striatal response to palatable food. J Neurosci. 2010;30(39):13105–13109. doi: 10.1523/JNEUROSCI.2105-10.2010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stoeckel LE, Kim J, Weller RE, Cox JE, Cook EW, 3rd, Horwitz B. Effective connectivity of a reward network in obese women. Brain Res Bull. 2009;79(6):388–395. doi: 10.1016/j.brainresbull.2009.05.016. S0361-9230(09)00162-2 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Styn MA, Bovbjerg DH, Lipsky S, Erblich J. Cue-induced cigarette and food craving: a common effect? Addict Behav. 2013;38(3):1840–1843. doi: 10.1016/j.addbeh.2012.09.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sunsay C, Bouton ME. Analysis of a trial-spacing effect with relatively long intertrial intervals. Learn Behav. 2008;36(2):104–115. doi: 10.3758/lb.36.2.104. [DOI] [PubMed] [Google Scholar]
- Sunsay C, Stetson L, Bouton ME. Memory priming and trial spacing effects in Pavlovian learning. Learn Behav. 2004;32(2):220–229. doi: 10.3758/bf03196023. [DOI] [PubMed] [Google Scholar]
- Swinburn BA, Sacks G, Lo SK, Westerterp KR, Rush EC, Rosenbaum M, Luke A, Schoeller DA, DeLany JP, Butte NF, Ravussin E. Estimating the changes in energy flux that characterize the rise in obesity prevalence. Am J Clin Nutr. 2009;89(6):1723–1728. doi: 10.3945/ajcn.2008.27061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Swithers SE, Davidson TL. A role for sweet taste: calorie predictive relations in energy regulation by rats. Behav Neurosci. 2008;122(1):161–173. doi: 10.1037/0735-7044.122.1.161. [DOI] [PubMed] [Google Scholar]
- Swithers SE, Doerflinger A, Davidson TL. Consistent relationships between sensory properties of savory snack foods and calories influence food intake in rats. Int J Obes. 2006;30(11):1685–1692. doi: 10.1038/sj.ijo.0803329. [DOI] [PubMed] [Google Scholar]
- Temple JL, Giacomelli AM, Kent KM, Roemmich JN, Epstein LH. Television watching increases motivated responding for food and energy intake in children. Am J Clin Nutr. 2007;85(2):355–361. doi: 10.1093/ajcn/85.2.355. [DOI] [PubMed] [Google Scholar]
- Temple JL, Giacomelli AM, Roemmich JN, Epstein LH. Dietary variety impairs habituation in children. Health Psychology. 2008;27(1):S10–S19. doi: 10.1037/0278-6133.27.1(Suppi.).S10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thanos PK, Subrize M, Lui W, Puca Z, Ananth M, Michaelides M, Wang GJ, Volkow ND. D-cycloserine facilitates extinction of cocaine self-administration in C57 mice. Synapse. 2011;65:1099–1105. doi: 10.1002/syn.20944. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thomas BL, Ayres JJB. Use of the ABA fear renewal paradigm to assess the effects of extinction with co-present fear inhibitors or excitors: Implications for theories of extinction and for treating human fears and phobias. Learning and Motivation. 2004;35(1):22–52. doi: 10.1016/S0023-9690(03)00040-7. [DOI] [Google Scholar]
- Thrailkill EA, Bouton ME. Contextual control of instrumental actions and habits. Journal of Experimental Psychology: Animal Learning and Cognition. 2015a doi: 10.1037/xan0000045. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thrailkill EC, Bouton ME. Extinction of chained instrumental behaviors: Effects of procurement extinction on consumption responding. 2015b. Submitted for publication. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todd TP, Vurbic D, Bouton ME. Behavioral and neurobiological mechanisms of extinction in Pavlovian and instrumental learning. Neurobiology of Learning and Memory. 2014a;108:52–64. doi: 10.1016/j.nlm.2013.08.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todd TP, Vurbic D, Bouton ME. Mechanisms of renewal after the extinction of discriminated operant behavior. J Exp Psychol Anim Learn Cogn. 2014b;40(3):355–368. doi: 10.1037/xan0000021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Todd TP, Winterbauer NE, Bouton ME. Effects of the amount of acquisition and contextual generalization on the renewal of instrumental behavior after extinction. Learning & Behavior. 2012b;40:145–157. doi: 10.3758/s13420-011-0051-5. [DOI] [PubMed] [Google Scholar]
- Tricomi E, Balleine BW, O’Doherty JP. A specific role for posterior dorsolateral striatum in human habit learning. European Journal of Neuroscience. 2009;29(11):2225–2232. doi: 10.1111/j.1460-9568.2009.06796.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Urcelay GP, Wheeler DS, Miller RR. Spacing extinction trials alleviates renewal and spontaneous recovery. Learn Behav. 2009;37(1):60–73. doi: 10.3758/LB.37.1.60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van den Akker K, Havermans RC, Bouton ME, Jansen A. How partial reinforcement of food cues affects the extinction and reacquisition of appetitive responses. A new model for dieting success? Appetite. 2014;81:242–252. doi: 10.1016/j.appet.2014.06.024. [DOI] [PubMed] [Google Scholar]
- Van Gucht D, Baeyens F, Vansteenwegen D, Hermans D, Beckers T. Counterconditioning reduces cue-induced craving and actual cue-elicited consumption. Emotion. 2010;10(5):688–695. doi: 10.1037/a0019463. [DOI] [PubMed] [Google Scholar]
- Van Gucht D, Vansteenwegen D, Beckers T, Hermans D, Baeyens F, Van den Bergh O. Repeated cue exposure effects on subjective and physiological indices of chocolate craving. Appetite. 2008;50(1):19–24. doi: 10.1016/j.appet.2007.05.003. S0195-6663(07)00300-5 [pii] [DOI] [PubMed] [Google Scholar]
- Van Gucht D, Vansteenwegen D, Beckers T, Van den Bergh O. Return of experimentally induced chocolate craving after extinction in a different context: divergence between craving for and expecting to eat chocolate. Behav Res Ther. 2008;46(3):375–391. doi: 10.1016/j.brat.2008.01.003. S0005-7967(08)00006-5 [pii] [DOI] [PubMed] [Google Scholar]
- Vansteenwegen D, Vervliet B, Iberico C, Baeyens F, Van den Bergh O, Hermans D. The repeated confrontation with videotapes of spiders in multiple contexts attenuates renewal of fear in spider-anxious students. Behav Res Ther. 2007;45(6):1169–1179. doi: 10.1016/j.brat.2006.08.023. [DOI] [PubMed] [Google Scholar]
- Volkow ND, Wise RA. How can drug addiction help us understand obesity? Nat Neurosci. 2005;8(5):555–560. doi: 10.1038/nn1452. nn1452 [pii] [DOI] [PubMed] [Google Scholar]
- Vurbic D, Bouton ME. Secondary extinction in Pavlovian fear conditioning. Learn Behav. 2011;39(3):202–211. doi: 10.3758/s13420-011-0017-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vurbic D, Bouton ME. A contemporary behavioral perspective on extinction. In: McSweeney FK, Murphy ES, editors. The Wiley-Blackwell handbook of operant and classical conditioning. Chichester, UK: John Wiley & Sons, Ltd; 2014. pp. 53–76. [Google Scholar]
- Vurbic D, Gold B, Bouton ME. Effects of d-cycloserine on the extinction of appetitive operant learning. Behavioral Neuroscience. 2011;125:551–559. doi: 10.1037/a0024403. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wagner AR. SOP: A model of automatic memory processing in animal behavior. In: Spear NE, Miller RR, editors. Information processing in animals: Memory mechanisms. Hillsdale, NJ: Erlbaum; 1981. pp. 5–47. [Google Scholar]
- Wagner AR. Context-sensitive elemental theory. Quarterly Journal of Experimental Psychology B: Comparative and Physiological Psychology. 2003;56B:7–29. doi: 10.1080/02724990244000133. [DOI] [PubMed] [Google Scholar]
- Wagner AR, Brandon SE. Evolution of a structured connectionst model of Pavlovian conditioning (AESOP) In: Klein SB, Mowrer RR, editors. Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theory. Hillsdale, NJ: Erlbaum; 1989. pp. 149–189. [Google Scholar]
- Walker DL, Ressler KJ, Lu KT, Davis M. Facilitation of conditioned fear extinction by systemic administration or intra-amygdala infusions of D-cycloserine as assessed with fear-potentiated startle in rats. Journal of Neuroscience. 2002;22:2343–2351. doi: 10.1523/JNEUROSCI.22-06-02343.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wang SH, de Oliveira Alvares L, Nader K. Cellular and systems mechanisms of memory strength as a constraint on auditory fear reconsolidation. Nature Neuroscience. 2009;12:905–913. doi: 10.1038/nn.2350. [DOI] [PubMed] [Google Scholar]
- Wang YC, McPherson K, Marsh T, Gortmaker SL, Brown M. Health and economic burden of the projected obesity trends in the USA and the UK. Lancet. 2011;378(9793):815–825. doi: 10.1016/S0140-6736(11)60814-3. [DOI] [PubMed] [Google Scholar]
- Watson P, Wiers RW, Hommel B, de Wit S. Working for food you don’t desire. Cues interfere with goal-directed food-seeking. Appetite. 2014;79:139–148. doi: 10.1016/j.appet.2014.04.005. [DOI] [PubMed] [Google Scholar]
- Weingarten HP. Conditioned cues elicit feeding in sated rats: a role for learning in meal initiation. Science. 1983;220(4595):431–433. doi: 10.1126/science.6836286. [DOI] [PubMed] [Google Scholar]
- Werthmann J, Roefs A, Nederkoorn C, Mogg K, Bradley BP, Jansen A. Can(not) take my eyes off it: attention bias for food in overweight participants. Health Psychol. 2011;30(5):561–569. doi: 10.1037/a0024291. [DOI] [PubMed] [Google Scholar]
- Weygandt M, Mai K, Dommes E, Leupelt V, Hackmack K, Kahnt T, Rothemund Y, Spranger J, Haynes JD. The role of neural impulse control mechanisms for dietary success in obesity. Neuroimage. 2013;83:669–678. doi: 10.1016/j.neuroimage.2013.07.028. [DOI] [PubMed] [Google Scholar]
- Whitlock EP, O’Connor EA, Williams SB, Beil TL, Lutz KW. Effectiveness of weight management interventions in children: a targeted systematic review for the USPSTF. Pediatrics. 2010;125(2):e396–418. doi: 10.1542/peds.2009-1955. [DOI] [PubMed] [Google Scholar]
- Williams BA. Conditioned reinforcement: Experimental and theoretical issues. Behav Anal. 1994;17 (2):261–285. doi: 10.1007/BF03392675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Winterbauer NE, Bouton ME. Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process. 2010;36(3):343–353. doi: 10.1037/a0017365. 2010-14441-003 [pii] [DOI] [PMC free article] [PubMed] [Google Scholar]
- Woods AM, Bouton ME. D-cycloserine facilitates extinction but does not eliminate renewal of the conditioned emotional response. Behavioral Neuroscience. 2006;120:1159–1162. doi: 10.1037/0735-7044.120.5.1159. [DOI] [PubMed] [Google Scholar]
- Woods AM, Bouton ME. Occasional Reinforced Responses During Extinction Can Slow the Rate of Reacquisition of an Operant Response. Learn Motiv. 2007;38(1):56–74. doi: 10.1016/j.lmot.2006.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Xue Y, Luo Y, Wu P, Shi H, Xue L, Chen C, Zhu W, Ding Z, Bao Y, Shi J, Epstein DH, Shaham Y, Lu L. A memory retrieval-extinction procedure to prevent drug craving and relapse. Science. 2012;336:241–245. doi: 10.1126/science.1215070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yager LM, Robinson TE. A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue. Psychopharmacology. 2013;226(2):217–228. doi: 10.1007/s00213-012-2890-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yokum S, Ng J, Stice E. Attentional bias to food images associated with elevated weight and future weight gain: an fMRI study. Obesity. 2011;19(9):1775–1783. doi: 10.1038/oby.2011.168. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhang Z, Manson KF, Schiller D, Levy I. Impaired associative learning with food rewards in obese women. Curr Biol. 2014;24(15):1731–1736. doi: 10.1016/j.cub.2014.05.075. [DOI] [PubMed] [Google Scholar]