Abstract
Background
Control over the tendency to make or withhold responses guided by contextual Pavlovian information plays a key role in understanding impulsivity and hyperactivity. Here we set out to assess (1) the understudied relation between contextual Pavlovian inhibitory control and hyperactivity/impulsivity in adults with ADHD and (2) whether this inhibition can be enhanced by mindfulness based cognitive therapy (MBCT).
Methods
Within the framework of a randomized controlled trial 50 Adult ADHD patients were assessed before and after 8 weeks of treatment as usual (TAU) with (n = 24) or without (n = 26) MBCT. We employed a well-established behavioral Pavlovian-to-instrumental transfer task that quantifies Pavlovian inhibitory control over instrumental behavior.
Results
Task results revealed (1) less aversive Pavlovian inhibition in ADHD patients with clinically relevant hyperactivity/impulsivity than in those without; and (2) enhanced Pavlovian inhibition across all ADHD patients after TAU+MBCT compared with TAU.
Conclusion
These findings offer new insights in the neurocognitive mechanisms of hyperactivity/impulsivity in ADHD and its treatment: We reveal a role for Pavlovian inhibitory mechanisms in understanding hyperactive/impulsive behaviors in ADHD and point toward MBCT as an intervention that might influence these mechanisms.
Keywords: ADHD, Pavlovian to instrumental transfer, mindfulness based cognitive therapy, inhibition, impulsivity
Introduction
Individuals diagnosed with attention-deficit/hyperactivity disorder (ADHD) have difficulties with controlling their behavior appropriately with respect to environmental demands. Two key cognitive systems that control our behavior with respect to the environment are the Pavlovian and instrumental systems (Dickinson and Balleine, 2002; Dolan and Dayan, 2013). Especially problems in Pavlovian control of goal-oriented instrumental behaviors are associated with a wide variety of psychiatric problems (e.g., Dayan et al., 2006; Heinz et al., 2016; Hallquist et al., 2018). This form of behavioral control might be key to adaptive inhibitory control which has since long been proposed to be central to understanding problems in ADHD (Barkley, 1997). Moreover, aberrant Pavlovian control over instrumental behavior can lead to maladaptive impulsivity in animals as well as in humans (Breland and Breland, 1961; Guitart-Masip et al., 2014; Hinojosa-Aguayo and González, 2020). This form of control has been shown to depend on monoaminergic transmission relevant for understanding ADHD (Dalley and Roiser, 2012; Geurts et al., 2013b; Salamone et al., 2015) and can specifically be modulated by methylphenidate (Swart et al., 2017). Nevertheless, it has received relatively little attention in human and animal ADHD research (Natsheh and Shiflett, 2015). To fill this gap in the literature, we tested whether Pavlovian control of instrumental behavior [i.e., Pavlovian to instrumental transfer (PIT)] is related to clinically relevant impulsivity/hyperactivity in ADHD. Therefore, we first compared Pavlovian control in adult ADHD patients diagnosed with and without clinically relevant impulsivity/hyperactivity. Second, we assessed the hypothesis that a mindfulness-based cognitive therapy (MBCT), i.e., an 8-week training program theoretically related to amending automatic tendencies (Segal et al., 2002) and shown to improve impulsivity/hyperactivity in ADHD (Janssen et al., 2018), should, accordingly, also modulate Pavlovian inhibitory control.
A wide range of animals, including humans, are endowed with mechanisms shaped throughout evolution that drive behavior (Dolan and Dayan, 2013). These drivers take advantage of environmental information carried by stimuli that predict motivationally salient future events or outcomes. The instrumental control system enables us to use specific actions when confronted with a certain stimulus to obtain a specific outcome (i.e., stimulus-action-outcome learning or operant conditioning). This system allows us to optimize our chances to achieve specific goals by learning when to exert specific actions and when not to act. Complementary to this instrumental control system, the Pavlovian control system regulates automatic, motivational responses in reaction to external and internal stimuli (Dolan and Dayan, 2013). This system enables us to associate neutral stimuli with motivationally salient outcomes in the environment (i.e., stimulus-outcome learning or classical conditioning). These neutral stimuli acquire part of the motivational properties of the outcome they are associated with (i.e., predict). When encountering these previously neutral, but now conditioned, stimuli (CS) again, the automatic preparatory reaction to the outcome will be elicited in response to these Pavlovian CSs. Critically, it has long been recognized that these two behavioral control systems do not act in separation, but interact. Pavlovian CS can (de) motivate ongoing instrumental behavior based on the valence (appetitive or aversive) of the Pavlovian CS (Rescorla and Solomon, 1967): Pavlovian CS that predict punishment (i.e., aversive Pavlovian CS) have the tendency to inhibit, whereas Pavlovian CS that predict reward (i.e., appetitive Palvovian CS) can activate instrumental behavior (Rescorla and Solomon, 1967; Huys et al., 2011; Geurts et al., 2013a). These interactions between instrumental and Pavlovian control of behavior are thought to be shaped by evolution and have adaptive properties in terms timing actions (i.e., when to make, and when not to make an action) to optimize gaining rewards and avoiding punishment at relatively low computational cost (Dolan and Dayan, 2013). However, too much or too little influence of the Pavlovian system on instrumental behavior has been proposed as a driver of several maladaptive behaviors (e.g., Dayan et al., 2006; Heinz et al., 2016; Hallquist et al., 2018). Too much potentiation of instrumental behavior by appetitive cues, or too little inhibition by aversive cues is linked to impulsive behavior in real life (Watson et al., 2014; Garbusow et al., 2016; Heinz et al., 2016; Hallquist et al., 2018). This latter source of disinhibition, i.e., disinhibition in the face of aversive affect, has been widely recognized to play a role in externalizing psychopathology, mainly under the umbrella of negative urgency (Whiteside and Lynam, 2001). Negative urgency has recently indeed been related to Pavlovian control of instrumental behavior in healthy controls (Hinojosa-Aguayo and González, 2020). However, whether the impact of appetitive activating and aversive inhibitory processes on instrumental behavior contributes to impulsivity/hyperactivity in ADHD remains an open question. We will test this specific hypothesis in ADHD patients diagnosed with and without clinically relevant impulsivity/hyperactivity symptomatology. Specifically, we compare patients diagnosed with the DSM-IV combined or hyperactive/impulsive subtype (both including relevant impulsive-hyperactive symptomatology) with those with the primarily inattentive subtype (without diagnosed impulsivity/hyperactivity).
The hypothesis that both increased appetitive PIT and decreased aversive PIT might drive impulsivity in ADHD can only be tested causally through an intervention study. A key prediction is that effective treatment of ADHD should modulate the effect of Pavlovian cues on instrumental behavior. One candidate for this is MBCT. MBCT has significant beneficial effects in ADHD (Cairncross and Miller, 2016; Gu et al., 2017; Hepark et al., 2017; Janssen et al., 2018), as well as impulsivity symptoms trans-diagnostically (Franco et al., 2016). It is a highly protocolled intervention that changes how patients deal with thoughts, emotions, bodily feelings and urges in reaction to both external and internal stimuli. Patients become more aware of internal and external triggers and consequent automatic patterns such as avoidance of aversive stimuli or attachment to appetitive stimuli, and learn to (initially) disengage from automatic reactivity (Segal et al., 2002, p. 217). Indeed, MBCT has been shown to reduce impulsivity/hyperactivity (Gu et al., 2017; Hepark et al., 2017; Janssen et al., 2018), improve self-reported adaptive inhibition (Hepark et al., 2017; Janssen et al., 2018) and increases experimentally measured behavioral inhibition (see for meta-analyses and critical notes; Lao et al., 2016; Vago et al., 2019). Moreover, previous findings from our group suggest that effects of MBCT on self-reported adaptive inhibition mediated the effects of MBCT on clinician rated ADHD symptoms (Geurts et al., 2020). Taken together, to test the hypothesis that aberrant PIT may drive impulsive responding in ADHD, we will assess whether MBCT changes the inhibitory or activating effects of Pavlovian cues. In line with the hypothesized relation between impulsivity and Pavlovian control, we expect MBCT to diminish the motivating effect of appetitive Pavlovian CS and to enhance the inhibiting effect of aversive Pavlovian CS on instrumental behavior, leading to more inhibition and less impulsivity/hyperactivity, respectively.
Materials and methods
Trial design and procedure
This behavioral intervention study was embedded in a multi-center randomized controlled trial (RCT) investigating the impact of MBCT in addition to TAU on adults with ADHD (NCT02463396) (Janssen et al., 2015, 2018). For this trial, a total of 120 adults with ADHD according to the criteria of Diagnostic and Statistical Manual of Mental Disorders—4th edition (DSM-IV-TR) (American Psychiatric Association, 2000) were randomized to either MBCT in addition to treatment as usual (MBCT + TAU) or TAU only. The eligibility criteria, study procedure and CONSORT diagram are described fully in the protocol paper (Janssen et al., 2015) and the main treatment outcome paper (Janssen et al., 2018) of the overarching RCT. Clinical outcome measures were assessed before (T0) and directly after (T1) and 3 months (T2) after MBCT or TAU. Behavioral data on the PIT task were collected before (T0) and after MBCT or TAU (T1). On each of these two test-days, patients were seated in front of a laptop and conducted the PIT computer task.
Patients
For the current study, behavioral data on the PIT task were collected from a subset of patients assessed at one site (RadboudUMC): 68 patients were asked to participate. One patient declined, which resulted in 67 patients participating in the pre-intervention test session. On the post-intervention test session 60 (90%) patients participated and 7 declined to participate. Unfortunately, there was a loss of 10 data sets on pre-intervention due to a technical (back-up) error, leaving 50 full data sets (MBCT+TAU: n = 24; TAU only n = 26) to be analyzed (for demographics see Table 1; see Supplementary Data for flow-chart of inclusions).
TABLE 1.
MBCT+TAU (n = 24) | TAU (n = 26) | P (Phi/T statistics) | |||
Demographic characteristics | |||||
Female gender | 13 | 54.2% | 16 | 61.5% | 0.28 (Phi = –0.075) |
Age; M (SD) | 42.6 | 12.4 | 39.0 | 10.5 | 0.26 (T48 = –1.1) |
Clinical characteristics | |||||
Subtype of ADHD, DSM-IV | |||||
Inattentive type | 13 | 54.2% | 16 | 61.5% | 0.87 (Phi = –0.28) |
Hyperactive/impulsive type | 0 | 0% | 0 | 0% | |
Combined type | 10 | 41.7% | 9 | 34.6% | |
Not otherwise specified type | 1 | 4.2% | 1 | 3.8% | |
ADHD symptoms (CAARS-INV) | |||||
Subscales: | |||||
Inattention | 16.9 | 5.2 | 18.6 | 3.8 | 0.20 (T48 = 1.3) |
Hyperactive/impulsive | 11.7 | 6.5 | 14.2 | 5.9 | 0.15 (T48 = 1.5) |
Total | 28.6 | 9.4 | 32.8 | 8.4 | 0.10 (T48 = 1.7) |
Use of ADHD medication | 17 | 70.8% | 14 | 53.8% | 0.22 (Phi = 1.53) |
Intervention
Mindfulness-based cognitive therapy
MBCT (Segal et al., 2002) is an 8-week group-based intervention of 2.5 h each, plus a 6-h silent day between session 6 and 7. In short, the program included mindfulness practice (bodyscan, gentle yoga, sitting and walking meditation) combined with daily life practices, psycho-education, Cognitive Behavioral Therapy (CBT) techniques, group discussions, and inquiry into present moment experiences. By this procedure patients are taught to become more aware of dysfunctional automatic patterns, such as avoidance of aversive stimuli or grasping of appetitive stimuli and to consciously disengage from these patterns (Segal et al., 2002, for further detail see the protocol paper; Janssen et al., 2015).
Treatment as usual
TAU reflected the usual treatments of ADHD patients in various mental health centers across the Netherlands, consisting of pharmacotherapy and psychosocial treatment, such as psycho-education and cognitive behavioral therapy.
Assessments
Clinical assessments
Clinical assessments are presented in Table 1. The primary outcome measure was total ADHD symptoms according to the 30-item Conners’ Adult ADHD Rating Scale (Conners et al., 1999), scored by a blinded clinician (CAARS-INV). In line with the findings of the overarching RCT (Janssen et al., 2018, n = 120), MBCT significantly reduced ADHD symptoms in our subsample of the total patient group with a moderate effect size (Treatment (MBCT/TAU) × Day (pre/post) interaction on CAARS-IVNV ADHD score: F(1, 48) = 5.2, p = 0.028; independent sample t-test pre MBCT: t(48) = 1.7, p = 0.098; post MBCT: t(48) = 2.8, p = 0.007; paired sample t-test (pre vs. post): MBCT+TAU: t(23) = 4.4, p < 0.001; TAU: t(25) = 3.7, p = 0.007).
Overall functioning was measured using the 45-item Outcome Questionnaire 45 (OQ-45), which offers a comprehensive review of overall life functioning (Lambert et al., 1996). Items are scored on a five-point rating scale, ranging from never (0) to almost always (4), with a maximum score of 180 points (a higher score means worse overall functioning) (DE Jong et al., 2007).
Pavlovian to instrumental transfer task
We used a PIT task that allowed us to assess the influence of appetitive and aversive Pavlovian CS on instrumental approach actions. This task was identical to the approach blocks used in Huys et al. (2011, 2016) and Geurts et al. (2013b). In short, the task consisted of an instrumental conditioning, a Pavlovian conditioning and a PIT stage (Figure 1).
Instrumental conditioning
The instrumental task (Figure 1A) was a go/NoGo task, framed in terms of collecting “good” and “bad” mushrooms. Patients chose whether to collect the mushroom by moving the mouse toward and clicking on the mushroom (go) within a response-window of 1.5 s, or not collect the mushroom by abstaining from a response for 1.5 s (NoGo). The outcome (±5 cents) was then presented in the middle of the screen. Reinforcements were probabilistic, with the “correct” response for each mushroom leading to reward on 75% of the trials and to punishment otherwise. For the “incorrect” response these probabilities were reversed. Correct trials were those on which they collected a “good” mushroom or refrained from collecting a “bad” mushroom. Patients thus had to learn the better response for each stimulus from the probabilistic, noisy reinforcement feedback. There were 3 “good” (go) and 3 “bad” (NoGo) mushrooms, meaning that the possible actions (i.e., collect or not collect) could be followed by both rewards and punishments.
Analyses and results on the instrumental conditioning stage are reported in Supplementary Material.
Pavlovian conditioning
The second part of the task consisted of a separate Pavlovian conditioning procedure. Five compound Pavlovian CS, consisting of a fractal visual stimulus (Figure 1B) and a tone, were deterministically paired with outcomes. The appetitive (SP++, SP+) and aversive (SP–, SP––) Pavlovian CSs predicted a gain/loss of 100 or 10 cents, respectively, while the neutral CS (SP0) was followed by an outcome of 0 cent. To ensure that patients paid attention, a query trial was presented on every fifth trial. Patients then had to choose between two different Pavlovian CS (Figure 1C) without any reinforcement. In addition, we asked patients to rate how much they liked the presented CS before and after the experiment on a visual analog scale (VAS).
Analyses and results on the Pavlovian conditioning stage are reported in Supplementary Material.
Pavlovian-instrumental transfer phase
This was the main phase of interest. Patients needed to choose whether to collect (go) or not collect (NoGo) the same mushrooms as in the instrumental training phase, while the Pavlovian CS now tiled the entire background (Figure 1D). No outcomes were presented during this phase to exclude further instrumental conditioning. Patients were instructed to continue performing the instrumental task; that choices were still earning them the same outcomes and were being counted; but that they would not be told about the outcomes during this phase. Thus, in this phase, we could assess the impact of the Pavlovian CS on the previously learned instrumental go/NoGo choices.
Data analysis
The primary effect of interest was the activating and inhibiting impact of the appetitive and aversive Pavlovian CSs on instrumental go/NoGo choices, respectively.
First, we assessed the relation between clinical impulsivity-hyperactivity and PIT: In the introduction we introduced two possible links between hyperactivity-impulsivity on the one hand and appetitive and aversive PIT on the other: Impulsivity-hyperactivity could theoretically be instantiated differentially by (i) exaggerated appetitive PIT, i.e., too much instrumental potentiation in the face of an appetitive Pavlovian CS and (ii) diminished aversive PIT, i.e., too little inhibition in the face of an aversive Pavlovian CS (Watson et al., 2014; Garbusow et al., 2016; Huys et al., 2016; Hallquist et al., 2018). We assessed these differential associations at baseline by assessing differences in PIT between the combined subtype (including hyperactivity-impulsivity) and the inattentive subtype (not including hyperactivity/impulsivity) of ADHD. Thus, we employed two generalized linear mixed effects models (GLMM) with, respectively, Pavlovian CS Appetitive (SP++ /SPn) and Aversive (SPn/SP–– as within subject factor and ADHD subtype (combined/inattentive) as between-subject factor.
Second, to test whether MBCT modulated appetitive and aversive PIT we used a GLMM including the within-subject factors Pavlovian CS Valence (5 levels: SP++/Sp+/SPn/SP–/SP––) and Day (Pre vs. Post treatment), and the between-subject factors Treatment Group (TAU+MBCT vs. TAU).
We used GLMMs to account for both between- and within-subject variability. We used the lme4 package in R (Bates et al., 2015; R Development Core Team, 2015). All GLMMs included all main effects and interactions as well as a full random effects structure to reduce inflation of Type I error (Barr et al., 2013).
Furthermore, to interpret the results of the above analyses as true changes in the interaction between Pavlovian and instrumental control, i.e., PIT, there should be no differences between the Treatment groups in task performance during the instrumental and Pavlovian training per se on Day 1 or a difference in change between the Groups from pre- to post treatment in these parts of the training. We assessed whether this was the case by using, where appropriate, t-tests and repeated measure ANOVA’s with, respectively, average performance at the end of the instrumental training stage (mean correct after more than 5 stimulus presentations), average performance at the end of Pavlovian training (mean correct after more than 5 query trials) and VAS ratings from pre-to post Pavlovian conditioning as dependent variables.
We note, that we did not pursue analysis of reaction time, because previous reports (Huys et al., 2011; Geurts et al., 2013b) with this paradigm did not find any meaningful effects on this outcome measure.
Results
General Pavlovian to instrumental transfer effects
Across Treatment Group and Day we replicated the expected PIT effect: appetitive Pavlovian CS activated (i.e., appetitive PIT), whereas aversive Pavlovian CS inhibited (i.e., aversive PIT) instrumental approach actions [main effect of Pavlovian CS Valence: X2 = 17.4, p = 0.002; simple contrast appetitive PIT (SPn/ SP++): X2 = 4.9, p = 0.026); simple contrast aversive PIT (SPn/SP–): FRS:X2 = 7.4, p = 0.006].
Aversive Pavlovian inhibition is related to clinical impulsivity-hyperactivity
Specific analyses, targeted at clinically diagnosed impulsivity/hyperactivity and its relation to aversive and appetitive PIT, respectively (see section “Introduction” and “Materials and methods”), revealed that aversive PIT was absent for those patients diagnosed with ADHD including impulsivity/hyperactivity (i.e., the combined subtype) compared with patients with ADHD with primarily inattentive symptoms [Figure 2, Subtype (combined/inattentive) × Pavlovian CS Valence (SPn/ SP––):X2 = 4.6, p < 0.031, Table 2]. More specifically, behavioral inhibition by aversive Pavlovian CS was not significant in patients diagnosed with the combined subtype (X2 = 1.5, p = 0.22) and significant for the inattentive subtype (X2 = 12.77, p < 0.001). No such effects were found for appetitive PIT [Subtype (combined/inattentive) × Pavlovian CS Valence (SPn/ SP++): FRS:X2 = 0.1, p = 0.73].
TABLE 2.
Combined subtype including hyperactivity/impulsivity | Inattentive subtype | p | |||
Demographic characteristics | |||||
Female gender | 19/29 | 65.5% | 9/19 | 47.4% | 0.21 |
Age; M(SD) | 38.1 | (9.9) | 44.4 | (12.7) | 0.060 |
Clinical characteristics | |||||
ADHD symptoms (CAARS-INV) | |||||
Total score | 33.6 | (8.3) | 26.9 | (9.3) | 0.012 |
Inattention subscale | 18.2 | (5.0) | 17.4 | (4.2) | 0.6 |
Hyperactive/impulsive subscale | 15.4 | (4.8) | 9.5 | (6.6) | <0.001 |
Outcome questionnaire | 55.7 | (15.6) | 63.7 | (18.9) | 0.12 |
Use of ADHD medication | 17/29 | (58.6%) | 12/19 | (63.2%) | 0.8 |
Mindfulness based cognitive therapy increased aversive Pavlovian inhibition over instrumental behavior
Notably, we found that MBCT modulated PIT as is revealed by a Treatment Group × Day × Pavlovian CS Valence interaction (X2 = 12.9, p = 0.011, Figure 3). Simple contrast analyses showed that this interaction was driven by changes in aversive PIT [Treatment Group × Day × Pavlovian CS Valence (SPn/ SP––): X2 = 7.4, p = 0.006] and not appetitive PIT [Treatment Group × Day × Pavlovian CS Valence (SPn/ SP++): X2< 0.1, p = 0.86]. Indeed, as revealed by the pattern in Figure 3, aversive PIT was enhanced post MBCT [Day (pre vs. post) × Pavlovian CS Valence (SPn/ SP––): X2 = 5.6, p = 0.018], but not post -TAU [Day (pre vs. post) × Pavlovian CS Valence (SPn/ SP––): X2 = 3.3, p = 0.069]. Moreover, there was no difference in PIT at baseline between the groups (Pre: Treatment Group × Pavlovian CS Valence: X2 = 5.3, p = 0.26), but there was a difference after MBCT/TAU (Post: Treatment Group × Pavlovian CS Valence: X2 = 11.0, p = 0.027), which was driven by enhanced aversive PIT for the MBCT compared to the TAU group [Post: Treatment Group × Pavlovian CS Valence (SPn/ SP––): X2 = 5.1, p = 0.023].
Thus, MBCT increased the inhibitory effects of aversive Pavlovian CS on instrumental behavior and left unchanged the activating effect of appetitive Pavlovian CS.
Instrumental and Pavlovian training
To interpret the above findings as true changes in the interaction between Pavlovian and instrumental control, i.e., PIT, there should be no (explanatory) differences between the Treatment groups at Day1 or a difference in change from pre- to post treatment between the groups in task performance at the end of instrumental and Pavlovian training. Indeed, we did not find evidence for such differences. Instrumental conditioning was successful as revealed by an above chance performance across the group at the end of the instrumental training on both days (one-sample t-test on mean correct choices after > 5 presentations vs. chance level (0.5 correct): Day1: t(49) = 4.2, p < 0.001: 0.59, 95% CI 0.54–0.63; Day2: t(49) = 4.6, p < 0.001; mean correct choices after > 5 presentations: 0.61, 95% CI 0.57–0.67). Moreover, performance did not differ between Treatment at Day 1 (two sample t-test on mean correct choices after > 5 presentations): t(48) = 0.8, p = 0.86, 95% CI of difference: –0.08 to 0.09) nor was performance dependent on an interaction between Day and Treatment (X2< 0.1, p = 0.99). This was also the case for Pavlovian conditioning: Conditioning in terms of explicit associations between CS and outcomes resulted in above chance performance across Treatment group on both days (Day 1: one-sample t-test: mean = 0.88, 95% CI: 0.83–0.93, t(49) = 14.7, p < 0.001: mean = 0.91, 95% CI: 0.87–0.96; Day2, t(49) = 19.5, p < 0.001) and no group differences arose (Day 1: two sample t-test: t(48) = –0.25, p = 0.80, 95% CI of difference: –0.12 to 0.09; interaction between Day and Treatment: X2 = 0.4, p = 0.53). Moreover, VAS liking ratings from before to after conditioning showed the expected pattern (appetitive stimuli were judged appetitive and aversive stimuli as aversive after training: Time (2 levels: pre/post conditioning) × Pavlovian CS Valence (5 levels: SP++/Sp+/SPn/SP–/SP––) at Day 1: X2 = 29.4, p < 0.001) with again no difference in conditioning effects between the Treatment groups on Day1 [Group × Pavlovian CS Valence × Time (pre/post conditioning): X2 = 2.8, p = 0.093] or as a function of change from pre- to post treatment [Group × Day × Pavlovian CS Valence × Time (pre/post conditioning): X2< 0.1, p = 0.85].
Discussion
Theory and data suggest that hyper(re)activity and impulsivity might be related to exaggerated appetitive Pavlovian activation and diminished aversive Pavlovian inhibition (Watson et al., 2014; Garbusow et al., 2016; Heinz et al., 2016; Hallquist et al., 2018). This prediction, however, remained untested for ADHD. We present two key findings. First, an ADHD diagnosis with clinically relevant impulsivity/hyperactivity was accompanied by an absence of aversive Pavlovian inhibition, while an ADHD diagnosis without clinically relevant impulsivity/hyperactivity was accompanied by the expected aversive Pavlovian inhibition, akin to multiple healthy control studies (e.g., Huys et al., 2011; Geurts et al., 2013a). In contrast to our expectations, we did not find a relation between appetitive Pavlovian activation and impulsivity/hyperactivity. Second, within a randomized controlled setting, MBCT enhanced this aversive Pavlovian inhibition across the whole group of patients.
Both our findings, the relation between impulsivity/hyperactivity and aversive Pavlovian inhibition and the strengthening of this inhibition through MBCT in ADHD, are particularly interesting when considering the wide ranging, adaptive effects of Pavlovian inhibitory processes in more detail. Pavlovian conditioned reactions have long been recognized to help the organism prepare (in a fast and computationally efficient manner) for the predicted outcome (Dickinson and Balleine, 2002). In case of appetitive outcomes these “preparations” increase the chances to benefit from this outcome. In the case of aversive outcomes, the Pavlovian behavioral reactions (e.g., inhibition) might prevent damage to the organism. Allowing predictors of aversive outcome (i.e., aversive Pavlovian CS) to influence behavior thus might instigate adaptive behavior. Moreover, aberrant Pavlovian mechanisms, e.g., too much appetitive attraction and/or too little aversive inhibition, are thought to play a role in psychiatric disorders such as major depressive disorder, different anxiety disorders, addiction (Huys et al., 2015; Heinz et al., 2016; Mkrtchian et al., 2017) and personality disorders associated with impulsive behaviors (Ly et al., 2016; Hallquist et al., 2018). It has been proposed that not only actions are under the influence of Pavlovian inhibitory mechanisms, but also our thoughts (Huys et al., 2012; Mendelsohn et al., 2014). Indeed, Huys et al. (2012); and Lally et al. (2017) recently provided empirical evidence that Pavlovian inhibitory processes have a central place in planning action sequences. This warrants future studies on the Pavlovian inhibitory mechanisms in especially impulsivity/hyperactivity in ADHD and with respect to MBCT that might advance our understanding of the neurocognitive mechanisms of both ADHD and the workings of MBCT, respectively.
One question that follows from the current study is why ADHD patients with clinically diagnosed impulsivity/hyperactivity lack the aversive Pavlovian inhibition we normally observe in healthy populations (Huys et al., 2011; Geurts et al., 2013a) and in ADHD patients without overt impulsivity/hyperactivity (this study). First, we note that instrumental and Pavlovian stimulus-outcome contingencies were learned by these patients as well as by the non-impulsive/hyperactive patients: Performance on query trials during conditioning nor (changes in) VAS-ratings of the Pavlovian stimuli across Pavlovian conditioning nor instrumental performance differed between these patient groups. Thus, the difference in aversive PIT cannot be readily explained by differences in learning. Moreover, it is not likely that within the PIT stage, these aversive Pavlovian CS were simply not noticed, because Pavlovian CS with appetitive valence exerted their normal (invigorating) effect (Huys et al., 2011). Thus, the absence of the inhibitory effect has to be searched downstream, in the interaction effect of Pavlovian and instrumental information itself. On a cognitive-psychological level this interaction effect might only surface when the aversive predictions are processed and used as guidance for steering instrumental behavior. Disturbances might thus come about through not processing the aversive information as relevant for behavioral procedures. The finding that patients showed increased effects of aversive Pavlovian stimuli post MBCT might be informative from this perspective. First, we note that the finding that MBCT increases the effect of aversive Pavlovian CS is in general accordance with a recent report on aversive Pavlovian conditioning (i.e., fear conditioning) before and after Mindfulness Based Stress Reduction (MBSR)(Hölzel et al., 2016). This study showed that through MBSR, healthy controls remained sensitive, as revealed by psychophysiological responses to the aversive Pavlovian CS (predictive of electrical shocks), whereas participants in the waitlist group lost this sensitivity. Our finding extends this result by showing that MBCT might potentiate the inhibitory effect of an aversive Pavlovian CS in adult ADHD patients. We speculate that this might be due to more openness to guiding information of contexts predicting adversity, instead of avoiding aversive information, in combination with an enhanced tendency to not immediately react, facilitated by the training. Moreover, on a neurophysiological level it has been shown that aversive Pavlovian inhibition depends on serotonergic signaling (Crockett et al., 2009; Geurts et al., 2013b; den Ouden et al., 2015) and is also influenced by methylphenidate suggesting catecholaminergic involvement (Swart et al., 2017). On a speculative account, we hypothesize that aberrant monoaminergic signaling related to Pavlovian control might be at the roots of this disinhibition, paralleling the psychological process by which aversive information guides instrumental behavior. Moreover, our data suggest that this process can be changed by MBCT.
Several limitations of this study should be noted: First we note that our relatively small sample size precluded us from assessing differential aspects of MBCT on the patients with the combined vs. the inattentive subtype of ADHD. This could have strengthened (or disproved) the suggestion that MBCT specifically remedies maladaptive aversive disinhibition. Moreover, including another active control treatment could have substantiated suggestions about the specificity of our result with regards to MBCT. With regard to the PIT paradigm, we think this might be improved by using a more naturalistic cover story (subjects informally reported that the game was boring) and more salient reinforcers (e.g., food, taste, shock, noise), which might make the task more ecologically valid and putatively more sensitive to change. Adding eye-tracking to this paradigm might also help to establish attentional components of the uncovered effect (e.g., more dwelling at the Pavlovian CS then at the instrumental stimulus) which might help to better understand the interindividual differences found here. Finally, because this paradigm has been shown to be sensitive to catecholaminergic modulation by methylphenidate and the current study suggests that it is also sensitive to change due to MBCT, it is interesting for future studies to assess whether this paradigm could have differential predictive properties in terms of treatment response for both pharmacological as well as psychotherapeutic interventions in ADHD.
In sum, our data suggests that the combined, but not the inattentive subtype of ADHD is associated with diminished aversive Pavlovian inhibition and that MBCT can enhance this inhibition. These findings offer new insights in the neurocognitive mechanisms of hyperactivity/impulsivity in the combined subtype of ADHD and point toward MBCT as an intervention that might influence these mechanisms.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the METC Oost-Nederland. The patients/participants provided their written informed consent to participate in this study.
Author contributions
DG, HO, RC, and AS contributed to conception and design of the study. DG, LJ, JS, and RC collected the data. DG performed the statistical analysis and wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
Acknowledgments
We thank Prof. Jan Buitelaar, MD, for very helpful comments on this manuscript.
Funding
DG and LJ were funded by the Netherlands Organization for Health Research and Development (AGIKO grant 92003576; ZonMW Doelmatigheid 80-83700-98-51002). RC, JS, and HO were funded by the Netherlands Organization for Scientific Research (VICI grant NWO- 453-14-005 to RC; VIDI grant NWO- 452-08-009 to HO; Research Talent grant NWO- 406-14-028 to JS).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnbeh.2022.938082/full#supplementary-material
References
- American Psychiatric Association (2000). Diagnostic and Statistical Manual of Mental Disorders. Fourth Edition, Text Revision. Washington, DC: American Psychiatric Association. [Google Scholar]
- Barkley R. A. (1997). Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychol. Bull. 121 65–94. 10.1037/0033-2909.121.1.65 [DOI] [PubMed] [Google Scholar]
- Barr D. J., Levy R., Scheepers C., Tily H. J. (2013). Random effects structure for confirmatory hypothesis testing: keep it maximal. J. Mem. Lang. 68 255–278. 10.1016/j.jml.2012.11.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bates D., Mächler M., Bolker B., Walker S. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67 1–48. 10.18637/jss.v067.i01 [DOI] [Google Scholar]
- Breland K., Breland M. (1961). The misbehavior of organisms. Am. Psychol. 16 681–684. 10.1037/h0040090 [DOI] [Google Scholar]
- Cairncross M., Miller C. J. (2016). The Effectiveness of Mindfulness-Based Therapies for ADHD: a Meta-Analytic Review. J. Atten. Disord. 24 627–643. 10.1177/1087054715625301 [DOI] [PubMed] [Google Scholar]
- Conners C. K., Erhardt D., Sparrrow E. P. (1999). Conners’ Adult ADHD Rating Scales: Technical Manual. New York: Multi Health Systems Inc. [Google Scholar]
- Crockett M. J., Clark L., Robbins T. W. (2009). Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J. Neurosci. 29 11993–11999. 10.1523/JNEUROSCI.2513-09.2009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dalley J. W., Roiser J. P. (2012). Dopamine, serotonin and impulsivity. Neuroscience 215 42–58. 10.1016/j.neuroscience.2012.03.065 [DOI] [PubMed] [Google Scholar]
- Dayan P., Niv Y., Seymour B., Daw N. D. (2006). The misbehavior of value and the discipline of the will. Neural Netw. 19 1153–1160. 10.1016/j.neunet.2006.03.002 [DOI] [PubMed] [Google Scholar]
- den Ouden H. E. M., Swart J. C., Schmidt K., Fekkes D., Geurts D. E. M., Cools R. (2015). Acute serotonin depletion releases motivated inhibition of response vigour. Psychopharmacologia 232 1303–1312. 10.1007/s00213-014-3762-4 [DOI] [PubMed] [Google Scholar]
- DE Jong K., Nugter M. A., Polak M. G., Wagenborg J. E. A., Spinhoven P., Heiser W. J. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: a cross-cultural validation. Clin. Psychol. Psychother. 14 288–301. 10.1002/cpp.529 [DOI] [Google Scholar]
- Dickinson A., Balleine B. (2002). “The role of learning in the operation of motivational systems,” in Steven’s Handbook of Experimental Psychology: Learning, Motivation and Emotion, ed. Gallistel C. R. (New York: John Wiley & Sons; ), 497–534. [Google Scholar]
- Dolan R. J., Dayan P. (2013). Goals and Habits in the Brain. Neuron 80 312–325. 10.1016/j.neuron.2013.09.007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Franco C., Amutio A., López-González L., Oriol X., Martínez-Taboada C. (2016). Effect of a Mindfulness Training Program on the Impulsivity and Aggression Levels of Adolescents with Behavioral Problems in the Classroom. Front. Psychol. 7:1385. 10.3389/fpsyg.2016.01385 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garbusow M., Schad D. J., Sebold M., Friedel E., Bernhardt N., Koch S. P., et al. (2016). Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence. Addict. Biol. 21 719–731. 10.1111/adb.12243 [DOI] [PubMed] [Google Scholar]
- Geurts D. E. M., Huys Q. J. M., den Ouden H. E. M., Cools R. (2013a). Aversive Pavlovian Control of Instrumental Behavior in Humans. J. Cogn. Neurosci. 25 1428–1441. 10.1162/jocn_a_00425 [DOI] [PubMed] [Google Scholar]
- Geurts D. E. M., Huys Q. J. M., den Ouden H. E. M., Cools R. (2013b). Serotonin and Aversive Pavlovian Control of Instrumental Behavior in Humans. J. Neurosci. 33 18932–18939. 10.1523/JNEUROSCI.2749-13.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Geurts D. E. M., Schellekens M. P. J., Janssen L., Speckens A. E. M. (2020). Mechanisms of Change in Mindfulness-Based Cognitive Therapy in Adults With ADHD. J. Atten. Disord. 25 1331–1342. 10.1177/1087054719896865 [DOI] [PubMed] [Google Scholar]
- Gu Y., Xu G., Zhu Y. (2017). A Randomized Controlled Trial of Mindfulness-Based Cognitive Therapy for College Students With ADHD. J. Atten. Disord. 22 388–399. 10.1177/1087054716686183 [DOI] [PubMed] [Google Scholar]
- Guitart-Masip M., Duzel E., Dolan R., Dayan P. (2014). Action versus valence in decision making. Trends Cogn. Sci. 18 194–202. 10.1016/j.tics.2014.01.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hallquist M. N., Hall N. T., Schreiber A. M., Dombrovski A. Y. (2018). Interpersonal dysfunction in borderline personality: a decision neuroscience perspective. Curr. Opin. Psychol. 21 94–104. 10.1016/j.copsyc.2017.09.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hallquist M. N., Hall N. T., Schreiber A. M., Dombrovski A. Y. (2018). Interpersonal dysfunction in borderline personality: a decision neuroscience perspective. Curr. Opin. Psychol. 21 94–104. 10.1016/j.copsyc.2017.09.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heinz A., Schlagenhauf F., Beck A., Wackerhagen C. (2016). Dimensional psychiatry: mental disorders as dysfunctions of basic learning mechanisms. J. Neural Trans. 123 809–821. 10.1007/s00702-016-1561-2 [DOI] [PubMed] [Google Scholar]
- Hepark S., Janssen L., de Vries A., Schoenberg P. L. A., Donders R., Kan C. C., et al. (2017). The Efficacy of Adapted MBCT on Core Symptoms and Executive Functioning in Adults With ADHD: a Preliminary Randomized Controlled Trial. J. Atten. Disord. 23 351–362. 10.1007/978-0-387-09593-6_18 [DOI] [PubMed] [Google Scholar]
- Hölzel B. K., Brunsch V., Gard T., Greve D. N., Koch K., Sorg C., et al. (2016). Mindfulness-based stress reduction, fear conditioning, and the uncinate fasciculus: a pilot study. Front. Behav. Neurosci. 10:e0123512. 10.1111/j.1755-5949.2011.00238.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hinojosa-Aguayo I., González F. (2020). Affect-driven impulsivity impairs human action control and selection, as measured through Pavlovian instrumental transfer and outcome devaluation. Q. J. Exp. Psychol. 73 537–554. 10.1177/1747021819883963 [DOI] [PubMed] [Google Scholar]
- Huys Q. J. M., Cools R., Gölzer M., Friedel E., Heinz A., Dolan R. J., et al. (2011). Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding. PLoS Comput. Biol. 7:e1002028. 10.1371/journal.pcbi.1002028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huys Q. J. M., Eshel N., O’Nions E., Sheridan L., Dayan P., Roiser J. P. (2012). Bonsai trees in your head: how the Pavlovian system sculpts goal-directed choices by pruning decision trees. PLoS Comput. Biol. 8:e1002410. 10.1371/journal.pcbi.1002410.g007 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Huys Q. J. M., Daw N. D., Dayan P. (2015). Depression: a Decision-Theoretic Analysis. Annu. Rev. Neurosci. 38 1–23. 10.1146/annurev-neuro-071714-033928 [DOI] [PubMed] [Google Scholar]
- Huys Q. J. M., Gölzer M., Friedel E., Heinz A., Cools R., Dayan P., et al. (2016). The specificity of Pavlovian regulation is associated with recovery from depression. Psychol. Med. 46 1027–1035. 10.1017/S0033291715002597 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Janssen L., Kan C. C., Carpentier P. J., Sizoo B., Hepark S., Grutters J., et al. (2015). Mindfulness based cognitive therapy versus treatment as usual in adults with attention deficit hyperactivity disorder (ADHD). BMC Psychiatry 15:216. 10.1186/s12888-015-0591-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Janssen L., Kan C. C., Carpentier P. J., Sizoo B., Hepark S., Schellekens M. P. J., et al. (2018). Mindfulness-based cognitive therapy v. treatment as usual in adults with ADHD: a multicentre, single-blind, randomised controlled trial. Psychol. Med. 49 55–65. [DOI] [PubMed] [Google Scholar]
- Lambert M. J., Burlingame G. M., Umphress V., Hansen N. B., Vermeersch D. A., Clouse G. C., et al. (1996). The reliability and validity of the outcome questionnaire. Clin. Psychol. Psychother. 3 249–258. [DOI] [Google Scholar]
- Lao S.-A., Kissane D., Meadows G. (2016). Cognitive effects of MBSR/MBCT: a systematic review of neuropsychological outcomes. Conscious. Cogn. 45 109–123. 10.1016/j.concog.2016.08.017 [DOI] [PubMed] [Google Scholar]
- Lally N., Huys Q. J. M., Eshel N., Faulkner P., Dayan P., Roiser J. P. (2017). The neural basis of aversive Pavlovian guidance during planning. J. Neurosci. 37 10215–10229. 10.1523/JNEUROSCI.0085-17.2017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ly V., von Borries A. K. L., Brazil I. A., Bulten B. H., Cools R., Roelofs K. (2016). Reduced transfer of affective value to instrumental behavior in violent offenders. J. Abnorm. Psychol. 125 657–663. 10.1037/abn0000166 [DOI] [PubMed] [Google Scholar]
- Mendelsohn A., Pine A., Schiller D. (2014). Between thoughts and actions: motivationally salient cues invigorate mental action in the human brain. Neuron 81 207–217. 10.1016/j.neuron.2013.10.019 [DOI] [PubMed] [Google Scholar]
- Mkrtchian A., Roiser J. P., Robinson O. J. (2017). Threat of shock and aversive inhibition: induced anxiety modulates Pavlovian-instrumental interactions. J. Exp. Psychol. Gen. 146 1694–1704. 10.1037/xge0000363 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Natsheh J. Y., Shiflett M. W. (2015). The Effects of Methylphenidate on Goal-directed Behavior in a Rat Model of ADHD. Front. Behav. Neurosci. 9:326. 10.3389/fnbeh.2015.00326 [DOI] [PMC free article] [PubMed] [Google Scholar]
- R Development Core Team (2015). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. [Google Scholar]
- Rescorla R. A., Solomon R. L. (1967). Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol. Rev. 74 151–182. 10.1037/h0024475 [DOI] [PubMed] [Google Scholar]
- Salamone J. D., Pardo M., Yohn S. E., López-Cruz L., SanMiguel N., Correa M. (2015). Mesolimbic Dopamine and the Regulation of Motivated Behavior. Curr. Top. Behav. Neurosci. 27 231–257. 10.1007/7854_2015_383 [DOI] [PubMed] [Google Scholar]
- Segal Z. V., Williams J. M. G., Teasdale J. D. (2002). Mindfulness-Based Cognitive Therapy for Depression: A New Approach to Preventing Relapse. New York, NY: The Guilford Press. [Google Scholar]
- Swart J. C., Frobose M. I., Cook J. L., Geurts D. E., Frank M. J., Cools R., et al. (2017). Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action. Elife 6:e22169. 10.7554/eLife.22169 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vago D. R., Gupta R. S., Lazar S. W. (2019). Measuring cognitive outcomes in mindfulness-based intervention research: a reflection on confounding factors and methodological limitations. Curr. Opin. Psychol. 28 143–150. 10.1016/j.copsyc.2018.12.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watson P., Wiers R. W., Hommel B., de Wit S. (2014). Working for food you don’t desire. Cues interfere with goal-directedfood-seeking. Appetite 79 139–148. 10.1016/j.appet.2014.04.005 [DOI] [PubMed] [Google Scholar]
- Whiteside S. P., Lynam D. R. (2001). The Five Factor Model and impulsivity: using a structural model of personality to understand impulsivity. Pers. Individ. Differ. 30 669–689. 10.1016/S0191-8869(00)00064-7 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.