Skip to main content
BMC Psychiatry logoLink to BMC Psychiatry
. 2019 Aug 7;19:246. doi: 10.1186/s12888-019-2224-2

Efficacy and mechanisms underlying a gamified attention bias modification training in anxious youth: protocol for a randomized controlled trial

Julia O Linke 1,, Emily Jones 1, David Pagliaccio 2, Caroline Swetlitz 1, Krystal M Lewis 1, Wendy K Silverman 3, Yair Bar-Haim 4, Daniel S Pine 1, Melissa A Brotman 1
PMCID: PMC6686536  PMID: 31391027

Abstract

Background

Attention bias modification training (ABMT) and cognitive behavioral therapy (CBT) likely target different aspects of aberrant threat responses in anxiety disorders and may be combined to maximize therapeutic benefit. However, studies investigating the effect of ABMT in the context of CBT have yielded mixed results. Here, we propose an enhanced ABMT to target the attentional bias towards threat, in addition to classic CBT for anxiety disorders in youth. This enhanced ABMT integrates the modified dot-probe task used in previous studies, where a target is always presented at the previous location of the neutral and not the simultaneously presented threatening stimulus, with a visual search, where the targets are always presented distally of threatening distractors. These two training elements (modified dot-probe and visual search) are embedded in an engaging game to foster motivation and adherence. Our goal is to determine the efficacy of the enhanced ABMT in the context of CBT. Further, we aim to replicate two previous findings: (a) aberrant amygdala connectivity being the neurobiological correlate of the attentional bias towards threat at baseline; and (b) amygdala connectivity being a mediator of the ABMT effect. We will also explore moderators of treatment response (age, sex, depressive symptoms and irritability) on a behavioral and neuronal level.

Methods

One hundred and twenty youth (8–17 years old) with a primary anxiety disorder diagnosis all receive CBT and are randomized to nine weeks of either active or control ABMT and symptom improvement will be compared between the two study arms. We will also recruit 60 healthy comparison youth, who along with eligible anxious youth, will be assessed with the dot-probe task during fMRI (anxious youth: before and after training; healthy volunteers: second measurement twelve weeks after initial assessment).

Discussion

The present study will contribute to the literature by (1) potentially replicating that aberrant amygdala connectivity mediates the attentional bias towards threat in anxious youth; (2) determining the efficacy of enhanced ABMT; and (3) advancing our understanding of the mechanisms underlying ABMT.

Trial registration

Clinicaltrials.gov: NCT03283930 Trial registration date: September 14th 2017. The trial registration took place retrospectively. Data acquisition started February 1st 2017.

Keywords: Attention bias modification, Cognitive behavioral therapy, Randomized controlled trial, Anxiety, Youth, fMRI, Gamification

Background

Anxiety disorders, such as separation anxiety, specific phobia, social phobia, generalized anxiety and panic, occur in 15–20% of all children and adolescents [1]. This is particularly important because anxiety during childhood and adolescence predicts not only later anxiety, but also other psychiatric disorders during adulthood [2, 3]. Cognitive behavioral therapy (CBT) emphasizes behavioral exposures and cognitive restructuring that aim to change dysfunctional behaviors (e.g. avoidance of fear-provoking stimuli/situations) and thoughts (e.g., catastrophic thinking). CBT has been shown to produce medium-to-large symptom reductions in anxious children and adolescents [4]. However, only one in five clinically anxious youth receives treatment [5] and about 50% of treated patients do not respond to treatment [6, 7]. This has motivated researchers to develop Attention Bias Modification Trainings (ABMT), which specifically target one well-replicated mechanism in anxiety disorders: an attentional bias towards threat [8].

ABMT is typically employed using a modified dot-probe task [9]. The dot-probe task indexes attentional bias using the difference in reaction times to target stimuli presented at the previous location of either a threatening or neutral stimulus, often emotional faces [10], for details see Fig. 2b). During ABMT, the probe consistently appears in the location of the neutral face stimulus thereby implicitly training participants to attend away from the threatening face, whereas in the control condition the probe replaces the neutral and threatening face stimuli with equal probability [11]. Thus, the modified version of the dot-probe task is hypothesized to change the attentional bias ‘bottom up’ by directly retraining salience contingencies [11]. On a neurobiological level, the dot-probe task has been most robustly associated with amygdala-insula connectivity [1214], which according to a first report by White and colleagues does not only differentiate anxious from healthy youth, but also predicts the response to ABMT [15]. Of note, the visual search for non-threat targets in the context of threatening distractors has also successfully been used as ABMT [16, 17], but has been more related to activity in the fronto-parietal attention network and the amygdala [18, 19]. Given that the modified dot-probe task and the visual search training target different, albeit partial overlapping neural circuits, it is conceivable that a combination of both trainings would yield enhanced treatment effects.

Fig. 2.

Fig. 2

Depiction of the gamified ABMT. a Shows the general outline of the training and feedback provided as participant progress through the training. b Shows the modified dot-probe task. The active condition consists of threat incongruent trials and neutral-neutral trials only, whereas the congruent and incongruent trials are shown with equal probability during the control condition. The face stimulus stems from the NimStim stimulus set [72]. c The upper panel shows the active visual search with two threatening faces and the lower panel shows the control condition with neutral faces only. At the left you see the same view as the participants and at the right searchable numbers are highlighted

To date, seven meta-analyses have investigated the effects of ABMT in terms of the modified dot-probe task in youth and adults showing small [2023] to moderate [2426] reductions in attention bias towards threat. ABMT effects on symptoms of anxiety were generally small [2026], albeit single reports of moderate [27], and no symptom reductions [28]. An additional six studies have investigated the efficacy of active vs. control ABMT in addition to CBT. Four studies including the one by White and colleagues (2017) showed an enhanced effect of the combination treatment on symptoms rated by clinicians [15, 2931]. An additional study showed improved effects of ABMT+CBT on symptoms rated by child and parent only [32]; one study reported no significant differences between active ABMT+CBT vs. control ABMT+CBT [33].

These mixed findings might be partially explained by differences in the study designs. Particularly, the vertical, rather than horizontal, presentation of stimulus pairs during the modified dot-probe task appears to yield larger effects [27]. Moreover, effect sizes of ABMT are larger in laboratory vs. home settings, and when anxiety symptoms are assessed by clinicians (rather than self-report) [34]. Inconsistencies may further relate to individual differences in task engagement and motivation to complete a specific task [35], as engagement has been shown to moderate the efficacy of cognitive trainings [36] such as the modified dot-probe task [37]. The use of game-like elements, henceforth referred to as “gamification”, [38] could make ABMT more engaging and motivating, thereby enhancing adherence to the training and improving ABMT efficacy [39]. As outlined by Boendermaker and colleagues (2015), the use of game elements in cognitive trainings such as ABMT should ideally target both extrinsic and intrinsic motivation, which might be achieved by using a performance-based point system and designing the training in a way that it is inherently interesting or enjoyable. The use of game-elements seems particularly promising in younger children (e.g. < 12 years), who show relatively small effects compared to older youth [40].

Finally, it has been argued that ABMT can only result in anxiety symptom reduction, when an attentional bias towards threat is initially present, i.e. the proposed target mechanism of ABMT [41]. Unfortunately, it is difficult to assess attentional bias behaviorally as reliability of the bias measure derived from the dot-probe task is poor [42]. However, reliability of amygdala connectivity as a neurobiological correlate of the attention bias is better [43].

Aims

There are three aims of this study. First, [1] we aim to test the efficacy of an enhanced ABMT, which consists of a gamified combination of the modified dot-probe task and a visual search, in a clinic setting in anxious youth. We hypothesize that children receiving active ABMT+CBT will show greater improvement relative to those receiving control ABMT+CBT, reflected by greater decreases in the Pediatric Anxiety Rating Scale (PARS [44]) scores and the Clinical Global Impressions-Improvement Scale (CGI-I [45]) scores rated by clinicians. Second, we seek to replicate the results previously reported by White and colleagues (2017): (2a) aberrant amygdala connectivity being the neurobiological correlate of the attentional bias towards threat at baseline; and (2b) amygdala connectivity being a mediator of the ABMT effect. To establish the association between anxiety and aberrant amygdala connectivity related to the attentional bias towards threat at baseline (aim 2a), we will also recruit a healthy comparison sample. Third, [3] we will explore moderators of treatment response namely age, sex, depressive symptoms, and irritability on a behavioral and neural level.

Methods

Study setting and trial design

This randomized controlled trial is being conducted at the National Institutes of Mental Health in Bethesda, Maryland, United States of America. The study adheres to the Consolidated Standards of Reporting Trials (CONSORT) statement [46] and the SPIRIT guidelines (Standard Protocol Items: Recommendations for Interventional Trials) [47]. The study protocol, information on the study, informed consent, and trial-related documents were approved by the Institutional Review Board of the National Institute of Mental Health. We chose a design similar to White and colleagues (2017); random assignment of anxious youth to one of two treatment-arms (active ABMT + CBT vs. control ABMT + CBT); assessment of anxiety and symptom severity pre-, mid-, and post treatment and 6 month after treatment; assessment of functional magnetic resonance imaging (fMRI) data pre- and post-treatment; recruitment of a healthy sample to test the association between anxiety and amygdala connectivity at baseline. A flowchart of the study is shown in Fig. 1.

Fig. 1.

Fig. 1

Study flow chart

Sample size

To test the first hypothesis regarding the efficacy of the enhanced ABMT, the target sample size was estimated using G*Power version 3.1 [48] to achieve a between-group (active vs. placebo ABMT) effect size of Cohen’s d = 0.45 (as reported by [15]), with a power of 80%, and an alpha error rate of .05. This calculation generated a sample size of N = 120. We will analyze the data with a linear mixed model that allows for both the fixed treatment effect and random subject effects on anxiety levels.

We also calculated the sample size needed to test the effect of the active vs. control ABMT within a linear mixed model using the PARS baseline ratings as covariate with the GLIMMPSE software [49]. For this secondary analysis, we used the following parameters: α = .05, β = .80, equal group size, and information about correlations between the PARS scores obtained from White et al. 2017 (PARS week 0 with PARS week 4: r = .46, PARS week 0 with PARS week 8: r = .20, PARS week 4 with PARS week 8: r = .48). As outlined above, we expect a larger treatment effect size and/or reduce variability in the treatment effect compared with White and colleagues (2017), as we provide an enhanced ABMT that consists of the modified dot-probe and a visual search task and is, further, enriched by game elements to increase engagement and adherence. These analyses showed that the effect might already be detected with N = 86 (effect size * 1.25, variability * 0.75) or N = 112 (effect size * 1.25, same variability). Depending on the speed of the participant accrual and the external review of our group in 2021, it might be necessary to have an independent assessor conduct an interim analysis, either when N = 86 or when N = 112. However, we will remain blind to our data, and the final analysis will be completed upon attaining the proposed sample size of N = 120.

To test hypothesis 2a that aberrant amygdala connectivity is the neurobiological correlate of the attention bias in anxious youth [15], we will also acquire anxiety ratings and functional magnetic resonance imaging (fMRI) data during the dot-probe task from healthy volunteers. White and coworkers (2017) were able to show this effect comparing 54 anxious to 51 healthy youth. Thus, we aim to acquire imaging data from 60 healthy volunteers (HV) to replicate this finding.

Recruitment and eligibility criteria

Recruitment and eligibility

Recruitment for this study began in February 2017. The study is being advertised in a local parenting magazine, through talks at local schools and flyers. After requesting information, interested families receive information about the trial and are asked to provide general information regarding the potential study participant, such as age and presenting anxiety symptoms. If eligibility criteria (Table 1) are met based on this initial assessment, families are invited onsite.

Table 1.

Eligibility criteria

Inclusion criteria Exclusion criteria

• Age: 8–17 (participants, who consent as 17-year-olds but turn 18 during the course of the study, will be eligible to complete all procedures)

• IQ: all participants will have IQ-scores > 70 as assessed by the WASI

• Language: all participants will be fluent in English

• Any current anxiety diagnosis for patient group only

• Any serious medical condition or condition that interferes with fMRI scanning

• Pregnancy

• Current use of any psychoactive substance

• Current suicidal ideation

• Current diagnosis of ADHD of sufficient severity to require pharmacotherapy, Tourette’s Disorder, OCD, PTSD, conduct disorder, major depressive disorder

• Past or current history of mania, psychosis, or severe pervasive developmental disorder

Abbreviations: ADHD attention-deficit hyperactivity disorder, IQ intelligence quotient; OCD obsessive compulsive disorder, PTSD post-traumatic stress disorder, WASI Wechsler Abbreviated Scale of Intelligence

During an onsite visit, participants and their parent(s) are administered modules of the Anxiety Disorders Interview Schedule – Child and Parent (ADIS-C/P) [50] to assess anxiety disorders and the Kiddie Schedule for Affective Disorders and Schizophrenia (K-SADS) [51] (without the anxiety modules) to determine current or past comorbidities. Assessment interviews are conducted with parents and children independently by a trained clinician. Diagnoses are then confirmed by D.S.P.. Further, trained research assistants administer the Wechsler Abbreviated Scale of Intelligence [52]. Once eligibility is confirmed, clinicians discuss treatment options and assess whether patients are suitable for CBT (e.g. willing to compete exposures) and ABMT (physically and behaviorally able to complete ABMT reliably). Then, parents give written informed consent and the children provide written assent.

Next, participants undergo three psychoeducational sessions and the subset who does not have MRI contraindications is assessed with the dot-probe task during fMRI. Prior to randomization and the beginning of active treatment, clinicians determine the participant’s willingness to engage in the intervention and ability to regularly participate in treatment sessions. If patients are unwilling or unable to participate in the treatment trial, alternative treatment options are offered (i.e., psychotropic medication, CBT without ABMT, community referrals).

All inclusion and exclusion criteria that apply to the patients also apply to the healthy volunteers (HV) and are assessed in the same way. However, HV must not fulfill criteria for a current or lifetime psychiatric disorder, which is confirmed by a trained clinician administering the ADIS and KSADS to the child and the parent. Further, MRI contraindication is exclusionary for HV.

Randomization and blinding

After baseline screening and three psychoeducational visits, patients are randomized to either the active or control ABMT condition. Randomization is handled by a computer algorithm administered by a person independent of the researchers and treating clinicians. Thus, patients, experimenters, and clinicians are blind to the AMBT condition (active vs. control) that participants receive. In case of an interim analysis, the blind will only be lifted for the person conducting the analysis, who will not be in contact with the patients.

Measures

Primary outcome measures

The Clinical Global Impression of Improvement Scale (CGI-I) is a measure of global symptom improvement rated by clinicians [45]. Its score ranges from 1 to 7, with lower scores reflecting greater levels of improvement. This scale provides an ordinal outcome as participants with CGI-I ratings of ≤3 at week 8 are considered as “responder” and participants with scores > 3 are counted as “non-responder”.

The Pediatric Anxiety Rating Scale (PARS) measures anxiety symptoms and related functional impairment in youth as continuous outcome [44]. It comprises a 50-item checklist asking for seven dimensions of global severity/ impairment: 1) number of symptoms, 2) frequency of symptoms, 3) severity of distress associated with anxiety symptoms, 4) severity of physical symptoms, 5) avoidance, 6) interference at home, and 7) interference outside of home. Each item is rated on a 0–5 scale by a clinician based on parent- and child-report. The sum score is calculated based on sub-scales 2, 3, 5, 6, and 7 and ranges from 0 to 25 with higher scores reflecting greater levels of anxiety. Scores above 11.5 indicate the presence of an anxiety disorder. The PARS shows satisfactory internal consistency (intraclass correlation coefficient [ICC] = 0.97) and moderate test-retest reliability (.55) [44]. If findings for these two primary outcome measures are discrepant, more weight will be given to the PARS, given the greater statistical power with the continuous approach.

Secondary outcome measures

The Children’s Global Assessment Scale (CGAS; [53]) is a clinician-rated measure of global functioning, which scores range from 1 to 100 and shows good interrater reliability (ICC = 0.88) [54]. Higher CGAS-scores reflect better overall functioning [55].

The Screen for Child Anxiety Related Disorders (SCARED; [56]) is a 41-item, dual-informant measure of pediatric anxiety symptoms; we use the mean of the parent and child ratings. The questionnaire consists of five subscales assessing symptoms of generalized anxiety, social anxiety, separation anxiety, panic, and school refusal. Items are rated on a scale from 0 to 2; the overall score range is 0–82. Higher scores reflect greater levels of anxiety, and scores above 25 indicate the presence of an anxiety disorder. The SCARED has good internal consistency (α = .91) [57] and good to excellent test-retest reliability (.70–.90) [58].

The State-Trait Anxiety Inventory for Children (STAI-C; [59]) is a 20-item self-report measure of trait anxiety. Items are rated on a scale from 1 to 3; the overall score range is 20–60. Higher scores reflect greater levels of anxiety. The STAI-C has good internal consistency (α = .86) and test-retest reliability estimates range from poor to good (.31–.86) [60].

The Self-Efficacy Questionnaire (SEQ-C; [61]) is a 24-item self-report measure of self-efficacy in youth. The questionnaire is made up of three subscales assessing social self-efficacy, academic self-efficacy, and emotional self-efficacy. Items are rated on a scale from 1 to 5; the overall score range is 24–130. Higher scores reflect higher levels of self-efficacy. The SEQ-C has good internal consistency (Cronbach’s α = .88) [61].

Measures of comorbid symptom clusters

Elevated anxiety levels frequently co-occur with increases in depressive symptoms [62] and increased irritability [63]. We will determine whether symptoms of depression assessed with the Mood and Feelings Questionnaire (MFQ; [64]) and irritability measured with the Affective Reactivity Index (ARI; [65]) at baseline moderate training effects. Further, we will investigate whether training effects transfer to these symptom clusters mid- and post-treatment.

The MFQ is a 33-item dual-informant measure of depressive symptoms in children. Items are rated on a scale from 0 to 2; the overall score range is 0–66. Higher scores reflect higher levels of depression, and scores above 27 indicate clinically significant depression. The MFQ has excellent internal consistency (α = .91 to .93) [66].

The ARI is a 7-item dual-informant measure of irritability in children. Items are rated on a scale from 0 to 2; the overall score range is 0–12. Higher scores reflect higher levels of irritability. The ARI has good to excellent internal consistency (α = .88–.92) and test-retest reliability (.88–.90) [67].

Treatment

Cognitive behavioral therapy

All participants receive 12 weekly sessions of CBT [68] administered by one of the licensed psychologists who specialize in the treatment of anxiety in youth (one of them being K.L.). Each CBT session is 40 to 60 min and the youth are assigned additional home practice, which builds on the exposure completed during the sessions. Treatment begins with an introduction to CBT, psychoeducation, and self-monitoring. After three weeks of treatment, children are instructed to complete their first out-of-session exposure. In-session exposures and cognitive restructuring exercises begin at session four. Table 2 gives an overview of the treatment, highlighting the skills and exercises emphasized in each session. Parents were involved in three sessions across treatment, which involved assessment of child psychopathology and improvement across the treatment. Home practice information was relayed to parents so that they could remind the kids to complete their exposures; however, the treatment was primarily individually focused. The CBT therapists were trained on the CBT protocol during a one-day training at the Child Study Center at Yale by W.K.S., who will also provide supervision as needed. There will be a bi-weekly intervision, where D.S.P., K.M.L., and another treating clinician will discuss the treatment progress and determine the need for supervision.

Table 2.

Schedule of enrolment, interventions, and assessments

graphic file with name 12888_2019_2224_Tab2_HTML.jpg

Abbreviations: ADIS Anxiety Disorders Interview Schedule, ARI Affective Reactivity Index, CGAS Children’s Global Assessment Scale, CGI-I/S Clinical Global Impressions-Improvement/Severity, K-SADS Kiddie-Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version, MFQ Mood and Feelings Questionnaire, PARS Pediatric Anxiety Rating Scale, SCARED Screen for Child Anxiety Related Disorders, SCAS Spence Child Anxiety Scale, SEQ Self-Efficacy Questionnaire, STAI-Trait State-Trait Anxiety Inventory Trait version, * indicates the main outcome measures

Attention bias modification training

As noted above, patients are randomly assigned to receive active or control ABMT that is administered via laptop prior to every CBT session (Table 2). The ABMT is administered to the youth by a research assistant (blinded to ABMT condition) who is responsible for setting up the computer. During task completion the research assistant remains in the test room but cannot see the screen in order to remain blinded. Both active and control ABMT are embedded within a game that consists of A) three 80-trial blocks of the modified dot-probe task [10], and B) two sessions of the visual search game (Fig. 2) in ABABA order. Each training session lasts 10–16 min.

During each of the three dot-probe blocks, participants are presented with pairs of faces (60 angry-neutral and 20 neutral-neutral) from picture-set A of the TAU-NIMH Attention Bias Measurement toolbox [10] are shown vertically on a computer screen (1440 × 900 pixel) for 500 msec. Next, a probe (< or >) will appear in the location vacated by one of these faces. Participants are required to indicate the direction the arrow probes are pointing to as quickly and as accurately possible. The response is followed by a fixation cross presented for 500 msec. In the control condition, trial type (angry-neutral, neutral-neutral), angry-face location (top or lower part of the screen), and probe location (behind an angry or neutral face at the top or lower part of the screen) are fully counterbalanced. In the active condition, the target appears at the neutral-face location in all angry-neutral trials, thereby training the participant to direct attention away from the angry face.

As it the primary aim of this study to replicate the efficacy of modified dot-probe task for the treatment of anxiety in youth, the actual training remains unchanged but is augmented by a performance-based point system. In each of the three blocks, participants can earn up to 80 points if they respond correctly to the probe. In addition, participants can earn “time tokens” for responding correctly and quickly in the modified dot-probe task. The number of time tokens are determined by (a) the number of correct responses, which is multiplied with 0.04, (b) the reaction time (number of time tokens = (600 msec – response time in msec)/ 50), and (c) the number of errors; 10 tokens are subtracted for each error after the first 4 errors. These tokens may be used in the visual search to extend the search time limit by 10 s each by clicking on a clock icon on the side panel. Points that are earned during the last dot-probe block do not translate into time points but count towards the final score of the session and the score across all sessions (see Fig. 2a).

As outlined above, our novel ABMT combines the modified dot-probe task with a visual search. Of note, the visual search task has been designed as a puzzle with a level-structure comparable to actual games people play to be inherently interesting. We expect that participants will be intrinsically motivated for this part of the “game” and see the dot-probe part as a mean to spend more time on the visual search thereby increasing the extrinsic motivation to perform well on the dot-probe too.

Within the visual search task, participants must find all numbers hidden within a scene in a limited time (level 1: 1 min for 10 numbers; level 2: 1 min 15 s for 15 numbers; level 3: 1 min 30 s for 20 numbers). The visual search scenes depict 6 youth with different ethnicities engaged in school-related activities. In the active condition, four youth display neutral and two display angry facial expressions and numbers can be found distal to the angry and proximal to the neutral faces. In the control condition all faces have a neutral expression and numbers can be found at the same location as in the active condition. For each number found, participants earn additional points (level 1: 10 points, level 2: 15 points, level 3: 20 points). For clicking on something other than the hidden numbers points are deducted (level 1: 1 point, level 2: 2 points, level 3: 3 points). Moreover, they can earn a bonus of 10 points for finding all numbers before the time is up. In between the dot-probe and visual search blocks feedback regarding points and time tokens is provided. At the end of each training session, participants receive feedback regarding their total score on that day and their overall score across all training sessions. The overall score (points from the dot-probe and the visual search task) does not translate into tangible rewards as there is evidence that these might undermine intrinsic motivation for a task [69].

It is possible that some participants infer which condition they have been allocated to from the matching of the probes to the stimuli. Therefore, we ask them before the debriefing to guess whether they think they had been allocated to the active or the placebo condition and how confident they are that their guess is correct. This information might be used in additional exploratory analyses.

Functional magnetic resonance imaging

Attention Bias assessment – dot-probe task

Participants complete an event-related dot-probe fMRI task [10] at baseline and after treatment. This dot-probe task is precisely the same as the one we use during the training, except that here we use picture set B of the TAU-NIMH Attention Bias Measurement toolbox [10], present the task in 2 blocks/ runs of 120 trials, and use a longer inter-trial interval with an average of 2 s to better capture the BOLD response. The task has three conditions that are presented in random order: 1) 40 congruent trials, when the arrow probe appears in the location of the angry face; 2) 40 incongruent trials, when the arrow appears in the location of the neutral face; and 3) 40 neutral trials, with two neutral faces as a non-threat condition. We are particularly interested in contrasting incongruent vs. congruent trials, as a measure of “attention bias” that reflects differential brain function when attention is allocated away or toward threat (angry face). Each task condition consists of 80 trials that are presented across two runs. Data will be excluded from participants who respond incorrectly on over 25% of trials.

Data acquisition

Functional neuroimaging data are acquired with a 3 T GE scanner (Waukesha, Wisc.) with an eight-channel head coil with 2.5 mm resolution and T2* weighting (TR = 2300 ms, TE = 25 ms, flip angle = 50°, FOV = 240 mm2, matrix = 96 × 96, 41 contiguous 3-mm interleaved axial slices). For co-registration and normalization, we acquire a a high-resolution T1-weighted 3D standard sequence (slice thickness 1 mm, FOV = 256 × 256 × 176 mm, matrix = 256x256x176).

Preprocessing of task-based fMRI data

Task-related functional imaging data are preprocessed with the AFNI (Analysis of Functional Neuroimages) software. Steps include slice timing correction, nonlinear registration of echoplanar data to anatomical scans, normalization, and spatial smoothing. Individual-level statistical analyses are carried out using a general linear model, with regressors for correct trials for each task conditions (congruent, incongruent, neutral) and one regressor for incorrect trials. Further, the models include regressors accounting for baseline drift and head motion. We also separately assess task-based functional connectivity of the left and right amygdala for the congruent, incongruent, and neutral conditions using generalized psychophysiological interaction (gPPI) analysis [70].

Statistical analyses

Behavioral data: efficacy of the ABMT

We will perform both per protocol analyses (i.e., evaluating only participants who completed the study) and intent to treat analyses (i.e., evaluating all participants enrolled regardless of whether they complete the study). PARS rating data will be entered into a linear mixed model with ABMT group (active, placebo) as a between-group factor and time as within-subject variable. If there are significant differences in pretreatment ratings, they will be included as a covariate and time will be a two-level factor (mid- and post-treatment). If there are no differences in pretreatment ratings, time will be entered as a three-level factor (pre-, mid- and post-treatment). The efficacy of the training will be determined based on the contrast that tests for group differences in the posttreatment PARS ratings. Additionally, we will compare responders (CGI-I score ≤ 3) and non-responders (CGI-I score > 3) between active and control group using a Chi-square test. Additional analyses will explore effects of age and sex on treatment response.

Imaging data

Consistent with previous studies [1215] showing aberrant amygdala connectivity in anxiety and greater stability of amygdala-based connectivity compared to activation on the dot-probe task [43], our analysis will focus on task-related amygdala-seed functional connectivity. We are particularly interested in how amygdala connectivity at baseline 1) differs between patients and healthy comparison participants, 2) predicts overall treatment response in patients, and 3) relates to ABMT-specific treatment effects. We will also compare amygdala-seed connectivity pre- vs. post-treatment. Additionally, we will explore treatment effects on amygdala activation and effects of age, sex, and other clinical measures (MFQ, ARI) on brain function and treatment-related changes in brain function.

All whole brain analyses will use a voxel-wise threshold of p < 0.001 and cluster correction to achieve a whole brain p < 0.05 false positive rate. The number of voxels in a cluster will be determined using 10,000 Monte Carlo simulations using AFNI’s 3dClustSim tool with the autocorrelation function correction. With regard to previous findings, we will use a region-of-interest approach to test for significant results specifically in the prefrontal cortex and the insula [15]. Consistent with previous studies the cluster-wise threshold for the prefrontal cortex will be based on a prefrontal cortex mask [15, 43]. Group maps will be thresholded to include only data for which > 90% of participants had valid data.

Differences in pretreatment amygdala connectivity will be tested with a linear mixed-effects model using AFNI’s 3dLME program using group (anxious patients vs. healthy comparison participants) as a between-subject variable and task condition (congruent, incongruent, neutral) as the within-subject variable. The question of whether pre-treatment amygdala connectivity predicts treatment response will be tested in the patient group using 3dMVM with post-treatment PARS ratings as a continuous variable, ABMT group (active, placebo) as a between-subject variable, and task condition (congruent, incongruent, neutral) as the within-subject variable. To control for baseline anxiety, pre-treatment PARS rating will be included as a covariate.

We will test two interactions of interest: [1] the two-way task condition-by-posttreatment PARS interaction will be examined to identify connectivity changes related to overall treatment response; and [2] the three-way task condition-by-ABMT-by-posttreatment PARS rating interaction will be examined to assess connectivity related to treatment differences that differs between the active and control ABMT groups. Post-hoc visualization will rely on correlations between connectivity levels and posttreatment PARS ratings for each of the two ABMT groups.

Discussion

Attentional bias towards threat is a key mechanism in anxiety disorders [8] that is not specifically targeted by CBT. ABMT procedures mostly using a modified version of the dot-probe task have been specifically developed to change this attentional bias ‘bottom up’ by directly retraining salience contingencies. Despite promising results of initial studies, this has not proved straightforward [28] and thus further research is warranted.

This study will be the largest randomized controlled trial in anxious youth that uses fMRI to assess the attention bias by focusing on amygdala connectivity – a neurobiological marker that has adequate test-retest reliability [43]. Of note, the intervention used in this study has been designed to maximize treatment response and therefore consists of a novel combination of the modified dot-probe task and a modified visual search task to more comprehensively target processes involved in the selective allocation of attention. Moreover, we also address the issue of low motivation/ low adherence by designing the visual search training as a puzzle that will be inherently interesting and additionally introducing game elements such as digital rewards, feedback, levels, and time pressure. Finally, we apply several strategies shown to enhance the ABMT effect including [1] using vertical presentation of stimuli pairs during the modified dot-probe task [27]; [2] training in a clinic setting to minimize distractions [8], and activate a relevant ‘fear structure’ to provoke the attentional bias that can then be modified [30]; and [3] using of independent clinician-based assessments of anxiety, as opposed to self-reported anxiety measures that are more prone to biased reporting [71]. Considering this framework, it can be expected that the results of this study will have a significant impact on the debate regarding the efficacy of ABMT on attentional biases. The study also can contribute to the development of personalized treatments and delineate the mechanisms underlying a predictive relationship between pretreatment attentional bias reflected not only in behavioral measures, but also increased amygdala-insula connectivity and response to ABMT.

Despite considerable strengths, there are several limitations inherent in the study design. First, we essentially combine three interventions (modified dot-probe, positive visual search, and CBT), and test them with two study arms. Thus, it will not be possible to dissociate effects of the modified dot-probe aiming at bottom-up attentional processes, the visual search potentially also targeting top-down attentional processes and CBT meant to reduce dysfunctional appraisal and avoidance of potential threats using exposure and cognitive strategies such as restructuring. In this regard, we also will not be able to answer whether the gamification led to an enhanced treatment response should we find one. A second related limitation is that the attention bias will be solely assessed with the dot-probe task. No task measuring goal-directed inhibitory control of attention potentially targeted by the visual search training will be administered as the sum of the ratings, interview and the dot-probe task that are conducted pre- and post-treatment already pose such a strain on the participating families that unfortunately the assessment of a second task pre-post treatment is practically not feasible. Thirdly, all patients will receive CBT with either active or control ABMT, so our findings may not be generalizable to other effective treatments, such as medication. Fourth, we enroll participants with any one of various anxiety disorders (generalized anxiety disorder, social phobia, separation anxiety, specific phobia). For this reason, we cannot tailor training stimuli to specific anxiety disorders. Fifth, the performance during the visual search task depends on the performance during the dot-probe task. Although the dot-probe task is easy (participants earn a point for correctly indicating whether the arrow is pointing to the left or the right) and participants always earn points, which they can use during the visual search task; this might negatively impact the motivation for some participants. However, only the numbers found during the regular time will be analyzed. Sixth, it is not the focus of the present study to assess the effect of the game elements. Therefore, engagement and adherence with regards to the game elements are not specifically assessed or evaluated but might be the focus of future studies. Lastly, the generalizability of our findings may be affected by the study’s exclusionary criteria (e.g., depression, OCD).

In summary, this is an important study that further tests the efficacy of a computer-based attention bias modification training aiming at reducing increased attention towards threat – a mechanism not specifically targeted by CBT. Given previously mixed findings, we employ a combination of the modified dot-probe and visual search to target both bottom-up and top-down attentional processes. Additionally, the training will be imbedded in a game to enhance motivation and adherence. Finally, we will use fMRI to delineate mechanisms relevant for future guided treatment selection in this largest randomized controlled trial in anxious youth to date.

Acknowledgements

We thank Bob Hohn for implementing the gamification in the ABMT.

Abbreviations

ABMT

Attention Bias Modification Training

ADIS

Anxiety Disorders Interview Schedule

AFNI

Analysis of Functional Neuroimages

ARI

Affective Reactivity Index

CBT

Cognitive behavioral therapy

CGAS

Children’s Global Assessment Scale

CGI

Clinical Global Impressions-Improvement Scale

CONSORT

Consolidated Standards of Reporting Trials

fMRI

functional magnetic resonance imaging

FoV

Field of view

FWHM

Full width at half maximum

gPPI

generalized psychophysiological interaction

HV

healthy volunteers

K-SADS

Kiddie Schedule for Affective Disorders and Schizophrenia

MFQ

Mood and Feelings Questionnaire

PARS

Pediatric Anxiety Rating Scale

RUPP

Research Unit on Pediatric Psychopharmacology

SCARED

Screen for Child Anxiety Related Disorders

SEQ-C

Self-Efficacy Questionnaire

SPIRIT

Standard Protocol Items: Recommendations for Interventional Trials

STAI-C

State-Trait Anxiety Inventory for Children

TE

Echo time;

TR

Repetition time

Authors’ contributions

DSP is the principal investigator for the project. DSP, DP, KL, WKS, YBH and MB conceptualized the initial trial design. CS, JL and EJ implemented the trial and manage data acquisition. The manuscript was written by JL and CS, with significant contributions and revisions from DSP, DP, KL, WKS, YBH, ES and MB. All authors have approved the submitted version and have agreed to be personally accountable for their contributions.

Funding

Not applicable.

Availability of data and materials

Not applicable.

Ethics approval and consent to participate

The research project and all related materials were submitted and approved by the appropriate Institutional Review Board of the National Institute of Mental Health. To participate, parents must give written informed consent and the children must provide written assent.

Consent for publication

Not applicable.

Competing interests

None of the authors has any conflicting interests to report.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Julia O. Linke, Email: julia.linke@nih.gov

Emily Jones, Email: emily.jones@nih.gov.

David Pagliaccio, Email: david.pagliaccio@nyspi.columbia.edu.

Caroline Swetlitz, Email: cswetlitz@gmail.com.

Krystal M. Lewis, Email: krystal.lewis@nih.gov

Wendy K. Silverman, Email: wendy.silverman@yale.edu

Yair Bar-Haim, Email: yair1@post.tau.ac.il.

Daniel S. Pine, Email: pined@mail.nih.gov

Melissa A. Brotman, Email: brotmanm@mail.nih.gov

References

  • 1.Beesdo K, Knappe S, Pine DS. Anxiety and anxiety disorders in children and adolescents: developmental issues and implications for DSM-V. Psychiatr Clin North Am. 2009;32:483–524. doi: 10.1016/j.psc.2009.06.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Bittner A, Egger HL, Erkanli A, Jane Costello E, Foley DL, Angold A. What do childhood anxiety disorders predict? J Child Psychol Psychiatry. 2007;48:1174–1183. doi: 10.1111/j.1469-7610.2007.01812.x. [DOI] [PubMed] [Google Scholar]
  • 3.Asselmann E, Wittchen HU, Lieb R, Hofler M, Beesdo-Baum K. Associations of fearful spells and panic attacks with incident anxiety, depressive, and substance use disorders: a 10-year prospective-longitudinal community study of adolescents and young adults. J Psychiatr Res. 2014;55:8–14. doi: 10.1016/j.jpsychires.2014.04.001. [DOI] [PubMed] [Google Scholar]
  • 4.Crowe K, McKay D. Efficacy of cognitive-behavioral therapy for childhood anxiety and depression. J Anxiety Disord. 2017;49:76–87. doi: 10.1016/j.janxdis.2017.04.001. [DOI] [PubMed] [Google Scholar]
  • 5.Merikangas KR, He JP, Burstein M, Swendsen J, Avenevoli S, Case B, et al. Service utilization for lifetime mental disorders in U.S. adolescents: results of the National Comorbidity Survey-Adolescent Supplement (NCS-A) J Am Acad Child Adolesc Psychiatry. 2011;50:32–45. doi: 10.1016/j.jaac.2010.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The efficacy of cognitive behavioral therapy: a review of meta-analyses. Cognit Ther Res. 2012;36:427–440. doi: 10.1007/s10608-012-9476-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.James AC, James G, Cowdrey FA, Soler A, Choke A. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2013:CD004690. [DOI] [PubMed]
  • 8.Bar-Haim Y, Lamy D, Pergamin L, Bakermans-Kranenburg MJ, IMH V. Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychol Bull. 2007;133:1–24. doi: 10.1037/0033-2909.133.1.1. [DOI] [PubMed] [Google Scholar]
  • 9.MacLeod C, Mathews A, Tata P. Attentional bias in emotional disorders. J Abnorm Psychol. 1986;95:15–20. doi: 10.1037/0021-843X.95.1.15. [DOI] [PubMed] [Google Scholar]
  • 10.Abend R, Pine DS, Bar-haim Y. The TAU-NIMH attention Bias measurement toolbox. School of Psychological Sciencesm Labratory for Research on Anxiety and Trauma: Tel Avivi, Tel Avivi University; 2014. [Google Scholar]
  • 11.Mogg K, Bradley BP. Anxiety and threat-related attention: cognitive-motivational framework and treatment. Trends Cogn Sci. 2018;22:225–240. doi: 10.1016/j.tics.2018.01.001. [DOI] [PubMed] [Google Scholar]
  • 12.Monk CS, Telzer EH, Mogg K, Bradley BP, Mai X, Louro HM, et al. Amygdala and ventrolateral prefrontal cortex activation to masked angry faces in children and adolescents with generalized anxiety disorder. Arch Gen Psychiatry. 2008;65:568–576. doi: 10.1001/archpsyc.65.5.568. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hardee JE, Benson BE, Bar-Haim Y, Mogg K, Bradley BP, Chen G, et al. Patterns of neural connectivity during an attention bias task moderate associations between early childhood temperament and internalizing symptoms in young adulthood. Biol Psychiatry. 2013;74:273–279. doi: 10.1016/j.biopsych.2013.01.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Price RB, Allen KB, Silk JS, Ladouceur CD, Ryan ND, Dahl RE, et al. Vigilance in the laboratory predicts avoidance in the real world: a dimensional analysis of neural, behavioral, and ecological momentary data in anxious youth. Dev Cogn Neurosci. 2016;19:128–136. doi: 10.1016/j.dcn.2016.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.White LK, Sequeira S, Britton JC, Brotman MA, Gold AL, Berman E, et al. Complementary features of attention Bias modification therapy and cognitive-behavioral therapy in pediatric anxiety disorders. Am J Psychiatry. 2017;174:775–784. doi: 10.1176/appi.ajp.2017.16070847. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Waters AM, Zimmer-Gembeck MJ, Craske MG, Pine DS, Bradley BP, Mogg K. Look for good and never give up: a novel attention training treatment for childhood anxiety disorders. Behav Res Ther. 2015;73:111–123. doi: 10.1016/j.brat.2015.08.005. [DOI] [PubMed] [Google Scholar]
  • 17.Waters AM, Zimmer-Gembeck MJ, Craske MG, Pine DS, Bradley BP, Mogg K. A preliminary evaluation of a home-based, Computer-delivered Attention Training Treatment for Anxious Children Living in Regional Communities. J Exp Psychopathol. 2016;7:511–527. doi: 10.5127/jep.053315. [DOI] [Google Scholar]
  • 18.Mohanty A, Egner T, Monti JM, Mesulam MM. Search for a threatening target triggers limbic guidance of spatial attention. J Neurosci. 2009;29:10563–10572. doi: 10.1523/JNEUROSCI.1170-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Ohrmann P, Rauch AV, Bauer J, Kugel H, Arolt V, Heindel W, et al. Threat sensitivity as assessed by automatic amygdala response to fearful faces predicts speed of visual search for facial expression. Exp Brain Res. 2007;183:51–59. doi: 10.1007/s00221-007-1022-0. [DOI] [PubMed] [Google Scholar]
  • 20.Liu H, Li X, Han B, Liu X. Effects of cognitive bias modification on social anxiety: a meta-analysis. PLoS One. 2017;12:e0175107. doi: 10.1371/journal.pone.0175107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Hallion LS, Ruscio AM. A meta-analysis of the effect of cognitive bias modification on anxiety and depression. Psychol Bull. 2011;137:940–958. doi: 10.1037/a0024355. [DOI] [PubMed] [Google Scholar]
  • 22.Heeren A, Mogoase C, Philippot P, McNally RJ. Attention bias modification for social anxiety: a systematic review and meta-analysis. Clin Psychol Rev. 2015;40:76–90. doi: 10.1016/j.cpr.2015.06.001. [DOI] [PubMed] [Google Scholar]
  • 23.Mogoase C, David D, Koster EH. Clinical efficacy of attentional bias modification procedures: an updated meta-analysis. J Clin Psychol. 2014;70:1133–1157. doi: 10.1002/jclp.22081. [DOI] [PubMed] [Google Scholar]
  • 24.Linetzky M, Pergamin-Hight L, Pine DS, Bar-Haim Y. Quantitative evaluation of the clinical efficacy of attention bias modification treatment for anxiety disorders. Depress Anxiety. 2015;32:383–391. doi: 10.1002/da.22344. [DOI] [PubMed] [Google Scholar]
  • 25.Beard C, Sawyer AT, Hofmann SG. Efficacy of attention bias modification using threat and appetitive stimuli: a meta-analytic review. Behav Ther. 2012;43:724–740. doi: 10.1016/j.beth.2012.01.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Cristea IA, Mogoase C, David D, Cuijpers P. Practitioner review: cognitive bias modification for mental health problems in children and adolescents: a meta-analysis. J Child Psychol Psychiatry. 2015;56:723–734. doi: 10.1111/jcpp.12383. [DOI] [PubMed] [Google Scholar]
  • 27.Hakamata Y, Lissek S, Bar-Haim Y, Britton JC, Fox NA, Leibenluft E, et al. Attention bias modification treatment: a meta-analysis toward the establishment of novel treatment for anxiety. Biol Psychiatry. 2010;68:982–990. doi: 10.1016/j.biopsych.2010.07.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Cristea IA, Kok RN, Cuijpers P. Efficacy of cognitive bias modification interventions in anxiety and depression: meta-analysis. Br J Psychiatry. 2015;206:7–16. doi: 10.1192/bjp.bp.114.146761. [DOI] [PubMed] [Google Scholar]
  • 29.Bechor M, Pettit JW, Silverman WK, Bar-Haim Y, Abend R, Pine DS, et al. Attention Bias modification treatment for children with anxiety disorders who do not respond to cognitive behavioral therapy: a case series. J Anxiety Disord. 2014;28:154–159. doi: 10.1016/j.janxdis.2013.09.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Kuckertz JM, Amir N, Boffa JW, Warren CK, Rindt SE, Norman S, et al. The effectiveness of an attention bias modification program as an adjunctive treatment for post-traumatic stress disorder. Behav Res Ther. 2014;63:25–35. doi: 10.1016/j.brat.2014.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Riemann BC, Kuckertz JM, Rozenman M, Weersing VR, Amir N. Augmentation of youth cognitive behavioral and pharmacological interventions with attention modification: a preliminary investigation. Depress Anxiety. 2013;30:822–828. doi: 10.1002/da.22127. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Shechner T, Rimon-Chakir A, Britton JC, Lotan D, Apter A, Bliese PD, et al. Attention bias modification treatment augmenting effects on cognitive behavioral therapy in children with anxiety: randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2014;53:61–71. doi: 10.1016/j.jaac.2013.09.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Rapee RM, MacLeod C, Carpenter L, Gaston JE, Frei J, Peters L, et al. Integrating cognitive bias modification into a standard cognitive behavioural treatment package for social phobia: a randomized controlled trial. Behav Res Ther. 2013;51:207–215. doi: 10.1016/j.brat.2013.01.005. [DOI] [PubMed] [Google Scholar]
  • 34.Price RB, Wallace M, Kuckertz JM, Amir N, Graur S, Cummings L, et al. Pooled patient-level meta-analysis of children and adults completing a computer-based anxiety intervention targeting attentional bias. Clin Psychol Rev. 2016;50:37–49. doi: 10.1016/j.cpr.2016.09.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Matthews G, Campbell SE, Falconer S, Joyner LA, Huggins J, Gilliland K, et al. Fundamental dimensions of subjective state in performance settings: task engagement, distress, and worry. Emotion. 2002;2:315–340. doi: 10.1037/1528-3542.2.4.315. [DOI] [PubMed] [Google Scholar]
  • 36.Siegle GJ, Price RB, Jones NP, Ghinassi F, Painter T, Thae ME. You gotta work at it: pupillary indices of task focus are prognostic for response to a enurocognitive interventino for rumination in depression. Clin Psychol Sci. 2014;2:455–471. doi: 10.1177/2167702614536160. [DOI] [Google Scholar]
  • 37.Lin Q, Denefrio S, Dennis-Tiwary T (2017): Optimizing Attention Bias Modification Training (ABMT): The role of engagement and anxiety. . 29th Annual Association for Psychological Science Convention. Boston, MA.
  • 38.Deterding S, Khaled R, Nacke L, Dixon D (2011): Gamification: toward a definition. CHI 2011 Gamification Workshop Proceedings
  • 39.Boendermaker WJ, Prins PJ, Wiers RW. Cognitive Bias modification for adolescents with substance use problems--can serious games help? J Behav Ther Exp Psychiatry. 2015;49:13–20. doi: 10.1016/j.jbtep.2015.03.008. [DOI] [PubMed] [Google Scholar]
  • 40.Pergamin-Hight L, Pine DS, Fox NA, Bar-Haim Y. Attention bias modification for youth with social anxiety disorder. J Child Psychol Psychiatry. 2016;57:1317–1325. doi: 10.1111/jcpp.12599. [DOI] [PubMed] [Google Scholar]
  • 41.Wiers RW, Boffo M, Field M. What’s in a trial? On the Importance of Distinguishing Between Experimental Lab Studies and Randomized Controlled Trials: The Case of Cognitive Bias Modification and Alcohol Use Disorders. J Stud Alcohol Drugs. 2018;79:333–343. doi: 10.15288/jsad.2018.79.333. [DOI] [PubMed] [Google Scholar]
  • 42.Schmukle SC. Unreliability of the dot probe task. Eur J Personal. 2005;19:595–605. doi: 10.1002/per.554. [DOI] [Google Scholar]
  • 43.White LK, Britton JC, Sequeira S, Ronkin EG, Chen G, Bar-Haim Y, et al. Behavioral and neural stability of attention bias to threat in healthy adolescents. Neuroimage. 2016;136:84–93. doi: 10.1016/j.neuroimage.2016.04.058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Group RUoPPAS The pediatric anxiety rating scale (PARS): Develpment and psychometric properties. Journal of the American Academy of Child Adolescent Psychiatry. 2002;41:1228–1231. doi: 10.1097/00004583-200209000-00006. [DOI] [PubMed] [Google Scholar]
  • 45.Guy W (1976): Clinical global impression. ECDEU Assessment Manual for Psychopharmacology (revised). Rockvilee, MD: National Institutes of mental health.
  • 46.Schulz KF, Altman DG, Moher D, Group C CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMC Med. 2010;8:18. doi: 10.1186/1741-7015-8-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–207. doi: 10.7326/0003-4819-158-3-201302050-00583. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Faul F, Erdfelder E, Lang AG, Buchner A. G*power 3: a flexible statistical power analysis for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39:175–191. doi: 10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
  • 49.Kreidler SM, Muller KE, Grunwald GK, Ringham BM, Coker-Dukowitz ZT, Sakhadeo UR, et al. GLIMMPSE: online power computation for linear models with and without a baseline covariate. J Stat Softw. 2013;54. [DOI] [PMC free article] [PubMed]
  • 50.Silverman WK, Albano AM. The anxiety disorders interview schedule for children (ADIS-C/P) San Antonio, TX: Psychological Corporation; 1996. [Google Scholar]
  • 51.Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, et al. Schedule for affective disorders and schizophrenia for school-age children–present and lifetime version (K-SADS-PL): initial reliability and validity data. J American Academy of Child Adolescent Psychiat. 1997;36:980–988. doi: 10.1097/00004583-199707000-00021. [DOI] [PubMed] [Google Scholar]
  • 52.Wechsler D (1999): Wechsler Abbreviated Scale of Intelligence. New York, NY: the psychological corporation: Hartcourt brace & company.
  • 53.Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, et al. A children’s global assessment scale (CGAS) Arch Gen Psychiatry. 1983;40:1228–1231. doi: 10.1001/archpsyc.1983.01790100074010. [DOI] [PubMed] [Google Scholar]
  • 54.Bird HR, Canino G, Rubio-Stipec M, Ribera JC. Further measures of the psychometric properties of the Children’s global assessment scale. Arch Gen Psychiatry. 1987;44:821–824. doi: 10.1001/archpsyc.1987.01800210069011. [DOI] [PubMed] [Google Scholar]
  • 55.Green B, Shirk S, Hanze D, Wanstrath J. The Children's global assessment scale in clinical practice: an empirical evaluation. J Am Acad Child Adolesc Psychiatry. 1994;33:1158–1164. doi: 10.1097/00004583-199410000-00011. [DOI] [PubMed] [Google Scholar]
  • 56.Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, et al. The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry. 1997;36:545–553. doi: 10.1097/00004583-199704000-00018. [DOI] [PubMed] [Google Scholar]
  • 57.Hale WW, 3rd, Crocetti E, Raaijmakers QA, Meeus WH. A meta-analysis of the cross-cultural psychometric properties of the screen for child anxiety related emotional disorders (SCARED) J Child Psychol Psychiatry. 2011;52:80–90. doi: 10.1111/j.1469-7610.2010.02285.x. [DOI] [PubMed] [Google Scholar]
  • 58.Behrens BM, Swetlitz CE, Kircanski K, Pine DS, Pagliaccio D. Measurement invariance and test-retest reliability of the SCARED questionnaire: examining parent and child report of anxiety symptoms. Bethesda: National Institues of Health Research Festival; 2017. [Google Scholar]
  • 59.Spielberger CD, Edwards CD, Montuori J, Lushene R. State-trait anxiety inventory for children. Balo Alto, CA: Consulting Psychologist Press; 1973. [Google Scholar]
  • 60.Julian LJ. Measures of anxiety: state-trait anxiety inventory (STAI), Beck anxiety inventory (BAI), and hospital anxiety and depression scale-anxiety (HADS-A) Arthritis Care Res (Hoboken) 2011;63(Suppl 11):S467–S472. doi: 10.1002/acr.20561. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Muris P. A brief questionnaire for measuring self-efficacy in youths. J Psychopathol Behav Assess. 2001;23:145–149. doi: 10.1023/A:1010961119608. [DOI] [Google Scholar]
  • 62.Cummings CM, Caporino NE, Kendall PC. Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychol Bull. 2014;140:816–845. doi: 10.1037/a0034733. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Vidal-Ribas P, Brotman MA, Valdivieso I, Leibenluft E, Stringaris A. The status of irritability in psychiatry: a conceptual and quantitative review. J American Academy of Child Adolescent Psychiat. 2016;55:556–570. doi: 10.1016/j.jaac.2016.04.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Costello EJ, Angold A. Scales to assess child and adolescent depression: checklists, screens, and nets. J Am Acad Child Adolesc Psychiatry. 1988;27:726–737. doi: 10.1097/00004583-198811000-00011. [DOI] [PubMed] [Google Scholar]
  • 65.Stringaris A, Goodman R, Ferdinando S, Razdan V, Muhrer E, Leibenluft E, et al. The affective reactivity index: a concise irritability scale for clinical and research settings. J Child Psychol Psychiatry. 2012;53:1109–1117. doi: 10.1111/j.1469-7610.2012.02561.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Thabrew H, Stasiak K, Bavin LM, Frampton C, Merry S. Validation of the mood and feelings questionnaire (MFQ) and short mood and feelings questionnaire (SMFQ) in New Zealand help-seeking adolescents. Int J Methods Psychiat Res. 2018;27:e1610. doi: 10.1002/mpr.1610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Tseng WL, Moroney E, Machlin L, Roberson-Nay R, Hettema JM, Carney D, et al. Test-retest reliability and validity of a frustration paradigm and irritability measures. J Affect Disord. 2017;212:38–45. doi: 10.1016/j.jad.2017.01.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Silverman WK, Kurtines WM. Anxiety and phobic disorders: a pragmatic approach. New York: Plenum Press; 1996. [Google Scholar]
  • 69.Deci EL, Koestner R, Ryan RM. A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychol Bull. 1999;125:627–668. doi: 10.1037/0033-2909.125.6.627. [DOI] [PubMed] [Google Scholar]
  • 70.McLaren DG, Ries ML, Xu G, Johnson SC. A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. Neuroimage. 2012;61:1277–1286. doi: 10.1016/j.neuroimage.2012.03.068. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Mogg K, Bradley BP. Anxiety and attention to threat: cognitive mechanisms and treatment with attention bias modification. Behav Res Ther. 2016;87:76–108. doi: 10.1016/j.brat.2016.08.001. [DOI] [PubMed] [Google Scholar]
  • 72.Tottenham N, Tanaka JW, Leon AC, McCarry T, Nurse M, Hare TA, et al. The NimStim set of facial expressions: judgments from untrained research participants. Psychiatry Res. 2009;168:242–249. doi: 10.1016/j.psychres.2008.05.006. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from BMC Psychiatry are provided here courtesy of BMC

RESOURCES