Abstract
Background:
Adolescents with anorexia nervosa have set-shifting inefficiencies that can be exacerbated by starvation and that may interfere with outcomes of treatment interventions. Cognitive Remediation Therapy (CRT), an adjunctive treatment focused on improving set-shifting, can target inefficiencies and may augment treatment effectiveness. The best way to add CRT to the standard of care (Family Based Treatment, FBT) for adolescents with anorexia remains understudied.
Methods/design:
This is a randomized controlled trial designed to determine if CRT is effective in increasing flexibility in adolescents with anorexia and/or their parents. Participants are adolescents 12-18 years old with anorexia and their parents. 54 family groups will be randomized into one of three groups: FBT only, FBT plus Parent-focused CRT, or FBT plus Adolescent-focused CRT. Psychosocial, neurocognitive, and behavioral measures will be collected throughout the study.
Discussion:
This is the first study of its kind to apply CRT to parents. All forms of CRT in the context of anorexia have targeted the individual with anorexia’s thinking style. We propose that it may be impactful to target the parent of the adolescent with anorexia as parents carry the burden of treatment and re-nourishment of their child during FBT and may have similar thinking styles.
Conclusion:
This study takes an experimental therapeutics approach to further our understanding of the mechanisms of treatment for adolescents with anorexia. It focuses on increasing cognitive flexibility in patients or their parents and determining the appropriate dose of CRT needed to achieve positive change.
Trial registration:
ClinicalTrials.gov Identifier NCT03928028
Keywords: Cognitive remediation therapy, Anorexia nervosa, Randomized Controlled Trial, Adolescents, Family based treatment, Set Shifting
1.0. Introduction
Anorexia Nervosa (AN) is a restrictive eating disorder characterized by significantly low body weight for one’s developmental history, age, and sex.1 The typical age of onset is during adolescence.2 It is accompanied by significant medical and psychological complications3 and has one of the highest mortality rates of all psychiatric illnesses.4–6 The immediate goal in the treatment of AN is nutritional repletion and weight restoration to reverse physical and cognitive complications associated with malnutrition. Parents take the lead in this process and the treatment team acts as supporting consultants.7–9 During the first phase of treatment, parents temporarily take charge over all food choices as they increase calories and food exposures. As treatment progresses, age-appropriate responsibilities involved in eating are gradually returned to the child in a developmentally appropriate manner, making sure that AN behaviors do not worsen as this occurs. Over time, symptoms of the eating disorder reduce and the adolescent returns to a normal developmental trajectory. Though effective, a significant portion of adolescents do not reach full remission,10 highlighting the need to improve the effectiveness of FBT.
1.1. Targeting Cognitive Flexibility.
Results from studies in adults with AN indicate that they have inefficiencies in executive functioning, specifically set-shifting.11–15 Set-shifting is the ability to switch tasks, shift attention, rapidly adapt to new situations, and respond to new environmental contingencies.16 Set-shifting inefficiencies in adults with AN do not fully improve with nutritional rehabilitation17. Similar inefficiencies are found in siblings and parents of individuals with AN. 11,18–20 Executive functioning is heritable21 and there is preliminary evidence of co-segregation of cognitive inefficiencies in the context of AN.19 We hypothesize that behaviors associated with inefficiencies in set-shifting in either parent or adolescent can maintain AN or interfere with treatment. Addressing cognitive flexibility in the treatment of AN may have a positive impact on outcome by facilitating early changes in flexibility that increase approach behaviors (e.g., eating a wider variety of macronutrients, eating with friends) or decrease avoidant behaviors (e.g., parental accommodation symptoms) leading to a faster rate of weight gain, which has been shown to improve outcomes.22
Cognitive flexibility can be increased by Cognitive Remediation Therapy (CRT), an adjunctive treatment focusing on cognitive skills, particularly skills associated with executive functioning. Previous studies show that CRT positively impacts cognitive flexibility in adults with AN,23–30 yet research on the use of CRT as an adjunctive treatment for adolescents with AN is limited and conflicting.31–37 There is significant gap in our knowledge regarding how best to apply CRT in the treatment of adolescents. Because parents are the implementors of treatment in FBT, it may be that supplementing FBT with CRT for parents has the largest impact on outcome. In this randomized clinical trial, the primary goal is to examine whether or not CRT improves flexibility in the adolescent or their parent. The end goal of this research line is to determine whether or not providing CRT to adolescents with AN or their parents effective in enhancing outcomes in FBT.
2. Materials and Methods
2.1. Trial Design and Purpose
The Shifting Perspectives Study is a first of a series of two randomized controlled trials that take an experimental therapeutics approach as outlined by the NIMH Strategic Plan for Research.38 In this approach, the focus is on malleable etiological or maintenance targets for intervention. If the treatment impacts the hypothesized target, the next step is to evaluate whether or not there is improved outcome in the experimental condition and if this outcome is linked to changes in the target.39
In the Shifting Perspectives Study, cognitive flexibility is the target. It is a putative endophenotype (or intermediate phenotype) for anorexia nervosa11 (thus, trait inefficiencies would be expected in a parent and child) and can be impacted by stress40 and hunger41 (state-based inefficiencies). We hypothesize that CRT will improve cognitive flexibility and that that improvements in flexibility can lead to reductions in avoidance and increases in approach-based motivation. For adolescents, this leads to more frequent social interactions and a greater salience of social reward, which can motivate treatment and increase the likelihood of consuming sufficient and varied nutrients (leading to faster weight gain). In parents, flexibility increases approach-based motivation and decreases avoidance, which in turn increases willingness to conduct exposures with their child and reduces the likelihood of parents accommodating symptoms of the eating disorder – leading to provision of sufficient and varied nutrition. The end result is a greater rate of weight gain for the adolescent accompanied by more behavioral gains in terms of food variety. An added benefit of increasing parental flexibility is that parents model flexibility for the adolescent, who may learn to be more flexible by observing parental behavior. Greater flexibility can lead to reductions in relapse (See Figure 1).
Figure 1. Theoretical Model Depicting the Role of Flexibility in Influencing Outcome.

Note. This figure demonstrates hypothesized mechanisms of Cognitive Remediation Therapy (CRT) leading to increases in food variety and weight gain.
Families are randomized to either Family Based Treatment alone (FBT), FBT + parent focused CRT (CRTp), or FBT + adolescent-focused CRT (CRTA). In line with the experimental therapeutics approach, specific a-priori thresholds are in place for evaluating if flexibility improves (in parents or the adolescent) sufficiently to continue investigating the impact that CRT could have on enhancing outcomes (see Table 1). The aim is to increase flexibility above and beyond what may be observed in FBT alone. The rationale for this is that in adolescents, renourishment alone may lead to improvements in flexibility. For parents, a reduction in stress and caregiver burden as their child recovers may result in improvements in flexibility. Thus, we seek to determine if CRT is truly effective in increasing flexibility above and beyond standard treatment.
Table 1.
Milestone Criteria for Go / No-Go Decision
| Adolescent | Parent | ||
|---|---|---|---|
| Criteria | Effect Size | Criteria | Effect Size |
| FBT + CRT group demonstrates greater improvement than FBT alone group on at least one of the following sub-tests of the Delis Kaplan: | FBT + CRT group demonstrates greater improvement than FBT alone group on at least one of the following subtests of the Delis Kaplan: | ||
| Number-Letter Sequencing | f = 0.40 | Number-Letter Sequencing | f = 0.40 |
| Inhibition | Inhibition | ||
| Inhibition/Switching | Inhibition/Switching | ||
| Correct Response Shifting | Correct Response Shifting Category | ||
| Category Switching | Switching | ||
| Description 1 or 2 | Description 1 or 2 | ||
| FBT + CRT group demonstrates greater improvement than FBT alone group on at least two of the following subtests of the Delis-Kaplan: | FBT + CRT group demonstrates greater improvement than FBT alone group on at least two of the following subtests of the Delis-Kaplan: | ||
| Number-Letter Sequencing | Number-Letter Sequencing | ||
| Inhibition | f = 0.24-0.26 | Inhibition | f =0.24-0.26 |
| Inhibition/Switching | Inhibition/Switching | ||
| Correct Response Shifting | Correct Response Shifting | ||
| Category Switching | Category Switching | ||
| Description 1 or 2 | Description 1 or 2 | ||
| BRIEF Inhibit or Shift | BRIEF Inhibition or Shift | ||
Note. A “Go” decision need only satisfy one of either criteria for both parent and adolescent CRT.
2.2. Aims
The primary aim is to identify whether or not we will see greater improvements in flexibility in adolescents or parents who receive CRT compared to their counterparts who receive FBT alone. A second aim is to determine the dose of CRT needed to increase cognitive flexibility. If we are able to demonstrate significant increases in cognitive flexibility, a second phase of this work will focus on replicating target engagement and dose and establish that there is a better outcome when CRT is added to FBT. The methods for this second phase are identical to the protocol described herein.
2.3. Study Design
The study is a randomized, three group design, single-center clinical trial that commenced in May of 2019, with recruitment starting in August of 2019. Figure 2 depicts the study design layout for each arm. Families receive 15 sessions of manualized FBT and/or CRTP/A over six months. For those in a CRT condition, CRT occurs prior to FBT. Assessment takes place at five different time points (as outlined in Figure 2 and Table 2).
Figure 2.

Study Diagram Depicting Flow of Treatment and Research Activities
Table 2.
Measures and Assessments Administered for Each Outcome
| Outcome Category | Measure | Time Point | ||||
|---|---|---|---|---|---|---|
|
| ||||||
| T1 | T2 | T3 | T4 | T5 | ||
| Target: Cognitive Flexibility | Behavior Rating Inventory of Executive Functioning (BRIEF) | x | x | x | x | |
| Delis-Kaplan Executive Functioning System (DKEFS) | x | x | x | x | ||
| Wechsler Abbreviated Scale of Intelligence | x | x# | ||||
|
| ||||||
| Outcome: Weight & ED Symptoms | Accommodation and Enabling Scale for Eating Disorders (AESED)* | x | x | x | x | x |
| Anorectic Behavior Observation Scale (ABOS)* | x | x | x | x | x | |
| Eating Disorder Examination Questionnaire (EDE-Q) # | x | x | x | x | x | |
|
| ||||||
| Outcome: Behavioral Flexibility | Buffet Challenge# | x | x | x | ||
| Meal Planning / OSOG* | x | x | x | |||
|
| ||||||
| Treatment Credibility & Therapeutic Alliance | Credibility and Expectancy Questionnaire (CEQ) | x | ||||
| CRT Treatment Evaluation Questionnaire (TEQ) | x | |||||
| Working Alliance Inventory (WAI) | x | x | x | x | ||
|
| ||||||
| Comorbid Symptoms & Potential Moderators | Autism Spectrum Quotient* | x | x | x | x | |
| Behavior Assessment System for Children (BASC) | x | x | x | x | x | |
| BIS/BAS | x | x | x | x | x | |
| Depression Anxiety and Stress Scale (DASS) | x | x | x | x | x | |
| Detail and Flexibility Questionnaire | x | x | x | x | x | |
| Eating Disorder Flexibility Index# | x | x | x | x | x | |
| Experience of Caregiving Inventory* | x | x | x | x | x | |
| Family Questionnaire* | x | x | x | x | x | |
| Intolerance of Uncertainty Scale | x | x | x | x | x | |
| Line Bisection Task | x | x | x | x | ||
| Obsessive-Compulsive Inventory | x | x | x | x | x | |
| Parent Versus Anorexia Scale (PVA)* | x | x | x | x | x | |
| Rey-Osterrieth Complex Figure Task (Rey-O) | x | x | x | x | ||
| Social Reward Questionnaire# | x | x | x | x | x | |
= Parent only
= Adolescent Only
2.4. Ethical Considerations
Approval of the study protocol was by Children’s Hospital of Philadelphia Institutional Review Board. Written informed consent for each adolescent study participant is obtained prior to any data collection; parents provide written informed consent for their child and themselves. This study is registered on ClinicalTrials.gov (NCT03928028).
2.5. Setting
This randomized controlled trial takes place in the research arm of the Eating Disorder Assessment at Treatment Program (EDATP) at Children’s Hospital of Philadelphia (CHOP). The EDATP is an interdisciplinary team of core medical, behavioral health, and nutrition staff. The program provides family-based treatment on an outpatient basis. An inpatient medical stabilization unit is available when adolescents have medical complications due to malnutrition.
2.6. Participants and Eligibility Criteria
Participants adolescents aged 12–18 who meet DSM-5 criteria for Anorexia Nervosa and are medically stable for outpatient care. Both biological parents of the adolescent must be willing to participate. Siblings currently living with the participant are asked to attend at least the first four sessions of treatment.
Epidemiological data indicate anxiety, depression, and obsessive compulsive disorder are common among individuals with AN;42–46 in order to increase external validity, individuals with these comorbidities will be included. Likewise, we will not exclude participants for the use of medication, with the exception of atypical antipsychotics (e.g., olanzapine). Atypical antipsychotics are sometimes prescribed to assist in weight gain or to reduce inflexibility and preservative behavior in adolescents with anorexia nervosa.47,48 Any prescribed medications or dosage changes will be tracked throughout the study. Concurrent psychotherapy will not be permitted during the study. Full exclusion and inclusion criteria are in Table 3.
Table 3.
Inclusion and Exclusion Criteria for Parents and Adolescent
| Adolescent | Parent | ||
|---|---|---|---|
|
| |||
| Inclusion Criteria | Exclusion Criteria | Inclusion Criteria | Exclusion Criteria |
| Age = 12-18 Meets DSM-V criteria for Anorexia Nervosa Medically stable for outpatient treatment Fluent in English No co-morbid condition that would exclude participation Medical clearance from primary care physician Biological parents and caregivers who live with adolescent willing to engage in treatment |
Outside of age range Adolescent is adopted Adolescent is pregnant Presence of suicidal ideation, psychosis, bipolar disorder, substance use disorder, autism spectrum disorder, or developmental disability Presence of a brain disorder or injury (such as TBI) that could impact the ability to engage in treatment. Use of anti-psychotic medication |
Age > 18 Child with diagnosis of Anorexia Nervosa Both biological parents willing to participate in treatment Fluent in English Parents will be included if pregnant as neither FBT nor CRT should have iatrogenic effects No co-morbid condition that would exclude participation |
Presence of suicidal ideation, psychosis, bipolar disorder, substance use disorder, autism spectrum disorder, or developmental disability Presence of a brain disorder or injury (such as TBI) that could impact the ability to engage in treatment. Use of anti-psychotic medication |
2.7. Recruitment and Initial Screening
Potential participants are identified during presentation for treatment at CHOP for an eating disorder. This includes during initial hospitalization for medical stabilization, during outpatient intake assessment, or during the initial medical visit and evaluation. Potentially eligible adolescents are flagged by the clinical team and reviewed for eligibility. Those who may be eligible are approached and, if willing, screened for final eligibility. If interested, families are scheduled for a baseline assessment.
3. Procedures
3.1. Randomization and blinding
After consent is obtained and baseline assessment is completed, participants are randomized to one of the three groups: FBT, CRTP, or CRTA. Randomization employs a covariate-adaptive randomization method (using open source free software; OxMaR)49 that ensures an equal distribution of males across the three conditions. Minimization works by re-calculating the probability of allocation to the treatment and control groups after each new participant enters the cohort. The probability of assignment depends on stratification by sex and age (defined by year in school: middle school vs high school) to assure that males have an equal probability of assignment to the different conditions, something that is not guaranteed with simple random assignment. The algorithms for doing this are programmed ahead of time; study team members enter the sex and school level (middle or high) of the participant into the program in order randomize them to groups. After baseline assessment, the study coordinator informs the family and their therapist of their treatment.
Because members of the study team are involved in coding for fidelity of treatment and post-baseline neuropsychological assessments, certain members are blinded to the conditions of the family to ensure bias does not influence the fidelity and/or assessment scores. Two teams are created in which one team knows the conditions of half of the incoming participants, but is responsible for assessing, coding, and scoring for the other half of participants for whom they are blind to their conditions. We have used this method with success in prior research.
3.2. Study measures
Primary outcomes for this study are specifically related to cognitive flexibility and will be assessed via standard neuropsychological assessment and self-report of executive function. However, we also assess credibility of treatment, therapeutic alliance, behavioral outcomes, and symptom change. Table 2 provides a summary of all measures and the timepoints they are administered. Assessments occur at the following times: Baseline (T1), four weeks (T2), 8-10 weeks (T3), 13-15 weeks (T4), and end of treatment (T5).
3.2.1. Credibility of treatment and therapeutic alliance
3.2.1.1. Credibility and Expectancy Questionnaire.50
The CEQ is a six item measure that assess cognitive and affective elements of how much participants believe that their treatment condition will be effective and that they will improve. Three versions of the CEQ are used, each one tailored to the specific treatment being offered (FBT, CRTP, or CRTA). Parents and adolescents complete the CEQ after the first session.
3.2.1.2. Working Alliance Inventory Short Revised (WAI-SR).51
The WAI-SR assesses patient and therapist perceptions of the collaborative helping relationship during treatment. The link between the quality of the working alliance and positive treatment outcomes is well established.52,53 Patients and their parents each complete the twelve-item measure. The therapist completes a ten-item variation, the Working Alliance Inventory Short Revised – Therapist (WAI-SRT), for the family as a whole. The WAI-SR is administered at each time point after baseline.
3.2.2. Target Outcome: Cognitive Flexibility
Cognitive flexibility is assessed via standard neuropsychological assessment and self-report of executive function.
3.2.2.1. The Delis-Kaplan Executive Functioning Scale (DKEFS).54
The DKEFS measures executive functioning valid for individuals ages 8–89 years. It has been validated for use with adolescents with AN and is part of a standardized battery developed to assess neuropsychological functioning in individuals with eating disorders.55,56 For this study, we are using Verbal Fluency, Color-Word Interference, Card Sort, and Trail Making Test. Our primary areas of interest are in the executive functions of inhibition and shifting. Inhibition refers to the ability to stop a response or urge; whereas shifting refers to the ability to stop one response and engage in another, that is, shifting gears. Generally speaking, one needs to inhibit a learned response in order to engage in a different behavioral response. Thus, we are interested in both these elements of flexibility.
3.2.2.2. The Behavior Rating Inventory of Executive Function-2 (BRIEF-2).57
The BRIEF-2 is an ecologically valid measure of executive functioning in everyday life across multiple contexts. It yields scores for behavioral and cognitive flexibility as well as metacognition. It is a strong and reliable predictor behavioral inflexibility, perseveration, and adaptive behavior in a variety of populations.58–60 The BRIEF-2 is available in self-report form for adolescents and adults and a parent report version. In this study, parents will complete the BRIEF-2 about themselves and their child. Adolescents will complete the BRIEF about themselves.
3.2.3. Behavioral Outcome
In order to assess the impact of improved cognitive on behavioral flexibility in a real world and in a disease relevant way, adolescents and parents will be asked to complete menu/food-related tasks at three time points: T1, T4, and T5. Parents will be asked to complete three days’ worth of meal plans for their child with AN and visit an on-line grocery store where they can engage in mock grocery shopping. Adolescents will be asked to serve themselves and eat a meal from a buffet.
3.2.3.1. Buffet Challenge.
The Buffet Challenge is described in detail elsewhere.61 Adolescents are presented with a buffet of food items that represent both “safe” (e.g., salad, no fat yogurt) and “challenge” (e.g., pizza, cookies) foods for adolescents with eating disorders. Food items for the buffet were generated from items in the Food Choice Task.62 and in collaboration with the study dietitian. We chose to present adolescents with actual food items instead of a computerized task as there may be difference between being able to choose more varied food on a computer and actually choosing and consuming foods.
As part of the buffet, adolescents are asked to approach the buffet, serve food, and consume the meal without coaching or support from parents. The meal is videotaped and the following data collected: amount of time to approach buffet, amount of time spent serving food, amount of time eating food, amount of food chosen (weight and calories), macronutrient profile of food chosen, and amount (calories and macronutrients) eaten. We also code for mealtime behaviors reported by Gianini and colleagues63 (e.g., tearing, staring, dissecting).
3.2.3.2. Open Science Online Grocery (OSOG).64
OSOG is a website that mimics an online grocery store. The store contains approximately 11,000 products across various categories (e.g., breads, produce, beverages, snack foods). Each product is an actual product stocked in American grocery stores with the exception of store brand “Howe’s” products. Product nutrition information and price for the version employed in this study were accurate as of February 2018. By clicking “check-out” consumers indicate they have finished their shopping trip. Consumers are not charged for and they do not receive any groceries. The OSOG has a logging framework that allows researchers have a granularity of understanding where users click, spend the most time, or the sequence of additions and removals from the user’s cart. In this study, parents’ food choices in their cart can be analyzed for macronutrient and caloric content. Parents will be asked to do three days of meal planning and then shop for those menus on-line. Although OSOG allows researchers to make a variety of changes to the store, participants see the “default” version which mimics the product categorization and within-page placement of standard American online grocery stores. This version did not contain any front-of-package labels, budget limits, or other custom changes.
3.2.4. Symptom outcome
For eating disorder symptom outcome, we assess weight change over the course of treatment as well as changes in eating disorder cognitions. Weight and height are measured each week. Goal weights represent expected body weight (EBW). EBW is calculated by the study dietician or medical safety officer and is based on historical growth curves, stage of pubertal development, menstrual history for females (including age of menarche, frequency of periods, and weight at last normal period), hormone levels (estradiol for females and testosterone for males) and linear growth potential and/or presence of height stunting. Comparison to prior growth patterns is essential, especially prior to the onset of AN. Therefore, EBW reflects where an individual should plot on a growth curve compared to his/her personal lifetime of growth.
3.2.4.2. Eating Disorder Examination Questionnaire (EDE-Q).91
The EDE-Q is self-report questionnaire based on the Eating Disorder Examination, a semi-structured clinical interview.65 It assesses core symptoms of eating disorders including: dietary restriction, weight, shape, and eating concern. The EDE-Q has four scales assessing each core symptoms area and a global score that is the mean of all four scales.
3.2.4.3. Anorectic Behavior Observation Scale (ABOS).66
The ABOS is a 30-item measure assessing eating disorder behaviors and designed to be completed by caregivers. Items are primarily behavioral in nature. It has a total score and three sub-scales: eating behavior, bulimic-like behaviors; and hyperactivity. A total score can also be generated; scores over 19 are considered clinically significant.
3.2.4. Definition of Remission
Although the aims of this trial do not focus on symptoms, the a priori criteria for remission are adolescents reaching 95% of EBW and EDE-Q scores within one standard deviation of population norms.
3.3. Investigational Intervention
3.3.1. Family Based Treatment.
FBT is a manualized family treatment for adolescents with AN.67 It is effective for children and adolescents aged 12-18. It is a conjoint family treatment with all family members attending all sessions. Both parents (and any additional caregivers such as step-parents and grandparents) are asked to attend. The goal of treatment is return adolescents back to normal physical and psychosocial development via weight restoration and reduction of eating disorder symptoms. The treatment takes place over 3 phases: 1) refeeding and weight restoration; 2) returning control of eating to the adolescent and 3) addressing issues of adolescent development and treatment completion. The primary focus of treatment sessions is to activate and empower the parents of the affected child to restore weight. Secondary goals of FBT include aligning the parental and sibling subsystems and reestablishing healthy adolescent developmental trajectories. We use a standardized 15 session FBT protocol used in prior clinical trials.68
3.3.2. Cognitive Remediation Therapy (CRT)
CRT is an adjunctive intervention focused on improving, remediating, or preventing worsening of executive functioning along with fostering meta-cognition (thinking about how one thinks).69,70 Treatment involves presenting the individual with an assortment of tasks such as geometric figures, illusions, reversing sequences of numbers and letters, completing sorting tasks, and finding various routes on a map. In each task, participants are asked to solve the puzzle or task, reflect on their process in solving it, attempt new ways to approach it, and make connections to real life activities. The focus is on process instead of outcome; a focus that is especially salient for individuals with AN and their parents as CRT guides them away from a perfection-based or task-oriented perspective.71,72 Learning to strengthen meta-cognitive skills and flexibility in a context that is not illness specific allows participants to strengthen new skills that can later be generalized to more emotionally laden situations (such as meal-times). CRT sessions are administered every week to the treatment groups prior to the standard FBT treatment. Unless touched upon by adolescent/parents, the eating disorder is not discussed. Between therapy sessions, homework is assigned so that CRT related tasks can be practiced.
3.3.3. Managing suicidality and medical instability
The clinical trial follows standard operating procedures of the Eating Disorder Assessment and Treatment Program’s outpatient clinic. Using the Columbia Severity Suicide Rating Scale (C-SSRC),73 Lifetime/current is assessed at intake and since last visit is assessed at every clinic appointment. If needed, the adolescent will be hospitalized for monitoring and management. We will assess parents for suicidality using the C-SSRC. Should parents express suicidal ideation, appropriate steps will be taken, including: development of a safety plan, information about suicide prevention hotlines, referral to a provider, and frequent contact with the study team.
Adolescents seen in the trial are required to be followed medically and to allow communication between providers. If weight does not increase or decreases substantially, immediate risk will be assessed using standard clinic protocols. Should hospitalization be required, adolescents will be allowed to return to the study once medically stable. Weight will be measured and the patient will be assessed for eating disorder symptomatology using the short form of the Eating Disorder Examination – Questionnaire74 prior to hospitalization and post-discharge. If at any point during the study an adolescent is no longer appropriate for outpatient treatment (as determined by the Medical Safety Officer), the adolescent will be removed from the study and referred to a higher level of care.
3.3.4. Fidelity and Definition of Treatment Completion
To ensure competent and uniform treatment delivery, treatment sessions are videotaped and a random selection of 20% audiotapes per patient are reviewed for adherence to FBT and the two CRT conditions. Fidelity is assessed using published FBT fidelity measures75 and CRT fidelity measures received from K. Tchanturia (personal communication, May 6, 2019). Therapists who are not adherent will be retrained; if adherence is not reached, they will be removed from the trial. Treatment completion is defined as completing 13 out of 15 sessions.
For families who drop out, we will characterize the reason for drop out via the method proposed by Dejong and colleagues.76 In addition to reporting on the percentage of sessions completed, we will categorize drop out as clinical withdrawal (e.g., recommendation of higher level of care by the treatment team), logistical withdrawal (e.g., change in parent employment that prohibits travel to treatment), progress withdrawal (withdrawal from the study when both clinician and parents agree that treatment goals have been met), patient/parent initiated withdrawal (e.g., desire for individual treatment).
3.4. Missing Data and Missing Sessions
We will make every effort to avoid missing data. Research intake days at baseline and during follow-up sessions involve a full day at our research site, ensuring that ample time is given to complete each of the research measures during the day. Participant reimbursement is given after the completion of research measures for each assessment day. Should the family need to cancel a therapy session or if the therapist is sick for a therapy session, all attempts will be made to reschedule within the week to ensure the family stays on schedule (including seeing another study therapist if needed). If an appointment cannot be rescheduled within the week, the family will have two sessions scheduled the following week. If the missed session falls during the period where sessions occur every two weeks, the missed session can be made up the following week.
For missing data, if assumptions that the pattern of missingness is occurring at random (MAR) appear tenable, then missing data will be imputed prior to analysis using data augmentation procedures.77,78 Data are MAR if systematic differences in the outcome variable between those with missing data and those with complete data can be explained by the observed variables (e.g., participant sex or age).79 The type of missing data80 will be evaluated and the most appropriate method for dealing with it will be chosen (e.g., multiple imputation).
3.6. Planned Analyses
We will use a mixed subjects design to evaluate target engagement. We include 5 different assessment points in the design, though not each time point is used in a given analysis. For example, we only use two time point to establish pre-post change in the dependent variables but use 4/5 assessment points to determine dose. To examine target engagement, we will use a 2 (time) x 3 (treatment) Multivariate Analysis of Covariance (MANCOVA) to establish whether or not flexibility increased over the course of treatment. MANCOVA was chosen due to the number of dependent variables. Prior research from our group indicates that the dependent variables typically correlate around r = 0.3. As IQ is related to executive functioning, it will serve as a covariate. If significant, the MANCOVA will be followed by a series of planned ANCOVAs of FBT vs the appropriate CRT condition. We are interested in how well the CRT condition of interest (adolescent focused CRT + FBT or parent focused CRT+ FBT) performed against FBT alone. FBT alone serves as a control for any gains made in set-shifting due to re-nourishment or maturation (in the adolescent) or reduction in stress due to treatment (in the parents) as well as a control for any practice effects due to multiple administrations of the neuropsychological measures.
Some research indicates that ≥8 sessions of CRT are necessary for improvement in cognitive flexibility with AN.81 It is unknown how many sessions will be needed for significant change in parents of adolescents with AN. To determine optimal dose needed for change in flexibility, we will model change across the 15 sessions using latent growth curve modeling (LGCM). LGCM is a multivariate method that models individual and average trajectory (across time) and model linear and/or quadratic trends. We will visually assess for the point (dose) at which there is a significant decrease in the rate of improvement (quadratic trend). Parameter estimation will employ Maximum Likelihood (ML) estimation.82,83 We will evaluate model fit using chi-square (χ2), Comparative Fit Index (CFI), Standardized Root Mean Squared Residual (SRMR), and Root Mean Squared Error of Approximation (RMSEA).84 We will use the following values as indicative of acceptable fit between the model and the observed data variance/covariance matrixes: CFI, SRMR, and RMSEA, < .95, < .80, and < .05, respectively. We will assess and compare different models using BIC and novel criteria such as Scaled Unit Information Prior BIC.85,86 Examining standardized model residuals in addition to global fit indices (GFI) permits us to identify model misspecification even if GFI values suggest adequate fit.84 For these analyses we will model change for the participant group (adolescent, mother, father) who had significant change in a dependent variable. We will also focus on the dependent variables that increased significantly by end of treatment.
3.6.1. Power analysis.
Our sample size estimation is based on a mixed MANCOVA design with two repeated measures from baseline to end-of-treatment (EOT; within subjects component) and three groups (CRTp, CRTA, and FBT; between subjects component). Based on a review of the literature, we are powering for a medium effect size. Our effect size estimate is Cohen’s f statistic.87 This effect size estimate is a ratio of variation explained to that unexplained by the model (treatment groups), and is expressed as follows: , where ; proportion of variability due to the model.88,89 Heuristics for small, medium, and large effect sizes are .1, .25, and .4, respectively. We selected an alpha of 0.15, given the nature of the study and the difficulty in recruiting participants from a low prevalence condition. Alpha of 0.15 is essential to provide adequate power for this study.90 As any analysis powered for a medium effect will also be powered for a large effect, we only highlight the expected medium effect. For all analyses, we specified an α=0.15, two time points, and a correlation between measures of .3 (based on unpublished data). We focused our power analysis on between and within effects. It is not necessary to examine the interaction. Accounting for a 20% dropout rate, we need a sample of 45 treatment completers in order to conduct the analyses. Thus, we will recruit a total sample of 54. Our power for these analyses varies based on the number of groups and whether or not we are examining between or within group effects. For example, using MANCVOA with three groups, assuming f = .26, we are powered at .664 for between groups and .929 for within groups. Likewise, using ANCOVA to compare two groups and assuming f = .26, we are powered at .616; however, within-group comparisons are powered at .821. If we assume a large effect (which was observed by Harrison and colleagues32 in an open trial of CRT), power estimates range from ,84-.997 with the current sample size.
In order to determine the sample size needed to determine dose, we used Mplus 7.2 software83 and conducted a LGCM Monte Carlo simulation with 1000 replications83,91–93 to determine power to identify CRTP/A dosage based on a half standard deviation increase (rate of change; slope) from baseline (effect size) above FBT. With 15 participants in 3 groups across 5 time points, parameter and standard error bias were ≤ 5%, confidence interval coverage ≥ 90%, and power = 0.59.
Discussion
CRT for AN is an adjunctive intervention designed to target cognitive flexibility and central coherence. It has been delivered in individual,68,72,81,94,95 group,96–100 and family101 and self-help102 formats. The majority of studies examining the use of CRT for adolescents with AN have been pilot and feasibility studies and most have not had a control group. Those that have used a control group have either been in an inpatient setting or used a control group that may have had active components. For example, art therapy has been used in the past as a valid contact control group for adolescents; however, the art therapy manual used in a prior RCT was based on empirical evidence and may have inadvertently fostered set shifting.68 The best way to use CRT to help adolescents is still unknown. Given that neurocognitive inefficiencies are inherited and parents are primarily responsible for treatment, we included a CRT group delivered directly to parents. We hypothesized that increases in flexibility in the parents would facilities delivery of FBT at home. In order to account for any changes that could occur due to brain maturation, we used a minimization procedure to allocate families to conditions. This increased the likelihood that we would have comparable numbers of older and younger adolescents and males and females in each condition. As reduced flexibility could be trait or state-based, we compare FBT+CRTA/P to FBT alone, allowing for us to have more confidence that improvements in the CRT condition(s) above and beyond the FBT condition are due actual improvements in flexibility (and not brain maturation or weight gain in adolescents, or stress reductions in parents).
While we believe that this study fills a key gap in the literature and will help to answer the question of how best to use CRT to help adolescents with AN, this was not the only approach we considered. We explored the possibility of using a family-based CRT or CRT simultaneously delivered to parents and adolescents. In the first scenario, the family would receive CRT as a unit. This has been piloted by another research group,101 and the focus of CRT was primarily the adolescent’s thinking style. We felt that this would not provide the specific and intentional targeting of parental set-shifting. Likewise, a parent assisted CRT (as was piloted in a self-help format) would not target parental thinking style directly – though individuals who received a caregiver assisted self-help version of CRT did note that doing CRT with their parents impacted the caregiver’s thinking style.102 In the second scenario, parents would receive CRT from one therapist while adolescents would simultaneously receive CRT from another therapist, and then the family would join together for FBT (ideally with a different therapist). While this approach to augmenting FBT would allow us to examine the synergistic interaction of parent and child on increases in flexibility, it does not seem feasible for dissemination and scaling up to the clinic. It would require three therapists to deliver the treatment. We feel the design chosen is the most parsimonious way to examine the impact of adding parental CRT to FBT.
Our comparison group is FBT alone, thus the two CRT conditions will have more contact with their therapist than those in the FBT alone condition. We chose not to create a contact control for a number of reasons, 1) it would require two additional groups (contact control for parents and contact control for adolescents) and 2) there is no established inactive contact control group that has face validity, although one group has created a control group specifically for a CRT trial.103 As noted, art therapy has been used in the past; however, whether or not parents would view art therapy as a credible adjunctive treatment for themselves is unknown. Finally, there is no reason to expect that contact with the therapist alone would increase flexibility. Since CRT is being added in order to enhance treatment, we felt that having an FBT alone control group was the most ecologically valid.
This project is the first phase of a two-phase project. We use an experimental therapeutics approach to determine whether or not CRT positively impacts cognitive flexibility in either adolescents with AN or their parents. Given the sample size (N =54), our power is lower than conventional levels for some analyses and at or higher than the standard of .80 for others assuming a medium effect size. Assuming a large effect size, we are sufficiently powered to observe the effect. If we observe a signal (i.e., meet “go” criteria as outlined in Table 1), we will enter the second phase of the project. In this second phase, we will replicate both the increase in cognitive flexibility and the dose needed to achieve this increase using a larger sample size.
COVID-19 Related Changes to Study Protocol
After study recruitment began, a global pandemic interrupted recruitment and prevented our ability to assess and treat participants in person. In order to protect the safety of research participants, all in-person research activities stopped in March of 2020. If procedures could be completed remotely, research activities were allowed to continue. We were able to rapidly move to a telehealth format for both FBT and CRT. Study team members were trained in best practices in telehealth via resources available at CHOP and all treatment was delivered via a secure, HIPPA compliant tele-health platform. FBT has been delivered via telehealth with success in the past,104 and modifications to the protocol were in-line with suggestions regarding remote delivery of FBT.105 To our knowledge, CRT for AN had never been delivered via telehealth prior to this study. In order to complete CRT sessions, materials requiring manipulation were mailed to families at their homes; other materials were made available for download via a study website within one week of cessation of in-person activities. A full description of the transition of CRT to a telehealth format is available.106 Review of videotaped remote sessions indicates that both CRT and FBT continue to be delivered to fidelity remotely.
Assessments were also moved to remote administration. Given the nature of some of the assessments, a number of key measures were not able to be administered remotely and participants could not complete the Buffet Challenge remotely. When permitted, assessments will resume in person, however, all treatment will continue to be delivered remotely in order to reduce heterogeneity in treatment delivery. Upon completion of the study, a full evaluation of missing data will be made and the analysis plan will be updated accordingly.
Summary
The protocol described takes an experimental therapeutics approach to evaluating the impact of adding CRT to FBT in the treatment of adolescents with AN. Working under the assumption that cognitive flexibility will be trait based, impacted by state factors, or a combination of both - we hypothesized that it may be possible that we can have a greater impact on eating disorder outcomes by adding a parent-focused version of CRT to FBT. CRT was developed over 100 years ago to improve functional outcomes in survivors of traumatic brain injuries.107 It has been successfully applied to a number of psychiatric illnesses (e.g., depression,108,109 schizophrenia110–112), and outcomes are typically focused on improvements in daily living and executive functioning. In the context of eating disorders, many researchers focus on the impact that CRT can have on eating disorder outcomes (e.g., weight, eating disorder cognitions).113 We contend that there is likely not a direct effect of CRT and subsequent improvements on eating disorder symptoms, but rather that positively impacting flexibly will lead to changes in other areas (such as approach and avoidance) which can impact eating disorder behavior. This study will allow for us to examine whether or not we see significant improvements in flexibility in either the parent or child. Future work will replicate these findings and begin to examine a serial mediation model of the impact of CRT on eating disorder behavior.
Acknowledgements.
The authors wish to thank Gregory J. Schwarz, PhD for reprogramming of OxMar to allow for randomization to three groups and Kevin Marvel, PhD and the American Astronomical Society for supporting the hosting of the OxMar program.
Research reported in this publication was supported by National Institute of Mental of the National Institutes of Health under award number R61MH119262. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Declaration of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
References
- 1.Association AP. Diagnostic and statistical manual of mental disorders (DSM-5®). Washington D.C.: American Psychiatric Association; 2013. [Google Scholar]
- 2.Swanson SA, Crow SJ, Le Grange D, Swendsen J, Merikangas KR. Prevalence and correlates of eating disorders in adolescents. Results from the national comorbidity survey replication adolescent supplement. Arch Gen Psychiatry. 2011;68(7):714–723. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Peebles R, Sieke EH. Medical complications of eating disorders in youth. Child and Adolescent Psychiatric Clinics. 2019;28(4):593–615. [DOI] [PubMed] [Google Scholar]
- 4.Arcelus J, Mitchell AJ, Wales J, Nielsen S. Mortality rates in patients with anorexia nervosa and other eating disorders: A meta-analysis of 36 studies. Archives of General Psychiatry. 2011;68(7):724–731. [DOI] [PubMed] [Google Scholar]
- 5.Franko DL, Keshaviah A, Eddy KT, et al. A longitudinal investigation of mortality in anorexia nervosa and bulimia nervosa. American Journal of Psychiatry. 2013;170:917–925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Keshaviah A, Edkins K, Hastings ER, et al. Re-examining premature mortality in anorexia nervosa: a meta-analysis redux. Comprehensive psychiatry. 2014;55(8):1773–1784. [DOI] [PubMed] [Google Scholar]
- 7.Lock J An update on evidence-based psychosocial treatments for eating disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology. 2015;44(5):707–721. [DOI] [PubMed] [Google Scholar]
- 8.Loeb KL, le Grange D. Family-based treatment for adolescent eating disorders: Current status, new applications and future directions. International journal of child and adolescent health. 2009;2(2):243. [PMC free article] [PubMed] [Google Scholar]
- 9.Loeb KL, Lock J, Greif R, le Grange D. Transdiagnostic theory and application of family-based treatment for youth with eating disorders. Cognitive and Behavioral Practice. 2012;19(l):17–30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Le Grange D, Lock J, Agras WS, et al. Moderators and mediators of remission in family-based treatment and adolescent focused therapy for anorexia nervosa. Behaviour research and therapy. 2012;50(2):85–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Holliday J, Tchanturia K, Landau S, Collier D, Treasure J. Is impaired set-shifting an endophenotype of anorexia nervosa? American Journal of Psychiatry. 2005;162:2269–2275. [DOI] [PubMed] [Google Scholar]
- 12.Lang K, Stahl D, Espie J, Treasure J, Tchanturia K. Set shifting in children and adolescents with anorexia nervosa: An exploratory systematic review and meta-analysis. International Journal of Eating Disorders. 2014;47(4):394–399. [DOI] [PubMed] [Google Scholar]
- 13.Roberts ME, Tchanturia K, Stahl D, Southgate L, Treasure J. A systematic review and meta-analysis of set-shifting ability in eating disorders. Psychological Medicine. 2007;37(8):1075–1084. [DOI] [PubMed] [Google Scholar]
- 14.Roberts ME, Tchanturia K, Treasure JL. Exploring the neurocognitive signature of poor set-shifting in anorexia and bulimia nervosa. Journal of Psychiatric Research. 2010;44(14):964–970. [DOI] [PubMed] [Google Scholar]
- 15.Tchanturia K, Morris RG, Anderluh MB, Collier D, Nikolaou V, Treasure J. Set shifting in anorexia nervosa: an examination before and after weight gain, in full recovery and relationship to childhood and adult OCPD traits. Journal of Psychiatric Research. 2004;38:545–552. [DOI] [PubMed] [Google Scholar]
- 16.Best JR, Miller PH. A developmental perspective on executive function. Child development. 2010;81(6): 1641–1660. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Kjaersdam Telleus G, Fagerlund B, Jepsen JR, et al. Are Weight Status and Cognition Associated? An Examination of Cognitive Development in Children and Adolescents with Anorexia Nervosa 1 Year after First Hospitalisation. Eur Eat Disord Rev. 2016;24(5):366–376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Tenconi E, Santonastaso P, Degortes D, et al. Set-shifting abilities, central coherence, and handedness in anorexia nervosa patients, their unaffected siblings and healthy controls: exploring putative endophenotypes. The World Journal of Biological Psychiatry. 2010;11(6):813–823. [DOI] [PubMed] [Google Scholar]
- 19.Galimberti E, Fadda E, Cavallini MC, Martoni RM, Erzegovesi S, Bellodi L. Executive functioning in anorexia nervosa patients and their unaffected relatives. Psychiatry Res. 2013;208(3):238–244. [DOI] [PubMed] [Google Scholar]
- 20.Roberts ME, Tchanturia K, Treasure JL. Exploring the neurocognitive signature of poor set-shifting in anorexia and bulimia nervosa. J Psychiatr Res. 2010;44(14):964–970. [DOI] [PubMed] [Google Scholar]
- 21.Friedman NP, Miyake A. Unity and diversity of executive functions: Individual differences as a window on cognitive structure. Cortex. 2017;86:186–204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Doyle PM, le Grange D, Loeb K, Doyle AC, Crosby RD. Early response to family-based treatment for adolescent anorexia nervosa. International Journal of Eating Disorders. 2010;43(7):659-662-. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Tchanturia K, Davies H, Lopez C, Schmidt U, Treasure J, Wykes T. Neuropsychological task performance before and after cognitive remediation in anorexia nervosa: a pilot case-series. Psychol Med. 2008;38(9):1371–1373. [DOI] [PubMed] [Google Scholar]
- 24.Tchanturia K, Lock J. Cognitive remediation therapy for eating disorders: development, refinement and future directions. Curr Top Behav Neurosci. 2011;6:269–287. [DOI] [PubMed] [Google Scholar]
- 25.Davies H, Fox J, Naumann U, Treasure J, Schmidt U, Tchanturia K. Cognitive remediation and emotion skills training for anorexia nervosa: an observational study using neuropsychological outcomes. Eur Eat Disord Rev. 2012;20(3):211–217. [DOI] [PubMed] [Google Scholar]
- 26.Dahlgren CL, Rø Ø. A systematic review of cognitive remediation therapy for anorexia nervosa-development, current state and implications for future research and clinical practice. Journal of eating disorders. 2014;2(1):26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Lindvall Dahlgren C, Ro O. A systematic review of cognitive remediation therapy for anorexia nervosa - development, current state and implications for future research and clinical practice. J Eat Disord. 2014;2(1):26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Tchanturia K, Lounes N, Holttum S. Cognitive remediation in anorexia nervosa and related conditions: a systematic review. Eur Eat Disord Rev. 2014;22(6):454–462. [DOI] [PubMed] [Google Scholar]
- 29.Darcy AM, Fitzpatrick KK, Lock J. Cognitive remediation therapy and cognitive behavioral therapy with an older adult with anorexia nervosa: A brief case report. Psychotherapy (Chic). 2016;53(2):232–240. [DOI] [PubMed] [Google Scholar]
- 30.Leppanen J, Adamson J, Tchanturia K. Impact of Cognitive Remediation Therapy on Neurocognitive Processing in Anorexia Nervosa. Front Psychiatry. 2018;9:96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Dahlgren CL, Stedal K. Cognitive Remediation Therapy for Adolescents with Anorexia Nervosa-Treatment Satisfaction and the Perception of Change. Behav Sci (Basel). 2017;7(2). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Harrison A, Stavri P, Ormond L, et al. Cognitive remediation therapy for adolescent inpatients with severe and complex anorexia nervosa: A treatment trial. Eur Eat Disord Rev. 2018;26(3):230–240. [DOI] [PubMed] [Google Scholar]
- 33.Herbrich L, van Noort B, Pfeiffer E, Lehmkuhl U, Winter S, Kappel V. Follow-up Assessment of Cognitive Remediation Therapy in Adolescent Anorexia Nervosa: A Pilot Study. Eur Eat Disord Rev. 2017;25(2):104–113. [DOI] [PubMed] [Google Scholar]
- 34.Tchanturia K, Giombini L, Leppanen J, Kinnaird E. Evidence for Cognitive Remediation Therapy in Young People with Anorexia Nervosa: Systematic Review and Meta-analysis of the Literature. Eur Eat Disord Rev. 2017;25(4):227–236. [DOI] [PubMed] [Google Scholar]
- 35.van Noort BM, Kraus MK, Pfeiffer E, Lehmkuhl U, Kappel V. Neuropsychological and Behavioural Short-Term Effects of Cognitive Remediation Therapy in Adolescent Anorexia Nervosa: A Pilot Study. Eur Eat Disord Rev. 2016;24(1):69–74. [DOI] [PubMed] [Google Scholar]
- 36.van Noort BM, Pfeiffer E, Lehmkuhl U, Kappel V. Cognitive Remediation Therapy for Children with Anorexia Nervosa. Z Kinder Jugendpsychiatr Psychother. 2015;43(5):351–355. [DOI] [PubMed] [Google Scholar]
- 37.Weinbach N, Perry A, Sher H, Lock JD, Henik A. Weak central coherence in weight-restored adolescent anorexia nervosa: Characteristics and remediation. Int J Eat Disord. 2017;50(8):924–932. [DOI] [PubMed] [Google Scholar]
- 38.Insel TR, Gogtay N. National Institute of Mental Health clinical trials: new opportunities, new expectations. JAMA Psychiatry. 2014;71(7):745–746. [DOI] [PubMed] [Google Scholar]
- 39.Lewandowski KE, Ongur D, Keshavan MS. Development of novel behavioral interventions in an experimental therapeutics world: Challenges, and directions for the future. Schizophrenia research. 2018;192:6–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Pally S Cognitive rigidity as a function of threat. Journal of Personality and Social Psychology. 1955;23(3):346–355. [DOI] [PubMed] [Google Scholar]
- 41.Benau EM, Orloff NC, Janke EA, Serpell L, Timko CA. A systematic review of the effects of experimental fasting on cognition. Appetite. 2014;77:52–61. [DOI] [PubMed] [Google Scholar]
- 42.Hughes EK. Comorbid depression and anxiety in childhood and adolescent anorexia nervosa: Prevalence and implications for outcome. Clinical Psychologist. 2012;16(l):15–24. [Google Scholar]
- 43.Swinbourne JM, Touyz SW. The co-morbidity of eating disorders and anxiety disorders: a review. European Eating Disorders Review. 2007;15:253–274. [DOI] [PubMed] [Google Scholar]
- 44.Kaye WH, Bulik CM, Thornton L, Barbarich N, Masters K, Group TPFC. Comorbidity of Anxiety Disorders With Anorexia and Bulimia Nervosa. American Journal of Psychiatry. 2004;161:2215–2221. [DOI] [PubMed] [Google Scholar]
- 45.Mischoulon D, Eddy K, Keshaviah A, et al. Depression and eating disorders: treatment and course. Journal of affective disorders. 2011;130(3):470–477. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Mandelli L, Draghetti S, Albert U, De Ronchi D, Atti AR. Rates of comorbid Obsessive-Compulsive Disorder in Eating Disorders: a meta-analysis of the literature. Journal of Affective Disorders. 2020. [DOI] [PubMed] [Google Scholar]
- 47.Spettigue W, Buchholz A, Henderson K, et al. Evaluation of the efficacy and safety of olanzapine as an adjunctive treatment for anorexia nervosa in adolescent females: a randomized, double-blind, placebo-controlled trial. BMC Pediatrics. 2008;31(8):4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Spettigue W, Norris ML, Maras D, et al. Evaluation of the Effectiveness and Safety of Olanzapine as an Adjunctive Treatment for Anorexia Nervosa in Adolescents: An Open-Label Trial. Journal of the Canadian Academy of Child and Adolescent Psychiatry. 2018;27(3):197–208. [PMC free article] [PubMed] [Google Scholar]
- 49.O’Callaghan CA. OxMaR: Open source free software for online minimization and randomization for clinical trials. PLoS ONE. 2014;9(10):ell0761. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. Journal of Behavior Therapy and Experimental Psychiatry. 2000;31:73–86. [DOI] [PubMed] [Google Scholar]
- 51.Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the Working Alliance Inventory. Psychotherapy research. 2006;16(l):12–25. [Google Scholar]
- 52.Flückiger C, Del Re AC, Wampold BE, Horvath AO. The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy 2018;55(4):216. [DOI] [PubMed] [Google Scholar]
- 53.Horvath AO. Research on the alliance: Knowledge in search of a theory. Psychotherapy Research. 2018;28(4):499–516. [DOI] [PubMed] [Google Scholar]
- 54.Delis D, Kaplan E, Kramer J. Dells Kaplan Executive Function System. San Antonio: The Psychological Corporation; 2001. [Google Scholar]
- 55.Rose M, Davis J, Frampton I, Lask B. The Ravello Profile: development of a global standard neuropsychological assessment for young people with anorexia nervosa. Clinical child psychology and psychiatry. 2011;16(2):195–201. [DOI] [PubMed] [Google Scholar]
- 56.Stedal K, Frampton I, Landrø NI, Lask B. An examination of the ravello profile—a neuropsychological test battery for anorexia nervosa. European Eating Disorders Review. 2012;20(3): 175–181. [DOI] [PubMed] [Google Scholar]
- 57.Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function, Second Edition. Florida: PAR; 2015. [Google Scholar]
- 58.Bertollo JR, Yerys BE. More than IQ: executive function explains adaptive behavior above and beyond nonverbal IQ in youth with autism and lower IQ. American Journal on Intellectual and Developmental Disabilities. 2019;124(3):191–205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Lantrip C, Isquith PK, Koven NS, Welsh K, Roth RM. Executive function and emotion regulation strategy use in adolescents. Applied Neuropsychology: Child. 2016;5(l):50–55. [DOI] [PubMed] [Google Scholar]
- 60.Løvstad M, Sigurdardottir S, Andersson S, et al. Behavior Rating Inventory of Executive Function Adult Version in patients with neurological and neuropsychiatric conditions: symptom levels and relationship to emotional distress. Journal of the International Neuropsychological Society: JINS. 2016;22(6):682. [DOI] [PubMed] [Google Scholar]
- 61.Timko CA, Mears C, Bhattacharya A, Heckert K, Orloff NC, Peebles R. The Buffet Challenge: A Behavioral Assessment of Eating Behavior in Clinical Trials 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Steinglass J, Foerde K, Kostro K, Shohamy D, Walsh BT. Restrictive food intake as a choice--a paradigm for study. Int J Eat Disord. 2015;48(l):59–66. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Gianini L, Liu Y, Wang Y, Attia E, Walsh BT, Steinglass J. Abnormal eating behavior in video-recorded meals in anorexia nervosa. Eat Behav. 2015;19:28–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Howe HS, Fitzsimons G, Ubel P. Using a Novel Online Grocery Platform to Explore How Front-Of-Package Labeling Affects Consumers’ Food Choice. In: Bagchi R, Block L, Lee LW, eds. NA - Advances In Consumer Research. Duluth, MN: Association for Consumer Research; 2019:291–296. [Google Scholar]
- 65.Fairburn CG, Cooper Z, O’Connor M. Eating Disorder Examination, Edition 17.0D. In:2014. [Google Scholar]
- 66.Vandereycken W Validity and reliability of the Anorectic Behavior Observation Scale for parents. Acta Psychiatrica Scandinavica. 1992;85(2):163–166. [DOI] [PubMed] [Google Scholar]
- 67.Lock J, le Grange D. Treatment Manual for Anorexia Nervosa: A Family-Based Approach. 2nd ed. New York: Guildford Press; 2012. [Google Scholar]
- 68.Lock J, Fitzpatrick KK, Agras WS, Weinbach N, Jo B. Feasibility Study Combining Art Therapy or Cognitive Remediation Therapy with Family-based Treatment for Adolescent Anorexia Nervosa. Eur Eat Disord Rev. 2018;26(l):62–68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Sohlberg MM, Matter CA. Cognitive rehabilitation: An Integrative neuropsychological approach. New York: The Guilford Press; 2001. [Google Scholar]
- 70.Sohlberg MM, Turkstra LS. Optimizing cognitive rehabilitation: Effective instructional methods. New York: The Guildford Press; 2011. [Google Scholar]
- 71.Fitzpatrick KK, Lock JD. Cogntive Remediation Therapy with Children and Adolescents. In: Tchanturia K, ed. Cognitive Remediation Therapy (CRT) for Eating and Weight Disorders. London: Routledge; 2015:111–129. [Google Scholar]
- 72.Timko CA, Goulazian T, Fitzpatrick KK, Rodriguez D. Cognitive remediation therapy (CRT) as a pretreatment intervention for adolescents with anorexia nervosa during medical hospitalization: a pilot randomized controlled trial protocol. Pilot and feasibility studies. 2018;4(1):87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Posner K, Brown GK, Stanley B, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168(12):1266–1277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Gideon N, Hawkes N, Mond J, Saunders R, Tchanturia K, Serpell L. Development and psychometric validation of the EDE-QS, a 12 item short form of the eating disorder examination questionnaire (EDE-Q). PloS one. 2016;ll(5):e0152744. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Forsberg S, Lock J, Le Grange D. Family Based Treatment for Restrictive Eating Disorders: A Guide for Supervision and Advanced Clinical Practice. Routledge; 2018. [Google Scholar]
- 76.DeJong H, Broadbent H, Schmidt U. A systematic review of dropout from treatment in outpatients with anorexia nervosa. International Journal of Eating Disorders. 2012;45(4):635–647. [DOI] [PubMed] [Google Scholar]
- 77.Schafer JL, Graham JW. Missing data: Our view of state of the art. Psychological Methods. 2002;7(2):147. [PubMed] [Google Scholar]
- 78.Scharner S, Stengel A. Alterations of brain structure and functions in anorexia nervosa. Clinical Nutrition Experimental. 2019. [Google Scholar]
- 79.Bhaskaran K, Smeeth L. What is the difference between missing completely at random and missing at random? International journal of epidemiology. 2014;43(4):1336–1339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Park T, Davis CS. A test of missing data mechanism for repeated categorical data. Biometrics. 1993:631–638. [PubMed] [Google Scholar]
- 81.Lock J, Agras WS, Fitzpatrick KK, Bryson SW, Jo B, Tchanturia K. Is outpatient cognitive remediation therapy feasible to use in randomized clinical trials for anorexia nervosa? Int J Eat Disord. 2013;46(6):567–575. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Muthén BO, du Toit SHC, Spisic D. Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. unpublished manuscript. 1997. [Google Scholar]
- 83.Muthén LK, Muthén BO. Mplus User’s Guide. 7th ed. Los Angeles, CA: Muthen & Muthen; 1998–2012. [Google Scholar]
- 84.Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting practices in confirmatory factor analysis: an overview and some recommendations. Psychol Methods. 2009;14(l):6–23. [DOI] [PubMed] [Google Scholar]
- 85.Bollen KA, Kolenikov S, Bauldry S. Model-implied instrumental variable-generalized method of moments (MIIV-GMM) estimators for latent variable models. Psychometrika. 2014;79(l):20–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Duncan TE, Duncan SC. Modelling the process of development vai latent variable growth curve methodology. Struct Equ Modeling. 1995;2:187–213. [Google Scholar]
- 87.Cohen J Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988. [Google Scholar]
- 88.Faul F, Erdfelder E, Buchner A, A. L.Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behaviour Research Methods. 2009;41(1149–1160). [DOI] [PubMed] [Google Scholar]
- 89.Faul F, Erdfelder E, Lang ABA. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavioral Research Methods,. 2007;39(175–191). [DOI] [PubMed] [Google Scholar]
- 90.Pituch KA, Stevens J. Applied multivariate statistics for the social sciences: Analyses with SAS and IBM’s SPSS .:Routledge; 2015. [Google Scholar]
- 91.Duncan TE, Duncan SC, Strycker LA. An introduction to latent variable growth curve modeling: concepts, issues, and applications . (2nd Ed.).Mahway, NJ.: Lawrence Erlbaum Associates; 2006. [Google Scholar]
- 92.Muthen B, Brown CH, Masyn K, al. e.General growth mixture modeling for randomized preventive interventions. Biostatistics. 2002;3(4):459–475. [DOI] [PubMed] [Google Scholar]
- 93.Muthen LK, Muthen BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Modeling. 2002;9(4):599–620. [Google Scholar]
- 94.Giombini L, Nesbitt S, Waples L, Finazzi E, Easter A, Tchanturia K. Young people’s experience of individual cognitive remediation therapy (CRT) in an inpatient eating disorder service: a qualitative study. Eat Weight Disord. 2017. [DOI] [PubMed] [Google Scholar]
- 95.Giombini L, Moynihan J, Turco M, Nesbitt S. Evaluation of individual cognitive remediation therapy (CRT) for the treatment of young people with anorexia nervosa. Eat Weight Disord. 2017;22(4):667–673. [DOI] [PubMed] [Google Scholar]
- 96.Kuge R, Lang K, Yokota A, et al. Group cognitive remediation therapy for younger adolescents with anorexia nervosa: a feasibility study in a Japanese sample. BMC Res Notes. 2017;10(1):317. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Tchanturia K, Larsson E, Brown A. Benefits of group cognitive remediation therapy in anorexia nervosa: case series. Neuropsychiatr. 2016;30(l):42–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Pretorius N, Dimmer M, Power E, Eisler I, Simic M, Tchanturia K. Evaluation of a cognitive remediation therapy group for adolescents with anorexia nervosa: pilot study. Eur Eat Disord Rev. 2012;20(4):321–325. [DOI] [PubMed] [Google Scholar]
- 99.Wood L, Al-Khairulla H, Lask B. Group cognitive remediation therapy for adolescents with anorexia nervosa. Clinical child psychology and psychiatry. 2011;16(2):225–231. [DOI] [PubMed] [Google Scholar]
- 100.Genders R, Tchanturia K. Cognitive remediation therapy (CRT) for anorexia in group format: a pilot study. Eat Weight Disord. 2010;15(4):e234–239. [DOI] [PubMed] [Google Scholar]
- 101.Lask B, Roberts A. Family cognitive remediation therapy for anorexia nervosa. Clin Child Psychol Psychiatry. 2015;20(2):207–217. [DOI] [PubMed] [Google Scholar]
- 102.Lang K, Treasure J, Tchanturia K. Acceptability and feasibility of self-help cognitive remediation therapy for anorexia nervosa delivered in collaboration with carers: A qualitative preliminary evaluation. Psychiatry Research. 2015;225(3):387–394. [DOI] [PubMed] [Google Scholar]
- 103.van Passel B, Danner U, Dingemans A, et al. Cognitive remediation therapy (CRT) as a treatment enhancer of eating disorders and obsessive compulsive disorders: study protocol for a randomized controlled trial. BMC Psychiatry. 2016;16(1):393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Anderson KE, Byrne CE, Crosby RD, Le Grange D. Utilizing telehealth to deliver family-based treatment for adolescent anorexia nervosa. International Journal of Eating Disorders. 2017;50(10): 1235–1238. [DOI] [PubMed] [Google Scholar]
- 105.Matheson BE, Bohon C, Lock J. Family-based treatment via videoconference: Clinical recommendations for treatment providers during COVID-19 and beyond. International Journal of Eating Disorders. 2020;53(7):1142–1154. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Orloff NC, McGinley K, Benner E, Lenz K, Mack A, Timko CA. Delivering Cogntive Remediation Therapy for adolescnets with anorexia nervosa via telehealth. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Boake C A history of cognitive rehabilitation of head-injured patients, 1915 to 1980. The Journal of Head Trauma Rehabilitation. 1989;4(3):l-8. [Google Scholar]
- 108.Bowie CR, Gupta M, Holshausen K, Jokic R, Best M, Milev R. Cognitive remediation for treatment-resistant depression: effects on cognition and functioning and the role of online homework. The Journal of nervous and mental disease. 2013;201(8):680–685. [DOI] [PubMed] [Google Scholar]
- 109.Porter RJ, Bowie CR, Jordan J, Malhi GS. Cognitive remediation as a treatment for major depression: a rationale, review of evidence and recommendations for future research. Australian and New Zealand Journal of Psychiatry. 2013;47(12):1165–1175. [DOI] [PubMed] [Google Scholar]
- 110.Anaya C, Aran AM, Ayuso-Mateos JL, Wykes T, Vieta E, Scott J. A systematic review of cognitive remediation for schizo-affective and affective disorders. Journal of affective disorders. 2012; 142(1): 13–21. [DOI] [PubMed] [Google Scholar]
- 111.Best MW, Bowie CR. A revew of cognitive remediation approaches for schizophrenia: from top-down to bottom-up, brain training to psychotherapy. 2017.2017;17(7):713–723. [DOI] [PubMed] [Google Scholar]
- 112.Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P. A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. American Journal of Psychiatry. 2011;168(5):472–485. [DOI] [PubMed] [Google Scholar]
- 113.Hagan KE, Christensen KA, Forbush KT. A preliminary systematic review and meta-analysis of randomized-controlled trials of cognitive remediation therapy for anorexia nervosa. Eating Behaviors,. 2020;37:101391. [DOI] [PMC free article] [PubMed] [Google Scholar]
