Abstract
Purpose
Noonan syndrome (NS) is a genetic disorder that is associated with social cognitive problems. While treatment aimed at the improvement of social cognition is available for other neuropsychiatric disorders, no such interventions yet exist for NS patients. In this study, the development of the first social cognitive training for NS patients is described and its applicability and feasibility evaluated.
Methods
Eleven adult patients with NS participated in this controlled proof-of-principle study. Six patients were included in the treatment group and five in the control group. Neuropsychological testing was performed in both groups at baseline and posttreatment. Social cognition was a primary outcome measure and nonsocial cognition and psychopathology secondary outcome measures. Differences between pre- and posttest were investigated with Wilcoxon signed-rank tests, and a process evaluation was performed to aid interpretation of the results.
Results
Both groups were comparable with regard to age, estimated intelligence, and baseline performance. Although no significant differences were found between pre- and posttest scores on primary and secondary outcome measures in either group, a medium–large effect size was found on emotion recognition in the treatment group. Also, the process evaluation demonstrated the feasibility of the training.
Conclusion
This first social cognitive training for adult patients with NS has proven to be feasible for this population and showed some encouraging results regarding emotion recognition, although the training protocol could be optimized. Further investigation is required using a randomized controlled design in a larger sample, in order to substantiate the overall effectiveness of the training.
Keywords: social cognition, alexithymia, cognition, social cognitive intervention, genetic syndrome
Introduction
Noonan syndrome (NS) is an autosomal-dominant genetic disorder characterized by distinctive facial features, congenital heart disease, short stature, and varying degrees of developmental delay. Other features include chest deformities, a broad or webbed neck, cryptorchidism, coagulation defects, and lymphatic dysplasia.1,2 The estimated prevalence is one in 1,000–2,500 live births.3 NS is caused by germ-line mutations encoding components of the Ras–MAPK pathway, a signal-transduction cascade involved in several developmental processes, such as cell-cycle regulation, differentiation, growth, apoptosis, and cell senescence.2,4 NS is one of the “RASopathies”, referring to a class of related developmental disorders that are caused by gene mutations, resulting in dysregulation of the Ras–MAPK pathway.5 To date, mutations in 17 genes have been associated with NS, of which those in PTPN11 (50%), SOS1 (10%), and RAF1 (10%) are most frequently identified.6 In approximately 75% of patients with NS, a genetic mutation can be identified, although diagnosis is still primarily based on clinical criteria.7–9
In children with NS, difficulties have been found in several cognitive domains, ie, language, motor function, attention, executive function, and social cognition.10 Regarding the cognitive profile of adults with NS, (low) average intelligence and lowered speed of information processing were found in comparison to matched controls.11 Performance on other cognitive domains, such as memory, executive functioning, and visuoconstruction, seems to be relatively intact in adulthood, although patients report subjective executive problems.11 With regard to social cognition – the mental processes underlying social functioning12 – in adults with NS, difficulty in identifying and describing one’s own emotional feelings (ie, higher levels of alexithymia), slight overall problems in facial emotion recognition and social discomfort have been described.13 Alexithymia (from Greek for ‘no words for emotions’) is a dimensional personality trait, reflecting weaknesses in cognitive processing and regulation of one’s own emotions. Alexithymia is characterized by difficulties in identifying and describing feelings, limited imaginal capacity, and an externally oriented cognitive style.20 In a variety of clinical and healthy populations, alexithymia has been related to social cognitive impairments, such as problems in the automatic processing of emotional stimuli, affect recognition, empathy, and mentalizing.65–76 Studies on a behavioral level in patients with NS showed higher prevalence of autism traits and weaker social skills, although it should be noted that these studies focused predominantly on children and only two included a (normally developing) control group.14–17 Even though only a few studies have investigated the presence of psychiatric disorders in adults with NS, mood and anxiety problems are suggested to be rather frequent.3,18,19 Despite the mental health risks associated with social cognitive impairments and alexithymia,12,20 no social cognitive intervention incorporating alexithymia training is yet available for patients with NS.
Various social cognitive interventions have demonstrated improvements in social cognition in adult neuropsychiatric patients (ie, patients with schizophrenia-spectrum disorders, autism-spectrum disorders, and acquired brain injury).21 These treatments included targeted interventions, focusing on one social cognitive subdomain, eg, emotion recognition or theory of mind (ToM), comprehensive interventions that addressed more than one social cognitive subdomain, eg, emotion recognition and ToM training, and broad-based interventions in which social cognition training was embedded in the context of other interventions, such as neurocognitive remediation or social skill training. In general, these social cognitive interventions were most effective in improving emotion perception, but ToM, social perception, and social functioning could also be trained effectively. Training of emotion perception appears to be an important component of effective social cognitive interventions, while addressing social functioning and providing sufficient practice opportunities in daily life are beneficial for generalization.21 Some well-described social cognitive interventions for various neuropsychiatric disorders include social cognition and interaction training,22 treatment of affect recognition,23 cognitive enhancement therapy,24 and treatment for impairments in social cognition and emotion regulation.25 Several social cognitive interventions exist for children with autism-spectrum disorder, but well-studied treatments for adults are scarce, although results seem promising.21,26 Given the fact that alexithymia is related to social cognitive difficulties, it is remarkable that social cognitive interventions for neuropsychiatric disorders do not address alexithymia.
Almost four decades ago, Krystal27 recommended the use of specific therapeutic techniques in alexithymic patients, such as making patients aware of their alexithymic problems and emotional feelings, developing affect tolerance, and providing psychoeducation regarding emotions (ie, their signal function, duration, and intensity), and helping patients to recognize and verbalize their emotions. A more recent narrative review on psychological interventions aimed at reducing alexithymia in psychiatric, medical, and healthy populations suggests that alexithymia is partly modifiable and that reductions in alexithymia scores can be obtained when alexithymia is directly trained.28 Some studies have used relaxation techniques and mindfulness to diminish stress levels and increase awareness of inner experiences and physical sensations.29–31 Psychoeducation regarding emotions and their function, as well as the identification of antecedents of alexithymia (eg, emotional expression in family of origin), have also been described.30–32 Since alexithymia is correlated with decrements in emotion recognition, many alexithymia interventions incorporate training of emotion perception, identification, and differentiation.29–33 Mentalizing and differentiating bodily feelings, thoughts, emotions, and behavior have also been addressed.31,32 In order to improve verbalization of emotions, training affect labeling, extension of the “emotional vocabulary”, and training of self-expression skills are used.31–33 Listening to music, creating fantasy stories, creative writing, noting dreams, reading literary fiction, or creating poetry can stimulate fantasizing.29,34 Lastly, Taylor and Bagby20 suggested that alexithymia interventions are preferably provided in a group-therapy setting, because a group offers relevant interpersonal practice. However, they suggest that the groups should be small and consist of no more than three patients.
Because the existing social cognitive treatments do not incorporate alexithymia training, they are not completely suitable for NS patients, in whom specific difficulties in the identification and verbalization of their own emotions have been demonstrated. For this reason, a social cognitive training was developed, based on the promising results of previous social cognitive and alexithymia interventions and tailored to the specific (social) cognitive profile of adult patients with NS. The training consists of ten weekly group sessions comprising the three phases of social cognition: perception of one’s own emotions and the emotions of others, interpretation and integration of socially relevant information, and execution and regulation of social behavior.35 In this proof-of-principle study, the development, applicability, and feasibility of the new training protocol will be described in a group of patients with NS in comparison to an NS control group. Social cognition, operationalized by the three aforementioned phases of affective information processing, was a primary outcome measure. Given the cognitive profile of patients with NS and relation with social cognition, nonsocial cognition (speed of information processing, inhibition, planning abilities), psychopathology ([social] anxiety, depression), quality of life, and self-efficacy were the secondary outcome measures.
Methods
Design and procedure
Pilot sessions of the training were held at meetings of the Dutch Noonan Syndrome Foundation to investigate both interest and support for a social cognitive training, as well as to obtain input from patients and their relatives regarding important aspects of everyday functioning, eg, inclusion of training partners. Subsequently, a training protocol was designed by RR and EW, including important elements of evidence-based social cognitive interventions (eg, training of emotion recognition, ToM, social behavior) and exercises from alexithymia treatments. This resulted in a structured, 10-week group intervention of 90-minute sessions in which the three phases of social cognition were addressed (perception, interpretation, and reaction). The training protocol included psychoeducation and in-session exercises, incorporating emotion-recognition training, ToM and mentalizing strategies, and exercises to improve identification, labeling, and expression of (own) emotional feelings (see Table 1 for topics and content per session). Participants also performed homework exercises aimed at increasing awareness of one’s own emotional feelings and social behavior and allowed them to practice with the training topics. Each training session was structured similarly, starting with the evaluation of homework exercises, psychoeducation concerning a social cognitive phase and/or subdomain, practice in the group, and introducing new homework. The group size was intentionally limited, with a maximum of five patients per group. Participants were asked to select a training partner, who was invited for two training sessions and performed homework exercises with the patients, in order to provide practice opportunities in daily life.
Table 1.
Session | Topic | Content |
---|---|---|
1 | Introduction | Identification of treatment aims Psychoeducation on social cognition (perception, interpretation, and reaction) in NS Relaxation exercise |
Perception | ||
2 | Emotion perception in other people | Psychoeducation on emotions and emotion perception in others Exercises aimed at emotion perception via different modalities |
3 | Perception of own emotions | Introduction of emotion word of the day (repeated exercise) Psychoeducation on (affective) alexithymia Exercises regarding the identification of emotional feelings and mindfulness |
4 | Training partner session (with patients) | Psychoeducation on social cognition (in NS) Providing information regarding the training and the role of training partners |
Interpretation | ||
5 | Theory of mind/perspective taking | Psychoeducation on analyzing emotions, mentalizing, theory of mind, and perception of social information Exercises aimed at the perception of social faux pas, perspective taking, and social context |
6 | Theory of mind/perspective taking | Psychoeducation on perspective taking and attributional biases Exercises concerning perspective taking, theory of mind, attributional biases, and social faux pas |
Reaction | ||
7 | Alexithymia | Psychoeducation on (cognitive) alexithymia, emotion regulation, and inhibition Exchanging emotion-regulation strategies (coping with emotions) in family of origin Exercises aimed at extending the emotional vocabulary and alternative ways of expressing emotions |
8 | Alexithymia | Psychoeducation on coping strategies (reappraisal, acceptance, and action) Exercises regarding emotional expression |
9 | Recapitulation | Summary of training information Evaluation of individual treatment aims Exercises concerning emotional expression and repeating exercises from previous phases |
10 | Evaluation with training partners and patients | Summary of training information Evaluation of individual mood boards (personal, nonverbal expression of the six basic emotions) Evaluating the role of training partners and treatment aims |
Abbreviation: NS, Noonan syndrome.
The current study had a controlled pre- vs posttest within-subject design with a treatment group and a control group. Patients in the control group received treatment as usual (eg, psycho-education, psychological counseling, consultation with general practitioner and/or medical specialist). Before and after training, a neuropsychological test battery, including several (social) cognitive tasks and self-report questionnaires, was administered in both groups. The primary outcome measures reflected all three phases of affective information processing, thus including emotion recognition, ToM, social perception, alexithymia, and social behavioral problems. As secondary outcome measures, subjective and objective measures of nonsocial cognition, psychopathology, quality of life, and self-efficacy were included. Proxies of patients in the treatment group were asked to complete two questionnaires as well. Training sessions were held at a central location in the Netherlands within an acceptable travel distance for all participants. For patients in the treatment group, pre- and posttests were planned at the same location and combined with the first and the last training session, if possible. Participants in the control group were tested at a location of their preference. However, most testing took place at the same location as for the treatment group and at about the same time. Control participants received a gift voucher as compensation for their travel expenses. Further information regarding the procedure is provided in the process analysis in Table 2.
Table 2.
Process components | Findings |
---|---|
Study population | 1. Recruitment and selection rate |
1a. Number of eligible persons in screened population Fifty-five patients from the Department of Clinical Genetics of Radboud University Medical Center and all contributors to the Dutch Noonan Syndrome Foundation were contacted by letter or email with information regarding the training. This information was also displayed on the websites of the Centre of Excellence for Neuropsychiatry of the Vincent van Gogh Institute for Psychiatry and the Dutch Noonan Syndrome Foundation and presented in newsletters and at meetings of the Dutch Noonan Syndrome Foundation. In total, approximately 150 patients were approached, of whom a maximum 25% were thought to be eligible, because children and adolescents aged <16 years, adult patients without social cognitive complaints, or patients who were not interested in this intervention were not eligible for participation. | |
1b. Number of participants from sample of eligible persons Initially, 15 patients were interested in participating in the training. Five patients were excluded due to age (<16 years) or low verbal intelligence. Four other patients were eligible for inclusion but did not (yet) participate, because they could not combine the training with current work or study obligations or because they did not respond to invitations. Given the small number of patients who volunteered, it was not possible to allocate patients randomly to a treatment group and a waiting-list control group. Therefore, control participants were actively recruited at meetings of the Dutch Noonan Syndrome Foundation, and five patients were included in the control group. The control group did not follow the training at a later point in time. One patient of the control group subsequently participated in the training. No pre-or posttest information was obtained from this participant after the training because they had already been included in the control group and repeated neuropsychological assessment after participation in the training would have affected the results. The training was provided in two treatment groups (n=4 and n=3), which started consecutively. In sum, 11 patients were included in this study: six in the treatment group and five in the control group. | |
1c. Number of participants vs aimed-at number The aim was to include 20 patients (ten in the treatment group and ten in the control group). The recruitment objective was not reached. | |
2. Barriers and facilitators in recruitment and selection | |
2a. Difference in baseline characteristics between nonparticipating and participating eligible persons No information was available regarding differences between participating and nonparticipating eligible patients. There were no significant differences in demographics or baseline variables between the control group and treatment group, although this could reflect a power problem due to the small study sample size. Because the groups could not be allocated randomly, a selection bias might be present, as patients with more severe social cognitive deficits may be more inclined to participate in the treatment group. | |
2b. Motivation of nonparticipating and participating eligible persons Some patients who were initially interested in the training could not make the required time investment in combination with current work or study activities. There also seemed to be some hesitation for participation in group training. Possibly, the nature of the (social) cognitive problems of patients with NS could provide an explanation for these findings. | |
2c. Experience with recruitment and selection Although there appeared to be much interest for the social cognitive training, the number of patients that volunteered in the feasibility study was lower than expected. | |
3. Number of participants completing follow-up vs number started | |
3a. All participants completed the neuropsychological measures at pre- and posttest. However, not all self-report and proxy questionnaires were returned. | |
4. Barriers to and facilitators of follow-up | |
4a. Reasons for dropout and motivation for continued participation There were no dropouts. All participants in the treatment group completed the training and wanted to improve their social cognitive functioning. Patients in both groups valued the importance of this study to increase the treatment options for patients with NS and were driven to contribute. | |
Complex intervention | 1. Quality of delivery of the interventional components |
1a. Part of each component and complete intervention delivered by instructors All three phases of the intervention (perception, interpretation, reaction) were delivered successfully. The number and difficulty of exercises could be adjusted flexibly to the level of social cognitive functioning of the group or to individual participants. | |
1b. Satisfaction with delivery All phases appeared to be feasible. It was observed that participants were inclined to spend a lot of time on sharing their experiences at the expense of practicing social cognitive exercises. A possible explanation for this observation could be that patients with NS seldom met other patients and enjoyed exchanging experiences. However, it could also reflect avoidance of (possibly distressing) exercises or be the result of verbosity, due to executive difficulties. The time spent on psychoeducation could be shortened in favor of more (group) exercises. The training initially incorporated one proxy session without participants and one evaluation session with proxies and participants together. After evaluation of the first training group, both proxy sessions were provided in the presence of the participants. | |
2. Barriers and facilitators for delivery of interventional components | |
2a. Reasons for diverging from or applying (planned) components The three phases of the training were all delivered, although the exercises were slightly adjusted to the level of social cognitive functioning of the group. Despite differences in intellectual capacities and education level, participants had comparable training aims and found many similarities between one another’s social cognitive difficulties. | |
3. Adherence to interventional components | |
3a. Number of sessions followed Three participants (50%) followed all sessions. One participant missed one-and-a-half sessions due to problems with public transport. Two participants missed two sessions, because of work-related activities or health issues. When sessions were missed, participants received the information and exercises of that week by email, studied them independently, and had the opportunity to ask questions via email or telephone. On average, less than one session was missed (mean 9.08±1.02 sessions). Not all training partners attended both proxy sessions, due to the required time investment, work obligations, or cognitive difficulties. | |
3b. Intervention components (partly) followed The participants received all three training phases. | |
3c. Compliance with individual recommendations Individual recommendations were followed up. | |
3d. Homework adherence All participants did homework exercises, although some needed additional guidance or support. The number and nature of the homework exercises slightly differed each week. Some patients viewed the number of exercises as too many. Also, there seemed to be a tendency to avoid exercises with training partners. Some proxies were thus less involved in the training than intended. Adequate involvement of a training partner seemed to be supportive and beneficial for the participant. | |
4. Barriers and facilitators for adherence to interventional components | |
4a. Motivation for (lack of) attendance and compliance Patients appeared motivated to attend the training. They valued the importance of the training and seemed to enjoy the sessions. | |
5. Experience of participants and instructors with interventional components | |
5a. Perceived benefit All participants reported that they benefited from the training. They mentioned, eg, an increased awareness of social cognitive difficulties (related to NS) and the acquisition of useful strategies to improve social cognitive functioning in daily life. In addition to the content of the training, participants seemed to benefit from recognition of one another’s experiences and the support from their group members. For some participants, this training was the first time they had come in contact with other patients with NS. Patients also mentioned that the training was intensive and demanding with regard to emotional load and time investment required. Two participants suggested more time and elaboration, eg, on social rules and social interaction. Furthermore, it was suggested by one participant that it be stated more clearly that the homework exercises could be time-consuming and to provide a contact person who patients could reach when they felt worse or relapsed. Three of the training partners who evaluated the training posttest felt that the participants benefited from the training. The training partners judged the proxy sessions as sufficient in frequency, although one partner mentioned that more proxy sessions were preferred. For the three other patients, no evaluative information was provided by their training partners. On average, general satisfaction with the training, evaluated by five participants in the treatment group, was judged as 8.9 (ranging from 0 to 10). Satisfaction with the therapeutic relationship 7.8, satisfaction with aims and topics of training 7.6, and satisfaction with approach and methods 8.4. | |
5b. Strong and weak aspects of the interventional components (structure and content) and the total intervention Strong aspects of the training concerned its (small) group-based format, in which patients learned from each other’s experiences, increased their awareness of social cognitive difficulties, and were able to practice learned strategies. The training stimulated three participants for additional psychotherapy to continue practicing with the training topics. For two patients, information and elements from the training were incorporated into already-existing coaching or counseling trajectories. In addition, patients used the psychoeducation provided during the training to inform other people (eg, healthcare professionals or family members) or in cases of relapse. Every 6 months, participants were invited to follow up evaluation-group sessions at meetings of the Dutch Noonan Syndrome Foundation. If patients were not able to participate in this session, individual (telephone) contact was offered. Besides the small sample, a weak aspect of the training may be the slight imbalance between time spent on psychoeducation and discussion of social cognitive complaints and the amount of practice time. More concise and practical psychoeducation in combination with additional exercises may be helpful. Also, some training partners were less involved in the training than intended. | |
Evaluation data | 1. Outcome measure: coverage of interventional components |
1a. Average number of outcomes per component Primary outcome measures covered all three phases of social cognition that were addressed in the training: perception (Emotion Recognition Task and alexithymia questionnaire), interpretation (social perception task, theory-of-mind task, and alexithymia questionnaire), and reaction (questionnaire of social behavioral problems and alexithymia). The five secondary outcome measures concerned nonsocial cognition (speed of information processing, inhibition, and planning), psychopathology ([social] anxiety and mood problems), quality of life, and self-efficacy. | |
2. Completeness of data collection | |
2a. Number and characteristics of missing data Neuropsychological test data were complete. With regard to the questionnaires, for one patient in the treatment group the BVAQ and DEX-SC were missing posttest, while the SIB was missing both pre- and posttest in this individual. For one control participant the BVAQ, DEX-SC, and SIB were missing. One individual in the treatment group missed one page of the questionnaire book, which was replaced with the pretest scores. In addition, there were nine incidental missing data points (five in the treatment group and four in the control group): six at pretest and three at posttest. Most missing data were on the BVAQ, SIB, and DEX-SC. If it was not possible to recontact participants, incidental missing data points were replaced with the score at pre- or posttest (depending on which score was missing) or with the average score on other items of that questionnaire. When two answers were given, the average score was calculated. | |
3. Barriers to and facilitators of data collection | |
3a. Feasibility of outcome measures The test battery lasted approximately 2 hours but was not considered too long by participants. Questionnaires were filled out mostly at home, which possibly led to a lower response rate. Three participants in the treatment group reported trouble with some of the questionnaires, and one received help from a friend. One proxy had difficulty filling out the questionnaires and thus did not complete the posttest. | |
3b. Reasons data were missing Reasons for attrition in returning the questionnaires at posttest were difficulty with completing the questionnaires, lack of supervision while filling out the questionnaires, psychosocial problems, and unfortunate practical complications with mail-order services. | |
3c. Reasons participants were excluded from analysis There were no participants excluded from analyses for reasons other than missing data. With regard to heterogeneity in patient characteristics in this sample, outliers could be present. However, for the purpose of this feasibility study, all data were included. | |
4. Comparison of qualitative and quantitative effectiveness data The perceived benefit by patients and training partners was not reflected by the quantitative data. Finding no significant improvement on primary or secondary outcome measures may be the result of a power problem due to the small sample. Furthermore, it is possible that some tests in the current battery were not able to detect differences adequately between pre- and posttest. |
Abbreviations: BVAQ, Bermond–Vorst Alexithymia Questionnaire; DEX-SC, Dysexecutive Questionnaire – social conventions; NS, Noonan syndrome; SIB, Scale for Interpersonal Behavior.
Participants
Eleven patients with NS participated in this study. Four more patients were eligible for inclusion, but did not participate, due to current work or study obligations or nonresponse. Due to the small number of patients who volunteered to participate in the training study, it was not possible to allocate patients randomly to the treatment and control conditions. The treatment group consisted of six patients, who followed the training in two consecutive groups. The control group comprised five patients. Participants were recruited by the Centre of Excellence for Neuropsychiatry of Vincent van Gogh Institute for Psychiatry, the Department of Medical Genetics of Radboud University Medical Center, Nijmegen, and the Dutch Noonan Syndrome Foundation. Written informed consent was obtained, and the study was approved by the Institutional Review Board of Vincent van Gogh Institute for Psychiatry, in accordance with the Declaration of Helsinki.
Inclusion criteria were a confirmed clinical diagnosis of NS or other RASopathy, minimum age of 16 years, and sufficient verbal capacities estimated during the intake procedure by two neuropsychologists (RR and EW). The presence of subjective or objective social cognitive impairments was required for participation in the treatment group. More information regarding the recruitment and inclusion procedures is presented in Table 2.
The mean age in the treatment group was 47.7 years (SD 12.8, range 29–60) and 35.8 years in the control group (SD 9.8, range 23–46). Mean IQ, estimated by the Dutch version of the National Adult Reading Test (NART),36 was 85.33 in the treatment group (SD 17.86, range 69–113) and 83.40 (SD 17.59, range 55–103) in the control group. Education level, according to the Dutch educational system and ranging from category 1 (<6 years of primary education) to 7 (academic degree),37 varied from 3 to 7 in the treatment group (mode 4) and from 2 to 5 in the control group (mode 5). In the treatment group, 17% of the participants were men, while in the control group 60% men were included. Half the participants in the treatment group had a mutation in the PTPN11 gene compared to 40% in the control group. One patient in the treatment group was diagnosed with NS with multiple lentigines and one patient in the control group with NS with loose anagen hair. After a Mann–Whitney U test, there appeared to be no significant differences between the treatment group and the control group with regard to NART IQ (treatment median 78, control median 85, U=13, z=−0.37, r=−0.11; P=0.76), and age (treatment median 50 years, control median 40 years, U=7.50, z=−1.38, r=−0.42; P=0.19), although the effect size for age was medium–large.
Five patients in the treatment group reported previous psychological problems (mood problems, anxiety, stress-related psychological complaints, alcohol abuse), and three had current psychological complaints (mainly mood problems). Two patients were still receiving psychosocial counseling, which did not focus on improving social cognition. All participants in the control group had received psychological treatment once in their lives for anxiety and compulsions, posttraumatic stress disorder, suicidal ideation, attention deficit/hyperactivity disorder, or a history of being bullied. Two participants in the control group reported current psychological problems, and one was still receiving psychological and psychiatric treatment, not aimed at reducing social cognitive problems, at another mental healthcare facility.
Baseline measures
The Dutch version of the NART was administered at baseline as an estimate of intellectual functioning.36
Primary outcome measures
Emotion recognition
The Emotion Recognition Task (ERT) was used as a measure of facial emotion recognition.38 The ERT is a computer task in which participants are presented with dynamic images of the faces of four actors expressing the six basic emotional expressions: anger, disgust, fear, happiness, sadness, and surprise. A computer program enables real-time interactive morphing between a neutral expression and the emotional expression in four intensities (40%, 60%, 80%, and 100%).38 After each video clip, the participant is asked to choose among the six emotions, displayed as buttons on the test computer. Performance is defined by the total number of correctly identified emotional expressions. Scores range from 0 to 96, and higher scores represent better facial emotion recognition. The ERT has been validated in a wide range of clinical groups and normative data of healthy participants are available.38
Theory of mind
Two subtests of the short Dutch version of The Awareness of Social Inference Test (TASIT-NL) were used as measures of ToM.39,40 A combined score of the subtests social inference – minimal (SI-M) and social inference – enriched (SI-E) was used, because these subtests measure aspects of ToM, while the first subtest – the emotion-evaluation test – addresses emotion recognition.40 The TASIT-NL is the only ToM test that uses videos of actual persons in familiar social situations. Subtest SI-M includes nine videos with three sincere, three sarcastic, and three paradoxical sarcastic scenes. After each video, the participant has to answer four questions about what the actor was doing, saying, thinking, and feeling. Subtest SI-E consists of eight other videos (four lies, four sarcastic scenes) with additional contextual cues to assist the understanding of the situation. After each video, the participant has to answer the same four questions (do, say, think, feel). The combined score for the two subtests ranges from 0 to 68, with higher scores reflecting better ToM abilities. The TASIT-NL has two parallel forms: form A (used at pretest) and form B (at posttest). Although some differences were found between the two forms regarding difficulty at item level and presence of a sequence effect for subtest SI-M (lower performance on form B when participants first completed form A), no differences were found between forms A and B on subtest total scores and overall score, indicating that both forms are comparable. Overall performance on the alternate forms was correlated moderately (r=0.45).40
Social perception
The social interpretation test (SIT) was used as a measure of social perception.41 The SIT consists of a colored drawing depicting a social situation (an accident and reactions of people in the street). Nine open questions are asked to the participant, such as “Can you tell me something about the picture?”; “Do you think there is something striking or strange in the picture?”; and “How are these people involved in the situation?”. The SIT contains a scoring system with 24 statements, and correct answers are scored as 1 point. The SIT has a parallel version using a different yet comparable drawing. Form A was used at pretest and form B at posttest. A maximum score of 21 could be obtained, because only those statements that were thought to be plausible analogies between the two forms were used.41 Performance on the two forms was highly correlated (r=0.82).41
Alexithymia
The Bermond–Vorst Alexithymia Questionnaire (BVAQ) was administered to measure alexithymia.42 This questionnaire consists of 40 items, which are rated on a 5-point Likert scale. The BVAQ includes five factor-based subscales (emotionalizing, fantasizing, identifying, analyzing, and verbalizing), and two higher-order scales (affective and cognitive dimensions). The total score on the BVAQ (40–200) was used in this study, with higher scores reflecting higher levels of alexithymia. Patients in both groups completed a self-report version of this questionnaire. In addition, for participants in the treatment group, a partner or other person close to the patient (ie, their training partner) was asked to complete a proxy version of this list constructed by the researchers. The reliability and validity of the self-report version of the BVAQ are acceptable, and normative data of healthy participants are available.42,43
Social behavioral problems
Based on the factor-analysis study of Bodenburg and Dopslaff,44 a subscale of the Dysexecutive Questionnaire was calculated measuring social conventions and the ability to incorporate social interaction in one’s own behavior (DEX-SC).45 The subscale consists of four items. Total scores range from 0 to 16, with higher scores reflecting more social behavioral problems. Patients in the treatment and control groups completed the self-report version of the DEX-SC, and for participants in the treatment group a proxy version of this list was completed by a partner or other person close to the patient (ie, their training partner).
Secondary outcome measures
Speed of information processing and inhibition
The Stroop color-word test (CWT) was assessed to measure processing speed and response inhibition.46,47 The average time to complete the first two conditions is used as a measure of mental speed. A ratio score (completion time on third condition divided by the average time on conditions 1 and 2) was calculated to reflect the ability to inhibit an automatic response. Lower ratio scores reflect better inhibition. The reliability of the Stroop CWT is considered good and construct validity sufficient.48
Planning
An adapted version of the modified six-elements test (MSET), a subtest of the behavioral assessment of the dysexecutive-syndrome battery, was used to measure planning abilities.45,49 The adapted MSET was used, because it has two parallel forms (version 1 was used at pretest and version 2 at posttest), reduced ceiling effects in mildly impaired individuals, and a more differentiated scoring system.50 In the adapted MSET, the original dictation subtask has been replaced with a sorting task. The other subtasks include arithmetic (version 1), categorizing pictures (version 1), picture naming (version 2), and categorizing words (version 2). The test procedure of the adapted MSET is comparable to the original task. In this study, the scoring method of the adapted MSET ([time of longest subtasks – time of shortest subtasks]/[number of executed tasks – rule breaks]) was used.50 Lower adapted MSET scores indicate better planning performance. Normative data of healthy participants are available.50
Social distress
The Scale for Interpersonal Behavior (SIB) was used to reflect engagement in social behavior and related distress.51 The SIB includes 50 items reflecting social behavior, of which the participant has to evaluate (on two separate 5-point scales) the probability of engaging in this behavior (performance scale) and the level of stress it evokes (distress scale). For the purpose of this study, only the distress scale was used. Higher scores reflect higher levels of social distress. The construct validity and reliability of the SIB are considered good and criterion validity sufficient.52 Normative data of healthy participants are available.77
Anxiety and depression
The Dutch version of the Symptom Checklist 90 – revised (SCL-90-R) was used to measure general psychological complaints.53 The questionnaire consists of 90 items, which are rated on a 5-point scale. For the purpose of this study, only the depression (16 items) and anxiety (10 items) subscales were administered. Higher scores reflect a higher level of complaints. The reliability, construct validity, and criterion validity of the SCL-90-R are considered good.54 Normative data of healthy participants are available.53
Quality of life and self-efficacy
Two short self-report questionnaires of quality of life (three items) and self-efficacy regarding social cognitive functioning (eight items) were administered. These questionnaires were developed by the authors, based on items of the Dutch version of the Acceptance and Action Questionnaire and the Lancashire Quality of Life Questionnaire,55,56 and adjusted to the NS population. Higher scores on these questionnaires reflect a higher level of quality of life or self-efficacy.
Data analyses
Pretest scores on the primary and secondary outcome measures of the treatment and control groups were compared using a Mann–Whitney U tests. Wilcoxon signed-rank tests were performed to investigate pre- vs posttest differences in the treatment and control groups. Effect sizes were calculated manually using the equation: r=z/(√n).57,58 Analyses were performed with SPSS version 23.0.0.0.
For tests for which normative data of healthy participants were available and no adjusted scores were used in the current study (ie, ERT, BVAQ, MSET, SIB, SCL-90-R), individual test scores were classified as low (<−2 SD), below average (−1.5 to −2 SD), above average (1.5–2 SD), or high (>2 SD). A process evaluation (ie, a structured exploration of each process of an intervention) was added, as it can provide valuable information regarding the understanding of both positive and negative outcome results.59 In the current study, the process evaluation was structured into three components, as suggested by Reelick et al:59 success rate of recruitment and quality of study population, quality of execution of complex intervention, and process of acquisition of evaluation data.
Results
Baseline testing
The results of the treatment group and control group at baseline are displayed in Table 3. On primary and secondary outcome measures, no significant differences were found between the groups, even though medium–large effect sizes were present for differences on the ERT, DEX-SC, quality of life, self-efficacy, SCL-90-R – anxiety, and Stroop CWT – inhibition.
Table 3.
Outcome measures | Treatmenta (n=6) | Controla (n=5) | U | z | P-value | rb |
---|---|---|---|---|---|---|
ERT | 47 | 52 | 9 | −1.10 | 0.31 | −0.33 |
TASIT-NL | 49 | 52 | 11 | −0.74 | 0.50 | −0.22 |
SIT | 12.5 | 13 | 11.5 | −0.65 | 0.54 | −0.20 |
BVAQ | 119 | 104 | 12 | −0.55 | 0.62 | −0.17 |
DEX-SC | 9 | 7 | 9.5 | −1.02 | 0.37 | −0.31 |
Stroop CWT processing speed | 55.5 | 48.5 | 12 | −0.55 | 0.66 | −0.17 |
Stroop CWT inhibition | 1.75 | 1.59 | 6 | −1.64 | 0.13 | −0.49 |
Adapted MSET | 18.5 | 15 | 11.5 | −0.64 | 0.57 | −0.19 |
SIB distress | 109 | 117 | 11 | −0.31 | 0.84 | −0.09 |
SCL-90-R anxiety | 17.5 | 12 | 9 | −1.10 | 0.32 | −0.33 |
SCL-90-R depression | 28 | 22 | 11 | −0.73 | 0.51 | −0.22 |
Quality of life | 12.5 | 16 | 9 | −1.11 | 0.33 | −0.33 |
Self-efficacy | 36 | 39 | 9.5 | −1.01 | 0.35 | −0.30 |
Note:
Medians;
effect size.
Abbreviations: BVAQ, Bermond -Vorst Alexithymia Questionnaire; CWT, color-word test; DEX-SC, Dysexecutive Questionnaire – social conventions; ERT, Emotion Recognition Task; MSET, modified six-elements test; SCL-90-R, Symptom Checklist 90, revised; SIB, Scale for Interpersonal Behavior; SIT, social interpretation test; TASIT-NL, The Awareness of Social Inference Test (Dutch version).
Compared to normative data, one patient in the treatment group had below-average performance on the ERT and one patient in this group performed at a low level. Two patients had above-average alexithymia levels on the BVAQ and two patients had high levels. For two patients, proxy reports showed above-average levels of alexithymia, while for two patients high levels of alexithymia were reported by proxies. Two patients reported high levels of depression on the SCL-90-R. In the control group, two patients reported high levels of alexithymia. Two patients in this group reported high levels of depression on the SCL-90-R and one patient reported high levels of anxiety on the same questionnaire. One patient reported an above-average level of social distress on the SIB and one patient reported high levels of social distress. One patient showed a low planning performance on the MSET. The classifications are displayed in Tables 4–7.
Table 4.
Patient number | ERT | TASIT-NL | SIT | BVAQa | DEX-SCa | BVAQ proxya | DEX-SC proxya | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | |
1 | 51 | 51 | 56 | 56 | 12 | 11 | 93 | 119 | 9 | 11 | 113b | 111 | 10 | 13 |
2 | 31c | 45 | 47 | 52 | 9 | 10 | 117b | 127 | 10 | 7 | 150c | 150 | 14 | 8 |
3 | 41b | 55 | 49 | 46 | 9 | 10 | 122c | – | 9 | – | 100 | 115 | 8 | 9 |
4 | 43 | 39 | 43 | 42 | 13 | 11 | 121b | 127 | 7 | 9 | 124c | – | 7 | – |
5 | 61 | 59 | 60 | 55 | 15 | 16 | 146c | 127 | 10 | 12 | 108 | 102 | 11 | 9 |
6 | 51 | 61 | 49 | 45 | 16 | 16 | 103 | 90 | 8 | 9 | 118b | 121 | 13 | 11 |
Median | 47.00 | 53.00 | 49.00 | 49.00 | 12.50 | 11.00 | 117.00 | 127.00 | 9.00 | 9.00 | 113.00 | 115.00 | 11.00 | 9.00 |
Interquartile range | 15.00 | 16.00 | 11.00 | 11.00 | 6.25 | 6.00 | 35.50 | 22.50 | 2.50 | 3.50 | 30.00 | 29.00 | 4.50 | 3.50 |
Te | 3.00 | 4.50 | 7.50 | 7.00 | 5.00 | 4.00 | 5.00 | |||||||
z | −1.22 | −0.81 | 0 | −0.14 | −0.69 | −0.37 | −0.68 | |||||||
P-value | 0.31 | 0.50 | 1.00 | 1.00 | 0.56 | 0.88 | 0.63 | |||||||
rd | −0.35 | −0.23 | 0 | −0.04 | −0.22 | −0.12 | −0.22 |
Note:
Median, interquartile range, and test statistics calculated for five patients;
below/above-average performance at pretest;
low/high performance at pretest;
effect size;
Test statistic of Wilcoxon signed-rank test reflecting the smallest sum of ranks.
Abbreviations: BVAQ, Bermond–Vorst Alexithymia Questionnaire; DEX-SC, Dysexecutive Questionnaire – social conventions; ERT, Emotion Recognition Task; SIT, social interpretation test; TASIT-NL, The Awareness of Social Inference Test (Dutch version).
Table 5.
Patient number | ERT | TASIT-NL | SIT | BVAQa | DEX-SCa | |||||
---|---|---|---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | |
1 | 45 | 27 | 45 | 44 | 13 | 9 | 124b | 144 | 9 | 6 |
2 | 56 | 61 | 52 | 59 | 13 | 11 | 104 | – | 6 | – |
3 | 52 | 49 | 58 | 49 | 11 | 11 | 89 | 90 | 12 | 12 |
4 | 47 | 53 | 52 | 60 | 14 | 16 | 126b | 105 | 7 | 8 |
5 | 59 | 65 | 58 | 54 | 16 | 16 | 89 | 91 | 5 | 5 |
Median | 52.00 | 53.00 | 52.00 | 54.00 | 13.00 | 11.00 | 106.50 | 98.00 | 8.00 | 7.00 |
Interquartile range | 11.50 | 25.00 | 9.50 | 13.00 | 3.00 | 6.00 | 36.50 | 44.00 | 5.75 | 5.75 |
Td | 6.00 | 7.00 | 1.50 | 4.00 | 1.00 | |||||
z | −0.41 | −0.14 | −0.82 | −0.37 | −0.45 | |||||
P-value | 0.75 | 1.00 | 0.75 | 0.88 | 1.00 | |||||
rc | −0.13 | −0.04 | −0.26 | −0.13 | −0.16 |
Note:
Median, interquartile range, and test statistics calculated for four patients;
low/high performance at pretest;
effect size;
Test statistic of Wilcoxon signed-rank test reflecting the smallest sum of ranks.
Abbreviations: BVAQ, Bermond–Vorst Alexithymia Questionnaire; DEX-SC, Dysexecutive Questionnaire – social conventions; ERT, Emotion Recognition Task; SIT, social interpretation test; TASIT-NL, The Awareness of Social Inference Test (Dutch version).
Table 6.
Patient number | Stroop CWT processing speed | Stroop CWT inhibition | Adapted MSET | SIB distressa | SCL-90-R anxietya | SCL-90-R depressiona | Quality of lifea | Self-efficacya | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | |
1 | 53.5 | 48.5 | 1.38 | 1.42 | 20.67 | 6.67 | 121 | 179 | 19 | 25 | 41b | 43 | 12 | 10 | 36 | 32 |
2 | 62.5 | 61.5 | 1.79 | 1.61 | 12.67 | 20.00 | 87 | 84 | 13 | 10 | 24 | 18 | 15 | 17 | 34 | 43 |
3 | 46.5 | 58.0 | 2.00 | 1.45 | 23.80 | 14.33 | – | – | 20 | – | 53b | – | 7 | – | 29 | – |
4 | 69.0 | 61.0 | 1.78 | 1.67 | 21.75 | 12.17 | 107 | 145 | 14 | 15 | 19 | 21 | 12 | 14 | 38 | 34 |
5 | 47.5 | 45.0 | 1.62 | 1.67 | 7.33 | 2.33 | 109 | 94 | 17 | 13 | 32 | 29 | 13 | 12 | 42 | 44 |
6 | 57.5 | 54.5 | 1.72 | 1.61 | 16.33 | 6.00 | 133 | 123 | 18 | 20 | 24 | 24 | 14 | 15 | 36 | 38 |
Median | 55.50 | 56.25 | 1.75 | 1.61 | 18.50 | 9.42 | 109.00 | 123.00 | 17.00 | 15.00 | 24.00 | 24.00 | 13.00 | 14.00 | 36.00 | 38.00 |
Interquartile range | 16.88 | 13.50 | 0.28 | 0.23 | 10.93 | 10.67 | 30.00 | 73.00 | 5.00 | 11.00 | 15.00 | 16.50 | 2.50 | 5.00 | 5.00 | 10.50 |
Td | 6.00 | 3.00 | 2.00 | 6.00 | 7.00 | 3.00 | 5.50 | 7.00 | ||||||||
z | −0.94 | −1.57 | −1.78 | −0.41 | −0.14 | −0.74 | −0.55 | −0.14 | ||||||||
P-value | 0.44 | 0.16 | 0.09 | 0.81 | 1.00 | 0.63 | 0.81 | 1.00 | ||||||||
rc | −0.27 | −0.45 | −0.51 | −0.13 | −0.04 | −0.23 | −0.17 | −0.04 |
Note:
Median and interquartile range calculated for five participants;
low/high performance at pretest;
effect size;
Test statistic of Wilcoxon signed-rank test reflecting the smallest sum of ranks.
Abbreviations: CWT, color-word test; MSET, modified six-elements test; SCL-90-R, Symptom Checklist 90, revised; SIB, Scale for Interpersonal Behavior.
Table 7.
Patient number | Stroop CWT processing speed | Stroop CWT inhibition | Adapted MSET | SIB distressa | SCL-90-R anxietya | SCL-90-R depressiona | Quality of lifea | Self-efficacya | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | Pre | Post | |
1 | 103.0 | 98.0 | 1.59 | 1.62 | 489.0c | 46.50 | 96 | 80 | 12 | 10 | 17 | 20 | 18 | 16 | 48 | 39 |
2 | 44.5 | 40.0 | 1.60 | 1.83 | 16.00 | 7.33 | 117 | – | 11 | – | 22 | – | 16 | – | 39 | – |
3 | 48.5 | 43.0 | 1.69 | 1.81 | 5.83 | 8.17 | 137b | 132 | 20c | 18 | 45c | 34 | 9 | 11 | 35 | 35 |
4 | 54.0 | 49.0 | 1.52 | 1.65 | 12.67 | 4.67 | 168c | 190 | 18 | 17 | 42c | 30 | 12 | 15 | 34 | 37 |
5 | 47.0 | 45.5 | 1.49 | 1.47 | 15.00 | 11.50 | 77 | 79 | 11 | 11 | 18 | 17 | 17 | 17 | 46 | 46 |
Median | 48.50 | 45.50 | 1.59 | 1.65 | 15.00 | 8.17 | 116.50 | 106.00 | 15.00 | 14.00 | 30.00 | 25.00 | 14.50 | 15.50 | 40.50 | 38.00 |
Interquartile range | 32.75 | 32.00 | 0.14 | 0.27 | 243.25 | 23.00 | 78.50 | 96.25 | 8.25 | 7.50 | 27.00 | 15.25 | 8.00 | 4.75 | 13.25 | 8.75 |
Te | 0.00 | 1.00 | 1.00 | 5.00 | 0.00 | 2.00 | 1.50 | 1.00 | ||||||||
z | −2.03 | −1.75 | −1.75 | 0 | −1.63 | −1.10 | −0.82 | −0.45 | ||||||||
P-value | 0.06 | 0.13 | 0.13 | 1.00 | 0.25 | 0.38 | 0.75 | 1.00 | ||||||||
rd | −0.64 | −0.55 | −0.55 | 0 | −0.58 | −0.39 | −0.29 | −0.16 |
Note:
Median and interquartile range calculated for four participants;
below/above-average performance at pretest;
low/high performance at pretest;
effect size;
Test statistic of Wilcoxon signed-rank test reflecting the smallest sum of ranks.
Abbreviations: CWT, color-word test; MSET, modified six-elements test; SCL-90-R, Symptom Checklist 90, revised; SIB, Scale for Interpersonal Behavior.
Pretest vs posttest
There appeared to be no significant differences on primary outcome measures between pre- and posttest scores in the treatment group or the control group (Tables 4 and 5). However, the effect size of improvement on the ERT was medium–large in the treatment group, while it was only small–medium in the control group.
Regarding secondary outcome measures, there were no significant differences between pre- and posttest scores in either group, although improvement on the adapted MSET in the treatment group and the faster performance of the control group on Stroop CWT processing speed almost reached significance and effect sizes were large (Tables 6 and 7). Despite the lack of significant results, the effect size of the improvement in inhibition scores on the Stroop CWT in the treatment group was medium–large, while decreased performance on this task in the control group showed a large effect. Furthermore, large effects were found in the control group with regard to the (nonsignificant) improvement in planning abilities on the adapted MSET and the decrease in anxiety on the SCL-90-R, while a medium effect was found for the decrease in depression. Since both groups showed a (medium to) large effect on improvement on the adapted MSET, this most likely reflected a practice effect.
Process evaluation
In Table 2, detailed information regarding the process evaluation is displayed. The results of the process analysis regarding selection of the study population showed that the number of included patients was smaller than intended. It is hypothesized that the lower inclusion may have been influenced by the nature of the (social) cognitive deficits in patients with NS. There were no dropouts among the included patients.
With regard to the evaluation of the intervention itself, the results of the process evaluation indicated that all three phases of the training were delivered successfully. All participants reported benefiting from the training. Increased awareness of social cognitive difficulties (related to NS) and the acquisition of useful strategies to improve social cognitive functioning were mentioned most frequently, though participants also reported that they had experienced the training as intensive and demanding in terms of the emotional load and practical issues (eg, time investment). In addition to the content of the training, participants also benefited from the support they felt from their group members. It was observed that patients were inclined to spend much time on sharing their experiences in a detailed manner during the sessions, at the expense of training time. Supposedly, most patients with NS seldom meet other patients and greatly valued the recognition of one another’s experiences and (social cognitive) problems. Alternatively, the observed tendency to share experiences extensively may reflect avoidance of (potentially distressing) exercises during the training or may be the result of verbosity, caused by difficulties in executive functioning. Although homework exercises were performed satisfactorily, participants tended to avoid exercises with their training partners. Patients who involved their training partners seemed to profit from the participation of their proxies. Three of the five training partners who shared their experiences after training reported that the participants benefited from the training in their opinion.
Lastly, the results of the process evaluation of outcome measures showed that the neuropsychological test data were complete, but that not all questionnaires were returned. This could suggest a difficulty with completing the questionnaires. The missing data may have influenced the findings in this study, because conservative methods were used to compensate for these. The perceived benefit by patients and their training partners was not reflected by the quantitative data.
Discussion
In the present study, applicability and feasibility of a new social cognitive training for adult patients with NS was evaluated. The training appeared feasible, and promising results were found with regard to enhancement of emotion recognition, although the overall effectiveness of the training could not be quantified, due to the small sample.
With regard to baseline measures, no significant differences were found between the treatment and control groups. However, several outcome measures showed medium–large effect sizes when comparing the two groups, which may suggest that meaningful differences between the treatment and control groups on these variables could not be demonstrated due to a power problem. Baseline variables that potentially differed were higher age, poorer emotion recognition, lower levels of quality of life and self-efficacy, more social behavioral problems, more anxiety, and a worse inhibition score in the treatment group in comparison to the control group. Possible baseline differences between the groups might have resulted from the inclusion of patients with subjective or objective social cognitive impairments in the treatment group.
Within each group, no significant differences between pre- and posttest were found for primary outcome measures. However, the medium–large effect size of the pre- vs posttest-difference on ERT in the treatment group compared to the small–medium effect sizes in the control group may indicate that the effects on emotion recognition were stronger in the treatment group. An improvement in emotion recognition was expected, because it has been a consistent finding in other social cognitive interventions.21 Finding no significant improvement in the treatment group on subjective measures of social cognitive functioning may reflect increased awareness of social cognitive difficulties. Awareness of one’s (social) cognitive problems can be considered an initial step toward behavioral change.
Regarding secondary outcome measures, no significant differences were found between pre- and posttest in either group. However, the improvement in adapted MSET scores in the treatment group and faster processing on the Stroop CWT in the control group almost reached significance. In addition, the medium–large effect sizes of the (nonsignificant) improvement on the Stroop CWT – inhibition in the treatment group and the (nonsignificant) improvement on the adapted MSET and SCL-90-R and (nonsignificant) decrease on Stroop CWT – inhibition in the control group may reflect differences that could not be demonstrated by the Wilcoxon signed-rank test due to power problems. Moreover, large effects were found in both groups with regard to the (non-significant) improvement in planning abilities on the adapted MSET, which most likely reflected a practice effect.
The process evaluation showed that there were no dropouts, all three phases of the intervention were feasible, and patients reported benefits from the training. Strong aspects concerned the (small) group-based format, in which NS patients learned from one another’s experiences, gained more awareness of their social cognitive difficulties, and were able to practice strategies. The number of patients included in this study was smaller than intended, which could be related to the nature of the (social) cognitive deficits in patients with NS. Providing more information concerning the beneficial effects of group training and considering alternative training locations in order to reduce the time investment may be helpful in this regard. eHealth interventions can also be considered, although exercising social skills in real-life interaction remains necessary. The evaluation also showed that more time may be spent on practicing social cognitive skills and performing exercises and to a lesser extent on psychoeducation and discussion of experiences and social cognitive complaints. Additional exercises can be considered, focusing for instance on emotion-regulation strategies, task-concentration training, and elements of acceptance and commitment therapy, which may be helpful in diminishing alexithymic problems and social anxiety and in increasing acceptance of emotions. Furthermore, training partners were less involved in the training than intended, which could have hampered the generalization of training effects to daily life. The selection of appropriate training partners, their role, and the benefits of their involvement should be addressed more elaborately during both the intake procedure and the sessions in which they are present. It also appeared that patients had some difficulty with filling out the questionnaires. Supervised administration of the questionnaires and the use of shorter instruments, eg, replacing the BVAQ with the shorter Toronto Alexithymia Scale 20, may be helpful in this regard.60 Furthermore, a revision of the test battery is suggested. Although the TASIT has many benefits (ie, alternate forms and videos of real-life social situations) and is used frequently, the Dutch version is still time-consuming and its suitability for repeated administration is questionable.61 Other ToM tasks may be considered, eg, a recognition of faux pas task.62–64
Despite the fact that this is the first controlled study to evaluate a new social cognitive training for adult patients with NS, there are also some limitations. Firstly, the study sample was small, which has consequences for the power. Furthermore, because subjective or objective social cognitive impairments were required for inclusion in the treatment group, a selection bias could be present, which limits the interpretation of pre- vs posttest results to this group. Although no baseline differences were found between the groups, the presence of several medium–large effect sizes on baseline comparisons may suggest that meaningful differences between the groups could not be demonstrated due to limited statistical power. Also, patients were not randomly allocated to the groups, and we emphasize that these preliminary findings should be interpreted with caution and replicated in a randomized controlled trial. Because only nonparametric analyses were performed, no interaction effects between group (treatment vs control) and time (pre vs post) could be explored. As a result of the large heterogeneity in cognitive functioning in the NS population, possible outliers may have influenced the results of the analyses. However, these effects are considered minimal, due to the use of nonparametric testing. Lastly, all participants in the treatment group underwent neuropsychological assessment at the Center of Excellence of Neuropsychiatry for different periods before the training (approximately 1–8 years). Some of the outcome measures in the current test battery overlapped with this neuropsychological assessment, which could have led to practice effects.
Conclusion
In conclusion, this first social cognitive training for adult patients with NS, based on existing evidence-based and best-practice social cognition and alexithymia interventions, has proven to be a feasible training for this population. Moreover, encouraging results were found with regard to the enhancement of emotion recognition. Based on the process evaluation, some alterations in the training protocol and test battery may be helpful in order to optimize the procedure. Future studies are needed using a larger sample and randomized controlled design, in order to evaluate further the effectiveness of the training.
Footnotes
Disclosure
The authors report no conflicts of interest in this work.
References
- 1.Allanson JE, Roberts AE. Noonan syndrome. In: Adam MP, Ardinger HH, Pagon RA, et al., editors. GeneReviews. Seattle (WA): University of Washington; 2016. [Google Scholar]
- 2.Roberts AE, Allanson JE, Tartaglia M, Gelb BD. Noonan syndrome. Lancet. 2013;381(9863):333–342. doi: 10.1016/S0140-6736(12)61023-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Noonan JA. Noonan syndrome. In: Goldstein S, Reynolds CR, editors. Handbook of Neurodevelopmental and Genetic Disorders in Adults. New York: The Guilford Press; 2005. pp. 308–319. [Google Scholar]
- 4.Tidyman WE, Rauen KA. Pathogenetics of the RASopathies. Hum Mol Genet. 2016;25(R2):R123–R132. doi: 10.1093/hmg/ddw191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rauen KA. The RASopathies. Annu Rev Genomics Hum Genet. 2013;14(1):355–369. doi: 10.1146/annurev-genom-091212-153523. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Tajan M, Paccoud R, Branka S, Edouard T, Yart A. The RASopathy family: consequences of germline activation of the Ras/MAPK pathway. Endocr Rev. 2018;39(5):676–700. doi: 10.1210/er.2017-00232. [DOI] [PubMed] [Google Scholar]
- 7.Tartaglia M, Gelb BD, Zenker M. Noonan syndrome and clinically related disorders. Best Pract Res Clin Endocrinol Metab. 2011;25(1):161–179. doi: 10.1016/j.beem.2010.09.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Turner AM. Noonan syndrome. J Paediatr Child Health. 2014;50(10):E14–E20. doi: 10.1111/j.1440-1754.2010.01970.x. [DOI] [PubMed] [Google Scholar]
- 9.van der Burgt I. Noonan syndrome. Orphanet J Rare Dis. 2007;2(4):1–6. doi: 10.1186/1750-1172-2-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Pierpont EI. Neuropsychological functioning in individuals with Noonan syndrome: a systematic literature review with educational and treatment recommendations. J Pediatr Neuropsychol. 2016;2(1–2):14–33. [Google Scholar]
- 11.Wingbermühle E, Roelofs RL, van der Burgt I, et al. Cognitive functioning of adults with Noonan syndrome: a case-control study. Genes Brain Behav. 2012;11(7):785–793. doi: 10.1111/j.1601-183X.2012.00821.x. [DOI] [PubMed] [Google Scholar]
- 12.Beauchamp MH, Anderson V. Social: an integrative framework for the development of social skills. Psychol Bull. 2010;136(1):39–64. doi: 10.1037/a0017768. [DOI] [PubMed] [Google Scholar]
- 13.Wingbermühle E, Egger JIM, Verhoeven WMA, van der Burgt I, Kessels RPC. Affective functioning and social cognition in Noonan syndrome. Psychol Med. 2012;42(02):419–426. doi: 10.1017/S0033291711001115. [DOI] [PubMed] [Google Scholar]
- 14.Adviento B, Corbin IL, Widjaja F, et al. Autism traits in the RASopathies. J Med Genet. 2014;51(1):10–20. doi: 10.1136/jmedgenet-2013-101951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Alfieri P, Piccini G, Caciolo C, et al. Behavioral profile in RASopathies. Am J Med Genet A. 2014;164(4):934–942. doi: 10.1002/ajmg.a.36374. [DOI] [PubMed] [Google Scholar]
- 16.Garg S, Brooks A, Burns A, et al. Autism spectrum disorder and other neurobehavioural comorbidities in rare disorders of the Ras/MAPK pathway. Dev Med Child Neurol. 2017;59(5):544–549. doi: 10.1111/dmcn.13394. [DOI] [PubMed] [Google Scholar]
- 17.Pierpont EI, Hudock RL, Foy AM, et al. Social skills in children with RASopathies: a comparison of Noonan syndrome and neurofibromatosis type 1. J Neurodev Disord. 2018;10(1):1–11. doi: 10.1186/s11689-018-9239-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Smpokou P, Tworog-Dube E, Kucherlapati RS, Roberts AE. Medical complications, clinical findings, and educational outcomes in adults with Noonan syndrome. Am J Med Genet A. 2012;158A(12):3106–3111. doi: 10.1002/ajmg.a.35639. [DOI] [PubMed] [Google Scholar]
- 19.Verhoeven W, Wingbermühle E, Egger J, van der Burgt I, Tuinier S. Noonan syndrome: psychological and psychiatric aspects. Am J Med Genet A. 2008;146A(2):191–196. doi: 10.1002/ajmg.a.32115. [DOI] [PubMed] [Google Scholar]
- 20.Taylor GJ, Bagby M. The alexithymia personality dimension. In: Widiger TA, editor. The Oxford Handbook of Personality Disorders. New York: Oxford University Press; 2012. pp. 648–673. [Google Scholar]
- 21.Roelofs RL, Wingbermühle E, Egger JIM, Kessels RPC. Social cognitive interventions in neuropsychiatric patients: a meta-analysis. Brain Impairment. 2017;18(01):138–173. [Google Scholar]
- 22.Roberts DL, Penn DL, Combs DR. Social Cognition and Interaction Training (SCIT), Group Psychotherapy for Schizophrenia and Other Psychotic Disorders: Clinician Guide. New York: Oxford University Press; 2016. [Google Scholar]
- 23.Wölwer W, Frommann N, Halfmann S, Piaszek A, Streit M, Gaebel W. Remediation of impairments in facial affect recognition in schizophrenia: efficacy and specificity of a new training program. Schizophr Res. 2005;80(2–3):295–303. doi: 10.1016/j.schres.2005.07.018. [DOI] [PubMed] [Google Scholar]
- 24.Hogarty GE, Greenwald DP. Cognitive Enhancement Therapy: The Training Manual. Pittsburgh, PA: University of Pittsburgh; 2006. [Google Scholar]
- 25.Westerhof-Evers HJ, Visser-Keizer AC, Fasotti L, et al. Effectiveness of a treatment for impairments in social cognition and emotion regulation (T-ScEmo) after traumatic brain injury: a randomized controlled trial. J Head Trauma Rehabil. 2017;32(5):296–307. doi: 10.1097/HTR.0000000000000332. [DOI] [PubMed] [Google Scholar]
- 26.Bishop-Fitzpatrick L, Minshew NJ, Eack SM. A systematic review of psychosocial interventions for adults with autism spectrum disorders. J Autism Dev Disord. 2013;43(3):687–694. doi: 10.1007/s10803-012-1615-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Krystal H. Alexithymia and psychotherapy. Am J Psychother. 1979;33(1):17–31. doi: 10.1176/appi.psychotherapy.1979.33.1.17. [DOI] [PubMed] [Google Scholar]
- 28.Cameron K, Ogrodniczuk J, Hadjipavlou G. Changes in alexithymia following psychological intervention: a review. Harv Rev Psychiatry. 2014;22(3):162–178. doi: 10.1097/HRP.0000000000000036. [DOI] [PubMed] [Google Scholar]
- 29.Beresnevaite M. Exploring the benefits of group psychotherapy in reducing alexithymia in coronary heart disease patients: a preliminary study. Psychother Psychosom. 2000;69(3):117–122. doi: 10.1159/000012378. [DOI] [PubMed] [Google Scholar]
- 30.Byrne G, Bogue J, Egan R, Lonergan E. “Identifying and describing emotions”: measuring the effectiveness of a brief, alexithymia-specific, intervention for a sex offender population. Sex Abuse. 2016;28(7):599–619. doi: 10.1177/1079063214558940. [DOI] [PubMed] [Google Scholar]
- 31.Neumann D, Malec JF, Hammond FM. Reductions in Alexithymia and emotion dysregulation after training emotional Self-Awareness following traumatic brain injury: a phase I trial. J Head Trauma Rehabil. 2017;32(5):286–295. doi: 10.1097/HTR.0000000000000277. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Kennedy M, Franklin J. Skills-based treatment for alexithymia: an exploratory case series. Behav Change. 2002;19(3):158–171. [Google Scholar]
- 33.Levant RF, Halter MJ, Hayden EW, Williams CM. The efficacy of alexithymia reduction treatment: a pilot study. J Mens Stud. 2009;17(1):75–84. [Google Scholar]
- 34.Samur D, Tops M, Schlinkert C, Quirin M, Cuijpers P, Koole SL. Four decades of research on alexithymia: moving toward clinical applications. Front Psychol. 2013;4:1–4. doi: 10.3389/fpsyg.2013.00861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Adolphs R. The neurobiology of social cognition. Curr Opin Neurobiol. 2001;11(2):231–239. doi: 10.1016/s0959-4388(00)00202-6. [DOI] [PubMed] [Google Scholar]
- 36.Schmand B, Lindeboom J, Van Harskamp F. Nederlandse Leestest voor Volwassenen: Handleiding [Dutch Version of the National Adult Reading Test: Manual] Lisse, The Netherlands: Swets & Zeitlinger; 1992. [Google Scholar]
- 37.Duits A, Kessels R. Schatten van het premorbide functioneren [Estimating premorbid functioning] In: Hendriks M, Kessels R, Gorissen M, editors. Neuropsychologische diagnostiek: De klinische praktijk [Neuropsychological Assessment: Clinical practice] Amsterdam: The Netherlands Boom; 2014. pp. 173–186. [Google Scholar]
- 38.Kessels RP, Montagne B, Hendriks AW, Perrett DI, de Haan EH. Assessment of perception of morphed facial expressions using the emotion recognition task: normative data from healthy participants aged 8–75. J Neuropsychol. 2014;8(1):75–93. doi: 10.1111/jnp.12009. [DOI] [PubMed] [Google Scholar]
- 39.McDonald S, Flanagan S, Rollins J, Kinch J. TASIT: a new clinical tool for assessing social perception after traumatic brain injury. J Head Trauma Rehabil. 2003;18(3):219–238. doi: 10.1097/00001199-200305000-00001. [DOI] [PubMed] [Google Scholar]
- 40.Westerhof-Evers HJ, Visser-Keizer AC, McDonald S, Spikman JM. Performance of healthy subjects on an ecologically valid test for social cognition: the short, Dutch version of the awareness of social inference test (TASIT) J Clin Exp Neuropsychol. 2014;36(10):1031–1041. doi: 10.1080/13803395.2014.966661. [DOI] [PubMed] [Google Scholar]
- 41.Vijftigschild W, Berger HJC, Van Spaendonck JAS. Verbale interpretatie van een alledaags gebeuren [Social interpretation test Verbal interpretation of an everyday situation] Amsterdam, The Netherlands: Swets & Zeitlinger; 1969. Sociale ubterpretatie test. [Google Scholar]
- 42.Vorst HCM, Bermond B. Validity and reliability of the Bermond–Vorst Alexithymia questionnaire. Pers Individ Dif. 2001;30(3):413–434. [Google Scholar]
- 43.Müller J, Bühner M, Ellgring H. The assessment of alexithymia: psychometric properties and validity of the Bermond–Vorst alexithymia questionnaire. Pers Individ Dif. 2004;37(2):373–391. [Google Scholar]
- 44.Bodenburg S, Dopslaff N. The Dysexecutive questionnaire advanced: item and test score characteristics, 4-factor solution, and severity classification. J Nerv Ment Dis. 2008;196(1):75–78. doi: 10.1097/NMD.0b013e31815faa2b. [DOI] [PubMed] [Google Scholar]
- 45.Wilson BA, Alderman N, Burgess PW. In: BADS: Behavioural Assessment of the Dysexecutive Syndrome. Krabbendam L, Kalff AC, translators. London: Pearson; 1996. [Google Scholar]
- 46.Bouma JM, Mulder J, Altena E. Stroop kleur-woord test [Stroop color-word test] In: Bouma JM, Mulder J, Lindeboom J, editors. Handboek neuropsychologische diagnostiek [Handbook of neuropsychological assessment] Amsterdam, The Netherlands: Pearson Assessment and Information B.V; 2012. pp. 475–509. [Google Scholar]
- 47.Stroop JR. Studies of interference in serial verbal reactions. J Exp Psychol. 1935;18(6):643–662. [Google Scholar]
- 48.Egberink IJL, Holly-Middelkamp FR, Vermeulen CSM. Stroop [Stroop Colour Word Test] COTAN review 2003. [Accessed December 8, 2017]. Available from: https://www-1cotandocumentatie-1nl-10004359x146f.hanhosting.vakliteratuur.info/beoordelingen/b/13536/stroop-kleur-woordtest/ Dutch.
- 49.Bertens D, Frankenmolen N, Boelen DH, Kessels RP, Fasotti L. Validity of an adapted scoring method for a modified six elements test in individuals with brain injury. Arch Clin Neuropsychol. 2015;30(2):122–129. doi: 10.1093/arclin/acu093. [DOI] [PubMed] [Google Scholar]
- 50.Bertens D, Fasotti L, Egger JI, Boelen DH, Kessels RP. Reliability of an adapted version of the modified six elements test as a measure of executive function. Appl Neuropsychol Adult. 2016;23(1):35–42. doi: 10.1080/23279095.2015.1012258. [DOI] [PubMed] [Google Scholar]
- 51.Arrindell WA, Bridges KR, van der Ende J, et al. Normative studies with the scale for interpersonal behaviour (SIB): II. US students. A cross-cultural comparison with Dutch data. Behav Res Ther. 2001;39(12):1461–1479. doi: 10.1016/s0005-7967(01)00009-2. [DOI] [PubMed] [Google Scholar]
- 52.Egberink IJL, Holly-Middelkamp FR, Vermeulen CSM. Schaal voor Interpersoonlijk Gedrag [Scale for Interpersonal Behaviour] COTAN review 1998. [Accessed December 8, 2017]. Available from: https://www-1cotandoc-umentatie-1nl-10004359x146f.hanhosting.vakliteratuur.info/beoordelingen/b/14504/schaal-voor-interpersoonlijk-gedrag/ Dutch.
- 53.Arrindell WA, Ettema JHM. SCL90: Handleiding bij een multidimensionele psychopathologie-indicator [SCL90: Manual of a multidimensional psychopathology indicator] Lisse, The Netherlands: Swets & Zeitlinger; 2003. [Google Scholar]
- 54.Egberink IJL, Holly-Middelkamp FR, Vermeulen CSM. Symptom Checklist-90 Revised. COTAN review 2004. [Accessed December 8, 2017]. Available from: https://www-1cotandocumentatie-1nl-10004359x146f.hanhosting.vakliteratuur.info/beoordelingen/b/13561/klachtenlijst/ Dutch.
- 55.Jacobs N, Kleen M, De Groot F. Het meten van experiëntiële vermijding: De Nederlandse versie van de acceptance and action questionnaire-II (AAQ-II) [Measuring experiential avoidance: The Dutch version of the acceptance and action questionnaire-II] Gedragstherapie. 2008;41:349–361. [Google Scholar]
- 56.van Nieuwenhuizen C, Schene AH, Koeter MW, Huxley PJ. The Lancashire quality of life profile: modification and psychometric evaluation. Soc Psychiatry Psychiatr Epidemiol. 2001;36(1):36–44. doi: 10.1007/s001270050288. [DOI] [PubMed] [Google Scholar]
- 57.Rosenthal R. Meta-Analytic Procedures for Social Research. 2nd ed. Newbury Park, CA: Sage; 1991. [Google Scholar]
- 58.Perdices M. Null hypothesis significance testing, p-values, effects sizes and confidence intervals. Brain Impairment. 2018;19(1):70–80. [Google Scholar]
- 59.Reelick MF, Faes MC, Esselink RA, Kessels RP, Olde Rikkert MG. How to perform a preplanned process evaluation for complex interventions in geriatric medicine: exemplified with the process evaluation of a complex falls-prevention program for community-dwelling frail older fallers. J Am Med Dir Assoc. 2011;12(5):331–336. doi: 10.1016/j.jamda.2011.01.006. [DOI] [PubMed] [Google Scholar]
- 60.Bagby RM, Parker JD, Taylor GJ. The twenty-item Toronto Alexithymia Scale – I. Item selection and cross-validation of the factor structure. J Psychosom Res. 1994;38(1):23–32. doi: 10.1016/0022-3999(94)90005-1. [DOI] [PubMed] [Google Scholar]
- 61.Kelly M, McDonald S, Frith MHJ. Assessment and rehabilitation of social cognition impairment after brain injury: surveying practices of clinicians. Brain Impairment. 2017;18(01):11–35. [Google Scholar]
- 62.Gregory C, Lough S, Stone V, et al. Theory of mind in patients with frontal variant frontotemporal dementia and Alzheimer’s disease: theoretical and practical implications. Brain. 2002;125(Pt 4):752–764. doi: 10.1093/brain/awf079. [DOI] [PubMed] [Google Scholar]
- 63.Stone VE, Baron-Cohen S, Knight RT. Frontal lobe contributions to theory of mind. J Cogn Neurosci. 1998;10(5):640–656. doi: 10.1162/089892998562942. [DOI] [PubMed] [Google Scholar]
- 64.Corcoran R, Mercer G, Frith CD. Schizophrenia, symptomatology and social inference: investigating “theory of mind” in people with schizophrenia. Schizophr Res. 1995;17(1):5–13. doi: 10.1016/0920-9964(95)00024-g. [DOI] [PubMed] [Google Scholar]
- 65.Bird G, Cook R. Mixed emotions: the contribution of alexithymia to the emotional symptoms of autism. Transl Psychiatry. 2013;3(7):e285. doi: 10.1038/tp.2013.61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Grynberg D, Chang B, Corneille O, et al. Alexithymia and the processing of emotional facial expressions (EFEs): systematic review, unanswered questions and further perspectives. PLoS One. 2012;7(8):e42429. doi: 10.1371/journal.pone.0042429. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Lane RD, Sechrest L, Riedel R, Shapiro DE, Kaszniak AW. Pervasive emotion recognition deficit common to alexithymia and the repressive coping style. Psychosom Med. 2000;62(4):492–501. doi: 10.1097/00006842-200007000-00007. [DOI] [PubMed] [Google Scholar]
- 68.Parker JD, Taylor GJ, Bagby RM. Alexithymia and the recognition of facial expressions of emotion. Psychother Psychosom. 1993;59(3–4):197–202. doi: 10.1159/000288664. [DOI] [PubMed] [Google Scholar]
- 69.Moriguchi Y, Ohnishi T, Lane RD, et al. Impaired self-awareness and theory of mind: an fMRI study of mentalizing in alexithymia. Neuroimage. 2006;32(3):1472–1482. doi: 10.1016/j.neuroimage.2006.04.186. [DOI] [PubMed] [Google Scholar]
- 70.Swart M, Kortekaas R, Aleman A. Dealing with feelings: characterization of trait alexithymia on emotion regulation strategies and cognitive-emotional processing. PLoS One. 2009;4(6):e5751. doi: 10.1371/journal.pone.0005751. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Donges US, Suslow T. Alexithymia and automatic processing of emotional stimuli: a systematic review. Rev Neurosci. 2017;28(3):1–18. doi: 10.1515/revneuro-2016-0049. [DOI] [PubMed] [Google Scholar]
- 72.Neumann D, Zupan B, Malec JF, Hammond F. Relationships between alexithymia, affect recognition, and empathy after traumatic brain injury. J Head Trauma Rehabil. 2014;29(1):E18–E27. doi: 10.1097/HTR.0b013e31827fb0b5. [DOI] [PubMed] [Google Scholar]
- 73.Milosavljevic B, Carter Leno V, Simonoff E, et al. Alexithymia in adolescents with autism spectrum disorder: its relationship to Internalising difficulties, sensory modulation and social cognition. J Autism Dev Disord. 2016;46(4):1354–1367. doi: 10.1007/s10803-015-2670-8. [DOI] [PubMed] [Google Scholar]
- 74.Poquérusse J, Pastore L, Dellantonio S. Alexithymia and autism spectrum disorder: a complex relationship. Front Psychol. 2018;9:1–10. doi: 10.3389/fpsyg.2018.01196. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Wearne T, Osborne-Crowley K, Rosenberg H, Dethier M, McDonald S. Emotion recognition depends on subjective emotional experience and not on facial expressivity: evidence from traumatic brain injury. Brain Inj. 2018 Oct 8; doi: 10.1080/02699052.2018.1531300. Epub. [DOI] [PubMed] [Google Scholar]
- 76.Williams C, Wood RL. Alexithymia and emotional empathy following traumatic brain injury. J Clin Exp Neuropsychol. 2010;32(3):259–267. doi: 10.1080/13803390902976940. [DOI] [PubMed] [Google Scholar]
- 77.Arrindell WA, De Groot PM, Walburg JA. De schaal voor interpersoonlijk gedrag [The scale for interpersonal behavior] Lisse: Swets & Zeitlinger; 1984. [Google Scholar]