Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Aug 1.
Published in final edited form as: Twin Res Hum Genet. 2018 Feb;21(1):12–23. doi: 10.1017/thg.2017.72

Genetic and Environmental Contributions of Negative Valence Systems to Internalizing Pathways

Jennifer L Cecilione 1,+, Lance M Rappaport 1,+, Shannon E Hahn 1, Audrey E Anderson 1, Laura E Hazlett 1, Jason R Burchett 1, Ashlee A Moore 1, Jeanne E Savage 1, John M Hettema 1, Roxann Roberson-Nay 1
PMCID: PMC5884079  NIHMSID: NIHMS949574  PMID: 29369039

Abstract

The Genetic and Environmental Contributions of Negative Valence Systems to Internalizing Pathways study (also referred to as the Adolescent and Young Adult Twin Study) was designed to examine varying constructs of the negative valence systems as they relate to the development of internalizing disorders from a genetically informed perspective. The goal of this study was to evaluate genetic and environmental contributions to potential psychiatric endophenotypes that contribute to internalizing psychopathology by studying adolescent and young adult twins longitudinally over a two-year period. This report details the sample characteristics, study design, and methodology of this study. The first wave of data collection (i.e., time 1) is complete; the 2-year follow-up (i.e., time 2) is currently underway. A total of 430 twin pairs (N=860 individual twins; 166 monozygotic pairs; 57.2% female) and 422 parents or legal guardians participated at time 1. Twin participants completed self-report surveys and participated in experimental paradigms to assess processes within the negative valence systems. Additionally, parents completed surveys to report on themselves and their twin children. Findings from this study will help clarify the genetic and environmental influences of the negative valence systems and their association with internalizing risk. The goal of this line of research is to develop methods for early internalizing disorder risk detection.

Keywords: negative valence systems, internalizing disorders, twin study, endophenotypes, adolescence, genetics


The National Institute of Mental Health (NIMH) launched the Research Domain Criteria (RDoC) to advance new approaches to psychopathology in which primary, core dimensions linking mental health disorders come to serve as the basis for categorizing individuals for research purposes. This effort is in response to the disappointing findings of research studies using psychiatric phenotypes (e.g., schizophrenia, major depression) to elucidate etiological mechanisms. In its current conception, the RDoC matrix encompasses a number of domains, including the negative valence systems (NVS), which focuses on biological and psychological systems involved in the response to loss or aversive, threatening, or harmful stimuli. Within each domain, potential constructs are studied across multiple levels of analysis (e.g., neural circuits, behavior, genes, etc.) (Insel et al., 2010). The NVS currently includes the following constructs: acute threat (fear), potential threat (anxiety), sustained threat, loss, and frustrative non-reward (NIMH, 2017). The present study was sponsored through the RDoC initiative and primarily seeks to provide an estimate of genetic and environmental contributions to NVS constructs spanning multiple units of analysis and to determine shared genetic and environmental influences among NVS constructs and between them and internalizing disorders/symptoms. Evidence of shared genetic and environmental contributions to NVS constructs and psychiatric syndromes may implicate these constructs in the etiology of internalizing disorders.

The notion of examining intermediate processes derives from other areas of science where intermediate phenotypes, called endophenotypes, may clarify the etiology of otherwise complex syndromes (Gottesman & Gould, 2003). Gottesman and Gould (2003) outlined four criteria to identify an endophenotype, such that endophenotypes must: 1) be correlated with a medical or psychological condition in the population, 2) be heritable, 3) be state-independent (i.e., independent of active psychiatric episode), and 4) co-segregate with the condition within a family. Cannon and Keller (2006) proposed additional qualifying criteria, such that: 1) endophenotypes must be related to causes instead of effects of disorders, 2) several endophenotypes should influence one complex disorder, 3) endophenotypes should be measured as continuous variables and at different levels of analysis, and 4) endophenotypes should be found in genetically related disorders. In summary, understanding which endophenotypes are associated with which psychiatric syndromes may provide a more useful model for the etiology of extant clinical diagnoses and help identify better prevention and intervention targets.

For the purposes of biometrical twin modeling, an unselected sample was recruited to represent an epidemiological distribution, which is needed to examine NVS constructs that are theorized to manifest in typically developing individuals. A general population sample (as opposed to a selected sample) is necessary for genetic and environmental estimates to be unbiased and maximally informative for the etiology of NVS phenotypes. Given the high prevalence rate of internalizing symptoms and conditions by late adolescence and young adulthood (Kessler et al., 2012; Kessler et al., 2005; Merikangas et al., 2010), a representative adolescent and young adult sample was expected to produce adequate numbers of individuals expressing internalizing disorder symptomatology and those at risk for developing internalizing disorders.

The behavioral genetic methods of this study allow for an examination of genetic and environmental influences to each potential endophenotype as well as the association of NVS-related constructs with existing clinical disorders/symptoms and risk factors. Similarly, the current study is positioned to examine the underlying structure of NVS constructs based on the correlation of observed phenotypes and the correlation between genetic and environmental influences. Thus, the current study can demonstrate heritability, examine the co-segregation of potential endophenotypes with psychiatric syndromes in families, and clarify the source of familial co-segregation. Additionally, the longitudinal design of this study will permit the examination of change in endophenotype manifestation and clinical diagnoses over a portion of adolescence and young adulthood (Khoo et al., 2006), which may shed light on an endophenotype’s ability to predict risk for and expression of internalizing disorders and internalizing symptoms.

The specific aims of this study included: 1) to examine the factorial architecture and underlying latent structure (at the phenotypic level) of the suite of NVS probes and dimensional measures collected at an initial assessment (i.e., time 1 or T1), 2) to determine the contributions of genetic and environmental factors to the covariance among endophenotypic measures at T1 and between endophenotypic measures and current internalizing disorder symptom expression at T1, 3) to determine the contribution of genetic and environmental factors to the covariance between endophenotypic measures at T1 and internalizing disorder symptom expression at a follow-up assessment (i.e., time 2 or T2), and 4) to determine the stability of NVS endophenotypes from T1 to T2.

Material and Methods

Participants

Participants for the current study were pairs of Caucasian (including Hispanic) and African-American twins (monozygotic, dizygotic same-sex, and dizygotic opposite-sex) between the ages of 15 and 20 (M=17.25 years, SD=1.3) residing in the mid-Atlantic region of the United States (see Table 1). The majority of the current sample (97.7%) were recruited from the Mid-Atlantic Twin Registry (MATR), a database of twins and families who have previously expressed interest in participating in research studies (Lilley & Silberg, 2013). MATR staff informed twins of the appropriate age of the current study and provided contact information of those who expressed interest and met inclusion criteria. The study coordinator then contacted participants to describe the study in more detail and schedule an appointment. A subset of the current sample (2.3%) was recruited directly by study staff through advertisements (e.g., radio, newspaper) in the Richmond, Virginia area. Twins or parents of twins who were interested in the advertisements contacted the study coordinator directly. The study coordinator screened twins and scheduled an appointment if twins were eligible.

Table 1.

Sample Characteristics (430 families; 860 twin adolescents/young adults)

N (%)
Zygosity
 Dizygotic 264 (61.4)
  Opposite-Sex 122 (28.4 of full sample)
 Monozygotic 166 (38.6)
Race
 Caucasian 399 (92.8)
 African American 31 (7.2)
Ethnicity
 Latino/Latina 17 (3.9)
Sex
 Male 368 (42.8)
 Female 492 (57.2)
DSM-5 Diagnoses and Phenomena (Twin)
 Panic Attacks 102 (11.9)
 Panic Disorder 10 (1.2)
 Social Anxiety Disorder 116 (13.5)
 Specific Phobia 102 (11.9)
 Generalized Anxiety Disorder 25 (2.9)
 Major Depressive Disorder 131 (15.3)
DSM-5 Diagnoses and Phenomena (Parent)
 Panic Attacks 59 (14.0)
 Panic Disorder 9 (2.1)
 Social Anxiety Disorder 18 (4.3)
 Specific Phobia 19 (4.5)
 Generalized Anxiety Disorder 46 (10.9)
 Major Depressive Disorder 129 (30.6)

The sample size of T1 (N=430 twin pairs) achieved over 80% power to detect statistical significance of additive genetic effects that explain at least 40% of the variance for the proposed quantitative (endo)phenotypes (Verhulst, 2016).

Inclusion criteria included: a) being an identical or fraternal twin, b) being between the ages of 15 and 20, and c) living primarily at home. Exclusion criteria were: a) current use of psychotropic medications (e.g., antidepressants) or medications with psychotropic effects (e.g., beta-adrenergic blockers), b) diagnosis of an autism spectrum disorder, c) diagnosis of an intellectual disability, d) diagnosis of a spatial learning disorder, or prior testing indicating an IQ below 70, e) seizure without a clear and resolved etiology, f) current or past episodes of psychosis, g) serious, not stabilized illness (e.g., liver, kidney, gastrointestinal, respiratory, cardiovascular, endocrinologic, neurologic, immunologic, or blood disease), h) inadequate production of human growth hormone, i) sensory integration disorder, j) congenital adrenal hyperplasia, k) adrenal inefficiency, l) deaf with bicochlear implants, m) cancer (current or past diagnosis), and n) pregnancy (current or lifetime). A family was excluded if either twin met any exclusionary criteria. Exclusionary criteria were established to reduce interference with physiological data (e.g., psychotropic medications) or participants’ ability to complete laboratory tasks.

Measures

Zygosity

Zygosity status (i.e., monozygotic or dizygotic) for each twin pair was assessed based on parent-reports about physical similarities between twins. When twin participants were over 18 and attended without a parent or legal guardian, twin participants completed the zygosity assessment. Prior research has demonstrated high validity for this zygosity assessment as compared to blood (Kasriel & Eaves, 1976) and DNA evaluations of zygosity (Jackson et al., 2001). In the present study, zygosity estimated from parent- and twin-reported physical similarity showed high concordance with zygosity estimated from assay of single nucleotide polymorphisms (SNPs) on a subset of the sample (N = 82 twin pairs, κ = .95, 95% CI [.88, 1.0]).

DNA samples

Genetic material (i.e., blood) was collected at T1 and will be collected at T2 to leverage genetic candidates identified by large-sample gene discovery efforts (e.g., Power et al., 2017; Otowa et al., 2016). Specifically, future research will follow a deep phenotyping approach (e.g., Stepniak et al., 2014) to examine whether putative genetic correlates of internalizing psychopathology are associated with psychobiological processes assessed here (e.g., Carney et al., 2016, Goodbourn et al., 2014).

Saliva samples

Markers of neuroendocrine function were assayed from saliva collected both at a resting baseline and before and after the Trier Social Stress Test and the 7.5% carbon dioxide (CO2) challenge (see “Laboratory tasks” section below). Salivary cortisol (CORT) indexed neuroendocrine function of the hypothalamic-pituitary-adrenal axis (HPA-axis), while salivary alpha amylase (sAA) indexed function of the sympathetic-adrenal-medullary system (SAM).

Laboratory tasks

Several laboratory tasks, described below, were used to probe NVS-related constructs of interest. See Tables 24 for more detail.

Table 2.

NVS Threat Constructs, Phenotypes, Units of Analysis, and Self-Report Measures


Units of Analysis

Constructs Phenotypes Participant-Report Paradigm Physiological
Acute Threat Phobias Composite International Diagnostic Interview 1,2
Fear generalization Fear Generalization 1,2 EMG, SC 1,2
Interoceptive hypersensitivity CO2 challenge 1,2 HRV, SC, RR, TV, HR 1,2

Potential Threat Anxiety Anxiety Sensitivity Index 1,2
Depression, Anxiety, Stress Scale-21 1,2
Fear Generalization 1,2
Trier Social Stress Test 1,2
CO2 challenge 1,2
EMG, SC 1,2
HRV, SC, RR, HR 1,2
HRV, SC, RR, HR, TV 1,2
Anxiety disorders* Composite International Diagnostic Interview 1,2
Anticipatory anxiety Trier Social Stress Test 1,2
Fear Generalization 1,2
CO2 challenge 1,2
HRV, SC, RR, HR 1,2
EMG, SC 1,2
HRV, SC, RR, HR, TV 1,2

Sustained Threat Emotional recognition Facial Expression Labeling Task1
Fear extinction Fear Generalization 1,2 EMG, SC 1,2
*

Not formally included in RDoC matrix

Note. HRV = heart rate variability; SC = skin conductance; RR = respiration rate; EMG = eye-blink electromyographic response; TV = tidal respiratory volume; HR = heart rate. Superscript of 1 = included in wave 1; superscript of 2 = included in wave 2.

Table 4.

NVS Environmental Risk Factors, Personality Constructs, Alcohol and Substance Use, Phenotypes, Units of Analysis, and Measures


Units of Analysis

Constructs Phenotypes Participant-Report Paradigm Physiological
Risk/Protective Factors Peer victimization Multidimensional Peer Victimization Scale1,2
Index of Peer Relations1,2
Experiences with close relationships-revised1,2
Parent Psychopathology CIDI-SF1
Life events/trauma Stress and Adversity Inventory 1,2
Parenting Parental Bonding Instrument 1

Alcohol Use Severity of Alcohol Use Alcohol Use Disorder Identification Test 1,2
Expectations of Alcohol Use Drinking Expectancy Profile 1,2

Smoking Severity of Nicotine Use Fagerstrom Test of Nicotine Dependence 1,2

Temperament/Personality* Neuroticism, extraversion Eysenck Personality Questionnaire Short Form 1,2
Anxiety sensitivity Anxiety Sensitivity Index 1,2 CO2 challenge 1,2 HRV, SC, RR, TV, HR 1,2
Behavioral inhibition/activation Behavioral Inhibition System/Behavioral Activation System Scales 1,2
Unemotionality Inventory of Callous-Unemotional Traits 1,2
*

Not formally included in RDoC matrix

Note. Superscript of 1 = included in wave 1; superscript of 2 = included in wave 2. HRV = heart rate variability; SC = skin conductance; RR = respiration rate; TV = tidal respiratory volume; CIDI-SF= Composite International Diagnostic Interview-Short Form

Trier Social Stress Test (TSST)

The TSST is a widely-used task used to study stress responsivity following a laboratory-induced stressor (Kirschbaum et al., 1993). Participants were told that they would give a short speech and perform mental arithmetic in front of an audience of three people while being video-taped for a psychologist to later assess. The TSST involved four phases: a five-minute anticipatory stress phase, a five-minute speech phase, a five-minute serial subtraction phase, and a five-minute recovery phase. After five minutes of solitary preparation by the participant, three confederates unknown to the participant entered the room. The confederates maintained a neutral expression throughout the task and provided no feedback (verbal or non-verbal). After the five-minute speech portion, participants were instructed to subtract 13 successively from 1,022. When participants made an error, they were asked to restart at 1,022. After the arithmetic portion ended, the confederates exited the room. The participant remained in the room for five minutes of recovery. Participant stress response during and following the task was assessed by neuroendocrine response (i.e., SAM and HPA axis activity), participant-reported subjective distress (measured by the Subjective Units of Distress Scale [SUDS]; Wolpe, 1969), and psychophysiological response (i.e., respiratory rate [RR], heart rate [HR], heart rate variability [HRV], and skin conductance [SC]). To our knowledge, there has not been any published evidence of test-retest reliability for the TSST.

Fear Generalization (FG)

Previous studies have demonstrated that fear conditioning and generalization of conditioned fear play a role in the formation and maintenance of anxiety disorders (Lissek et al., 2005; 2008; Mineka & Zinbarg, 2006). Hence, the present study used a fear generalization (FG) paradigm, a classical conditioning task with a generalization phase instead of an extinction phase, to examine fear responding. The FG paradigm consisted of three phases—habituation, acquisition, and generalization, occurring in the same order for all participants. The aversive/unconditioned stimulus (US; i.e., a stimulus that elicits an automatic, unlearned response) in this task was a 100-ms electric shock, administered to the left wrist. It was paired with neutral stimuli (i.e., stimuli that do not naturally elicit a target response) until it becomes the conditioned stimulus (CS) and can elicit the target response without the presence of the US. A computer monitor presented the visual conditioned stimuli with the CS+/- randomized to be either a large or small circle. During habituation, participants wore a headset and repeatedly heard a sudden white noise (i.e., startle probe). For acquisition, the CS+ was paired with a shock and the CS- was not. During the acquisition phase, 75% of the CS+ were paired with the shock. The objective of acquisition was for the participant to learn to associate either the little circle or big circle with the shock. For generalization, eight circles (generalization stimuli; GS) of intermediate size rings representing a “continuum-of-size” between the CS+ and CS- were added. During the generalization phase, participants were randomly presented with the CS+/- and six trials from each of the eight GS sizes; 50% of the CS+ presentations were paired with a shock to prevent extinction (Lissek et al., 2008). Startle probes accompanied 50% of acquisition and generalization trials (even) and in the other 50% of trials (odd), participants rated perceived likelihood of shock (i.e., level of risk). The primary psychophysiological outcome measure was fear-potentiated startle magnitude (FPS; relative increase in the amplitude of the acoustic startle response measured by electromyography [EMG]). Additional responses to the task were assessed via subjective distress (Wolpe, 1969) and SC. To our knowledge, there has not been any published evidence of test-retest reliability for the FG task.

7.5% Carbon Dioxide (CO2) Challenge

Variations of the CO2 challenge have been used to assess risk factors for panic disorder (e.g., Papp et al., 1993; Pine et al., 2005). Breathing air with elevated levels of CO2 is known to produce distress as assessed physiologically (Papp et al., 1993) and psychologically (Roberson-Nay et al., 2010) among adults (Roberson-Nay et al., 2013) and children (Pine et al., 2005). Participants wore a facemask for the 20-minute duration of this task and were informed that they would breathe both ambient room air as well as air with an elevated level of CO2. The facemask was connected to a stopcock valve that allowed the experimenter to manually switch from ambient room air to the CO2 air mixture. Participants breathed ambient room air for five minutes (pre-CO2), followed by eight minutes of air enriched to 7.5% CO2, and then a five-minute recovery period (ambient room air). Participants were not told when the CO2 air mixture was turned on or off, thus remaining unaware of the onset and discontinuation of the CO2 air mixture. Anxious arousal during the task was assessed as neuroendocrine response (i.e., SAM and HPA activity), psychophysiological response (i.e., RR, tidal respiratory volume [TV], HR, HRV, and SC), and behavioral response (i.e., whether and when participants prematurely ended the task). Psychological response was assessed as subjective distress (Wolpe, 1969) and panic symptom severity, as measured by the Diagnostic Symptoms Questionnaire (Sanderson et al., 1989). Test-retest reliability of this CO2 challenge task has been previously documented in a young adult sample (Roberson-Nay et al., 2017).

Mirror Tracing Task

Distress tolerance has been frequently associated with internalizing psychopathology risk (Leyro et al., 2010). In the present study, distress tolerance was assessed using the mirror tracing task (Strong et al., 2003). Participants were told to trace the outline of three shapes on the computer screen. They were also told that they could earn more money if they completed the task. To create psychological distress, the actions of the computer mouse and cursor were reversed. When the participant moved the mouse too slowly or moved off the line, a buzz sounded to signal them to restart at the beginning of the shape. Participants first practiced the mechanics of the task on two simple lines. During the trial stage, participants traced the outline of a star. The software was programmed so that the buzzer would sound randomly to prevent participants from completing the star shape. Distress tolerance was assessed behaviorally as the amount of time that a participant persisted on the trial stage. Additionally, subjective distress was assessed by participant self-report to ensure that persistence on the task was not conflated with distress due to the task. To our knowledge, there has not been any published evidence of test-retest reliability for the mirror tracing task.

Facial Expression Labeling Task (FELT)

Deficits in facial emotion recognition have been associated with a variety of internalizing psychiatric syndromes (e.g., Trentacosta & Fine, 2010). During the FELT, participants were asked to choose the emotion of various faces shown on the screen. All faces were Caucasian adults who expressed one of Ekman’s six basic emotions (i.e., happiness, sadness, surprise, fear, disgust, or anger; Ekman & Friesen, 1976). Images were presented to participants at varying degrees of emotional expressivity from 10% to 100% expressivity of the target emotion, such that participants saw a total of 360 images (6 trials X 6 emotions X 10 expressivity levels). Images were created by morphing a picture of the actor making a neutral face with one of the actor expressing the target emotion at 100% intensity. After each face was displayed, participants were asked to choose the emotion displayed from a list of six emotions. Trials were presented in a single randomized order (Blair et al., 2001; Marsh et al., 2010) and have shown test-retest reliability among adult (Adams et al., 2015) and child samples (Cecilione et al., 2017).

Dimensional Participant-Report Measures

Participant-report measures were chosen for inclusion in the current study to assess dimensional severity of internalizing psychopathology, related psychological constructs and behaviors (e.g., irritability, alcohol use), and environmental influences (see Tables 24). All questionnaires were administered via Research Electronic Data Capture (REDCap; Harris et al., 2009), except for the Stress and Adversity Inventory (STRAIN; Slavich & Epel, 2010), which was administered via its own internet-based interface.

Severity of internalizing and related syndromes was assessed based on participant-reported symptoms of depression (Short Mood and Feelings Questionnaire [SMFQ]; Angold et al., 1995 and Depression, Anxiety, Stress Scale−21 [DASS-21]; Lovibond & Lovibond, 1995), anxiety, and stress (DASS-21; Lovibond & Lovibond, 1995). Test-retest reliability and validity have been previously documented for the SMFQ (Turner et al., 2014; Cheng et al., 2009) and the DASS-21 (Mahmoud et al., 2010; Silva et al., 2016) in adolescent or young adult samples. Additionally, participants completed an expanded version of the Composite International Diagnostic Interview-Short Form (CIDI-SF; Wittchen, 1994; Kessler et al., 1998; see Appendix A in Rappaport et al., 2017). Validity and test-retest reliability of the CIDI have been established in adults (Wittchen, 1994); to our knowledge, there has not been any published evidence of test-retest reliability for the CIDI-SF in an adolescent and young adult sample. However, there is evidence of a strong relationship between diagnoses garnered from the CIDI-SF and the full-scale CIDI (Kessler et al., 1998). The present study also assessed related psychological correlates of internalizing psychopathology, including anxiety sensitivity (Anxiety Sensitivity Index [ASI]; Reiss et al., 1986), irritability (Affective Reactivity Index [ARI]; Stringaris et al., 2012), extraversion and neuroticism (modified version of the Eysenck Personality Questionnaire – Short Form [EPQ-SF]; Eysenck et al., 1985; Khan et al., 2005), psychopathy (Inventory of Callous-Unemotional Traits [ICU]; Kimonis et al., 2008), and behavioral inhibition (BIS) and behavioral activation systems (BAS) (BIS/BAS scales; Muris et al., 2005). Test-retest reliability and validity have been previously documented for the ASI (Peterson & Heilbronner, 1987; Vujanovic et al., 2007; Reiss et al., 1986), ARI (Mulraney et al., 2014; Stringaris et al., 2012), EPQ-SF (Sato, 2005; Hosokawa & Ohyama, 1993), ICU (Kimonis et al., 2008; Kimonis et al., 2013; Feilhauer et al., 2012), and the BIS/BAS scales (Carver & White, 1994) in adolescent or young adult samples.

Among potentially important environmental influences, social relationships play a critical role in the development and maintenance of internalizing disorders (Semrud-Clikeman, 2007; Rubin et al., 2009), particularly major depression (Hammen, 2005; Weissman et al., 1971; Kendler & Gardner, 2001). Social relationships were assessed as participant attachment to romantic partners among those who reported a prior or current romantic relationship (Experiences with Close Relationships-Revised [ECR-R]; Fraley et al., 2011), peer relationships (Index of Peer Relations [IPR]; Hudson, 1982), peer victimization (Multidimensional Peer Victimization Scale [MPVS]; Mynard & Joseph, 2000), and parental relationships (Parental Bonding Instrument [PBI]; Parker et al., 1979). Test-retest reliability and validity have been previously demonstrated for the ECR-R (Fairchild & Finney, 2006; Sibley et al., 2005), MPVS (Eastman et al., 2017), and PBI (Parker et al., 1979; Parker, 1989) within adolescent or young adult samples. Validity, but not test-retest reliability, has been established for the IPR in an adolescent sample (Forte & Green, 1994). Prior research also demonstrates the importance of stressful and/or traumatic life events to internalizing disorder risk (Miller et al., 2003; Nugent et al., 2011; Kendler et al., 1999). Stressful life experiences were assessed by participant report on the STRAIN (Slavich & Epel, 2010); test-retest reliability and validity of the STRAIN have been previously demonstrated among adults but not in an adolescent sample (Slavich & Shields, 2017).

Substance use has also been correlated with internalizing disorders and their development, specifically during adolescence and young adulthood (Kendler et al., 2003; Clark & Neighbors, 1996). Participants who reported prior consumption of alcohol completed the Alcohol Use Disorders Identification Test (AUDIT; Saunders et al., 1993) and the Drinking Expectancy Profile (DEP) (Young & Oei, 1996) to assess frequency, severity, and expectations regarding alcohol consumption, respectively. Similarly, severity of nicotine dependence was assessed for current smokers via the Fagerstrom Test of Nicotine Dependence (FTND; Fagerstrom & Schneider, 1989). Test-retest reliability and validity of the AUDIT (de Meneses-Gaya et al., 2009; Selin, 2003) and the FTND (Haddock et al., 1999; Pomerleau et al., 1994) has been previously documented among adults but not yet in an adolescent sample. To our knowledge, there is evidence of validity (Lee et al., 2003), but presently no data on test-retest reliability for the DEP.

Since parental psychopathology and parenting styles have been shown to impact children’s development (e.g., Berg-Nielsen et al., 2002; Walker et al., 1989), parents reported on their lifetime experiences with psychopathology (expanded CIDI-SF), neuroticism and extraversion (modified EPQ-SF), Post-Traumatic Stress Disorder symptom severity (Post-Traumatic Stress Disorder Checklist for the DSM-5 [PCL-5]; Weathers et al., 2013), alcohol use severity (AUDIT), expectations regarding alcohol use (DEP), and severity of nicotine dependence (FTND). Test-retest reliability and validity of the PCL-5 have been previously demonstrated in young adult (Blevins et al., 2015) and veteran (Bovin et al., 2016) samples; to our knowledge, there has not been any published evidence of test-retest reliability of the PCL-5 in an adult community sample. These parent-report measures were collected to assess the role of parental psychopathology and/or substance use in the development of internalizing disorders in adolescents and young adults. Parents also reported on externalizing traits of their twin children (ICU; Kimonis et al., 2008).

Procedure

The study staff explained the study in detail to the participants and their parent(s)/legal guardian(s) and answered all questions prior to consent and assent forms being signed. Participants age 18 and above provided written consent. Participants under age 18 provided written assent after their parent or legal guardian provided written consent. Separate consent and assent were obtained for participation in the blood draw, which was treated as a separate, optional component of the study. The current study was reviewed and approved by the VCU Institutional Review Board.

The current study is longitudinal in design; T1 and T2 are separated by a period of approximately two years. At T1, all twin participants participated in person in a laboratory at VCU. Twin participants were separated from each other at the beginning of the appointment to complete all laboratory tasks (see “Laboratory Tasks” section). Before the twins started the laboratory tasks, their blood was drawn by a study staff member trained in phlebotomy. To reduce the time burden on twins, each completed the tasks in one of two orders. Self-report assessments (see “Dimensional Participant-Report Measures” section) were administered in between the laboratory tasks. Meanwhile, the accompanying parent(s) or legal guardian(s) completed questionnaires about themselves and about their twin children in a separate room. Visits at T1 visits took approximately four and half to five hours to complete.

All twin participants will be invited to participate in some aspect of the T2 follow-up assessment to examine change in NVS-related constructs and internalizing disorder symptomology from T1. All participants will be asked to complete participant-report assessments at T2, and a subset of 150 twin pairs will be invited back into the laboratory for T2 to complete select experimental paradigms from T1 in addition to completing questionnaire measures (see Tables 24). The same consent and blood procedures used in T1 will also be applied to T2 laboratory visits. Like T1, twin participants will be separated from each other to complete laboratory tasks in one of two orders. Visits at T2 will take approximately four hours to complete. Twin participants not selected to return to the laboratory for T2 will complete participant-report measures from their home using electronic data capture methods. T2 study measures will be highly consistent with the T1 assessment measures (see Tables 24).

Results

The full sample for T1 included 430 twin pairs (N=860 individuals) and 422 parents or legal guardians. Table 1 lists the demographic information for this study’s sample. Psychometric and descriptive data for dimensional participant-report assessments are provided in Tables 57.

Table 5.

Statistics for Sum Scores of Twin-Report Measures and Survey Subscales

Measure Mean(SD) Internal Consistency (Cronbach’s α)
Mood and emotion
 Short Mood and Feelings Questionnaire 5.16 (4.44) 0.92
 DASS: Depression 2.67 (3.09) 0.92
 DASS: Anxiety 3.01 (2.91) 0.82
 DASS: Stress 4.98 (3.42) 0.84
 Anxiety Sensitivity Index 17.70 (9.52) 0.89
 Affective Reactivity Index 2.65 (2.56) 0.92

Personality
 EPQ-SF: Neuroticism 4.74 (3.21) 0.90
 EPQ-SF: Extraversion 5.17 (2.35) 0.90
 ICU 21.07 (8.90) 0.89
 BIS 11.50 (4.14) 0.83
 BAS (reward responsiveness) 11.21 (2.59) 0.82
 BAS (drive) 5.15 (2.64) 0.82
 BAS (fun-seeking) 5.91 (2.49) 0.67

Relationships
 Index of Peer Relations 22.54 (14.55) 0.96
 Parental Bonding Instrument (mom): Overprotection 13.15 (6.70) 0.87
 Parental Bonding Instrument (mom): Care 29.21 (6.12) 0.93
 Parental Bonding Instrument (dad): Overprotection 11.03 (6.84) 0.89
 Parental Bonding Instrument (dad): Care 25.53 (7.95) 0.94
 ECR-R: Anxiety 3.26 (1.24) 0.94
 ECR-R: Avoidance 2.84 (1.08) 0.95
 Multidimensional Peer Victimization Scale: Total 5.53 (6.03) 0.95

Note: DASS=Depression, Anxiety, Stress Scale-21, EPQ-SF= Eysenck Personality Questionnaire- Short Form, ECR-R=Experiences with Close Relationships-Revised, ICU=Inventory of Callous-Unemotional Traits, BIS=Behavioral Inhibition System, BAS=Behavioral Activation System

Table 7.

Statistics for sum scores of parent-report measures and survey subscales

Measure Mean (SD) Internal Consistency (Cronbach’s α)
Personality
 EPQ-SF: Neuroticism (about self) 3.18 (3.03) 0.92
 EPQ-SF: Extraversion (about self) 4.41 (2.57) 0.93
 ICU (about twin) 20.03 (9.33) 0.91
Nicotine Use (about use)
 Fagerstrom Test for Nicotine Dependence 3.45 (2.66) 0.60
Alcohol Use (about self)
 DEP: Assertion 28.38 (7.84) 0.88
 DEP: Affective change 20.26 (6.05) 0.89
 DEP: Dependence 13.50 (4.31) 0.81
 DEP: Sexual enhancement 16.30 (2.89) 0.52
 DEP: Cognitive change 7.25 (2.34) 0.77
 DEP: Tension reduction 10.44 (3.29) 0.67
 AUDIT 3.12 (2.51) 0.82
Other
 PCL-5: this month (about self) 6.46 (9.21) 0.95
 PCL-5: lifetime (about self) 8.92 (11.22) 0.96

Note: DASS=Depression, Anxiety, Stress Scale-21, AUDIT= Alcohol Use Disorders Identification Test, DEP=Drinking Expectancy Profile EPQ-SF= Eysenck Personality Questionnaire- Short Form, ECR-R=Experiences with Close Relationships-Revised, PCL-5=Post-Traumatic Stress Disorder Checklist for DSM-5, ICU=Inventory of Callous-Unemotional Traits

Discussion

The current study aimed to identify endophenotypes that may be both risk factors for internalizing psychopathology development and intermediate mechanisms in understanding the developmental pathway from genetic loci to psychiatric syndromes. The present study focused on endophenotypes within the NVS; the dimensions of the NVS describe behavioral, emotional, neurological, genetic and cognitive patterns that traverse internalizing disorders (Insel et al., 2010). Therefore, the constructs of the NVS can be used to understand the development of multiple internalizing disorders and the comorbidity amongst them. It is theorized that NVS processes may explain genetic pleiotropy and common etiology of multiple internalizing disorders.

In keeping with the strengths of multi-trait, multimethod research (Maas et al., 2009), the present study employed a range of methods from participant-report to the assessment of psychophysiological and hormonal responses. Additionally, the current study’s sample and longitudinal design allowed for some examination of internalizing disorder risk and development over a critical developmental period during which many internalizing disorders manifest (Kessler et al., 2005; Merikangas et al., 2010). Of specific relevance to the psychiatric representativeness of the current twin sample, the estimated prevalence rates for panic attacks, panic disorders, generalized anxiety disorder, and major depressive disorder were similar to population estimates, while prevalence rates of specific phobias and social phobia were slightly higher (see Table 1) (Hayward et al., 1989; Merikangas et al., 2010).

As outlined by the RDoC initiative, elucidating the genetic and environmental influences in the development of NVS phenotypes may help clarify the development of internalizing disorders (Insel et al., 2010). Ultimately, it is hoped that this approach will provide additional targets for biological and psychological interventions, which may address processes that occur prior to psychiatric illness onset. These targets may be particularly important in the identification of individuals at risk for later psychopathology, which would guide preventive intervention.

There are several limitations associated with the current study. One limitation is the small sample sizes of African-American and Hispanic twins, which precludes the examination of race/ethnic-specific differences in NVS phenotypes and internalizing disorder risk. A future study with larger samples of other races is necessary to examine race-related differences in endophenotype heritability or internalizing disorder development. Additionally, twin participants each completed laboratory tasks in one of two orders. To account for potential task order effects, task order will be entered into relevant analyses as a covariate. Also, visits were conducted at different times of day. It is possible that participants who participated earlier in the day experienced a different level of fatigue as compared to those who participated in evening visits. The variation in time of day may also complicate analyses of neuroendocrine outcomes (i.e., cortisol). Finally, twins on antidepressants or anti-anxiety medications were excluded from study participation at T1. It may be possible that some variance of internalizing disorder symptom expression may have been lost because of this exclusionary criterion.

The goals of the current study were to 1) examine the relationship between NVS probes (i.e., laboratory tasks) and the participant-report measures collected at T1, 2) clarify the genetic and environmental contributions to endophenotypes and their relationship to internalizing disorders at T1, 3) study the development of internalizing disorders from T1 to T2 by considering the genetic and environmental factors that contribute to change in endophenotypes and internalizing disorder expression over time, and 4) to establish the temporal stability of NVS endophenotypes from T1 to T2. The host of multidimensional measures in conjunction with many units of analysis (e.g., genetic samples, psychophysiological measures, participant-reports, and laboratory paradigms), and the study’s longitudinal design will allow for the thorough examination of each of the study’s primary aims.

Table 3.

NVS Loss/Frustrative Constructs, Phenotypes, Units of Analysis, and Measures


Units of Analysis

Constructs Phenotypes Participant-Report Paradigm
Loss Depression* Short Mood and Feelings Questionnaire 1,2
Depression, Anxiety, Stress Scale-21 1,2
Composite International Diagnostic Interview 1,2

Frustrative Non-Reward Irritability Affective Reactivity Index 1,2
Distress Tolerance Mirror tracing task 1
*

Not formally included in RDoC matrix

Note. Superscript of 1 = included in wave 1; superscript of 2 = included in wave 2.

Table 6.

Statistics for Twin-Report Substance Use Measures

Measure Mean (SD) Internal Consistency (Cronbach’s α)
Nicotine Use (for those who reported smoking cigarettes)
 Fagerstrom Test for Nicotine Dependence 2.25 (2.43) 0.59
Alcohol Use (for those who reported drinking alcohol)
 DEP: Assertion 35.27 (6.73) 0.86
 DEP: Affective change 21.09 (6.60) 0.87
 DEP: Dependence 14.62 (4.10) 0.78
 DEP: Sexual enhancement 16.69 (3.94) 0.76
 DEP: Cognitive change 7.82 (2.60) 0.75
 DEP: Tension reduction 10.26 (3.21) 0.63
 AUDIT 6.18 (4.58) 0.79

Note: DEP=Drinking Expectancy Profile, AUDIT= Alcohol Use Disorders Identification Test

Acknowledgments

The authors sincerely appreciate all the twin participants and their families. This study is also grateful for such wonderful researchers and research staff that helped make this project possible: Ethan Wiley, Caroline Hazlett, Sravya Uppalapiti, Angela Michalak, Zahra Ehtesham, Paul Todela, Jeremy Cornelissen, Nicole Miano, Divya Patel, Jacqueline Roth, Ari Kagan, Alexis Anderson, Bijal Rajput, Ayisha Qadir-Khana, Jamie Mustian, Conner Muth, Anthony Alvarez, Heera Ha and Jessica Ashworth. The authors are also grateful for all the tremendous effort put forth by the Mid-Atlantic Twin Registry, particularly the work of Anne Taylor-Morris and Emily Lilley.

Financial support

This study was supported by the National Institute of Mental Health (R01MH101518 to RRN and T32MH020030 to LMR, AAM, and JES) and by UL1TR000058 to JES and AAM from the NCRR.

Footnotes

The authors do not have any financial interests that might influence this research. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Conflicts of interest

None.

Ethical standards

The authors ensure that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

References

  1. Adams T, Pounder Z, Preston S, Hanson A, Gallagher P, Harmer CJ, McAllister-Williams RH. Test–retest reliability and task order effects of emotional cognitive tests in healthy subjects. Cognition and Emotion. 2016;30(7):1247–1259. doi: 10.1080/02699931.2015.1055713. [DOI] [PubMed] [Google Scholar]
  2. Angold A, Costello EJ, Messer SC, Pickles A. Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. International Journal of Methods in Psychiatric Research. 1995;5:237–249. [Google Scholar]
  3. Berg-Nielsen TS, Vikan A, Dahl AA. Parenting related to child and parental psychopathology: A descriptive review of the literature. Clinical Child Psychology and Psychiatry. 2002;7(4):529–552. [Google Scholar]
  4. Blair RJR, Colledge E, Murray L, Mitchell DGV. A selective impairment in the processing of sad and fearful expressions in children with psychopathic tendencies. Journal of Abnormal Child Psychology. 2001;29(6):491–498. doi: 10.1023/a:1012225108281. [DOI] [PubMed] [Google Scholar]
  5. Blevins CA, Weathers FW, Davis MT, Witte TK, Domino JL. The posttraumatic stress disorder checklist for DSM‐5 (PCL‐5): Development and initial psychometric evaluation. Journal of Traumatic Stress. 2015;28(6):489–498. doi: 10.1002/jts.22059. [DOI] [PubMed] [Google Scholar]
  6. Bovin MJ, Marx BP, Weathers FW, Gallagher MW, Rodriguez P, Schnurr PP, Keane TM. Psychometric properties of the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders–Fifth Edition (PCL-5) in veterans. Psychological Assessment. 2016;28(11):1379. doi: 10.1037/pas0000254. [DOI] [PubMed] [Google Scholar]
  7. Cannon TD, Keller MC. Endophenotypes in the genetic analyses of mental disorders. Annual Review of Clinical Psychology. 2006;2:267–290. doi: 10.1146/annurev.clinpsy.2.022305.095232. [DOI] [PubMed] [Google Scholar]
  8. Carney DM, Moroney E, Machlin L, Hahn S, Savage JE, Lee M, Roberson-Nay R. The twin study of negative valence emotional constructs. Twin Research and Human Genetics. 2016;19(5):456–464. doi: 10.1017/thg.2016.59. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Carver CS, White TL. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales. Journal of Personality and Social Psychology. 1994;67(2):319–333. [Google Scholar]
  10. Cecilione JL, Rappaport LM, Verhulst B, Carney DM, Blair RJR, Hettema JM. Test-retest reliability of the facial expression labeling task. Psychological Assessment. 2017 doi: 10.1037/pas0000439. in press. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Cheng PX, Cao FL, Su LY. Reliability and validity of the Short Mood and Feelings Questionnaire in Chinese adolescents. Chinese Mental Health Journal. 2009;23(1):60–62. 72. [Google Scholar]
  12. Clark DB, Neighbors B. Adolescent substance abuse and internalizing disorders. Child and Adolescent Psychiatric Clinics of North America. 1996;5(1):45–57. [Google Scholar]
  13. de Meneses-Gaya C, Zuardi AW, Loureiro SR, Crippa JAS. Alcohol Use Disorders Identification Test (AUDIT): An updated systematic review of psychometric properties. Psychology & Neuroscience. 2009;2(1):83. [Google Scholar]
  14. Forte JA, Green RG. The reliability and validity of the Index of Peer Relations with a clinical and nonclinical sample of adolescents. Journal of social service research. 1994;19(1–2):49–65. [Google Scholar]
  15. Eastman M, Moore A, Cecilione J, Hettema J, Roberson-Nay R. Confirmatory factor structure and psychometric properties of the multidimensional peer victimization scale Unpublished manusrcript. Department of Psychiatry, Virginia Commonwealth University; Richmond, VA, USA: 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Ekman P, Friesen WV. Pictures of facial affect. Consulting Psychologists Press; 1976. [Google Scholar]
  17. Eysenck SB, Eysenck HJ, Barrett P. A revised version of the psychoticism scale. Personality and Individual Differences. 1985;6(1):21–29. [Google Scholar]
  18. Fagerstrom KO, Schneider NG. Measuring nicotine dependence: a review of the Fagerstrom Tolerance Questionnaire. Journal of Behavioral Medicine. 1989;12(2):159–182. doi: 10.1007/BF00846549. [DOI] [PubMed] [Google Scholar]
  19. Fairchild AJ, Finney SJ. Investigating validity evidence for the experiences in close relationships-revised questionnaire. Educational and Psychological Measurement. 2006;66(1):116–135. [Google Scholar]
  20. Feilhauer J, Cima M, Arntz A. Assessing callous–unemotional traits across different groups of youths: Further cross-cultural validation of the Inventory of Callous–Unemotional Traits. International Journal of Law and Psychiatry. 2012;35(4):251–262. doi: 10.1016/j.ijlp.2012.04.002. [DOI] [PubMed] [Google Scholar]
  21. Fraley RC, Heffernan ME, Vicary AM, Brumbaugh CC. The experiences in close relationships—Relationship Structures Questionnaire: A method for assessing attachment orientations across relationships. Psychological Assessment. 2011;23(3):615. doi: 10.1037/a0022898. [DOI] [PubMed] [Google Scholar]
  22. Goodbourn PT, Bosten JM, Bargary G, Hogg RE, Lawrance-Owen AJ, Mollon JD. Variants in the 1q21 risk region are associated with a visual endophenotype of autism and schizophrenia. Genes, Brain and Behavior. 2014;13(2):144–151. doi: 10.1111/gbb.12096. [DOI] [PubMed] [Google Scholar]
  23. Gottesman II, Gould TD. The endophenotype concept in psychiatry: etymology and strategic intentions. American Journal of Psychiatry. 2003;160(4):636–645. doi: 10.1176/appi.ajp.160.4.636. [DOI] [PubMed] [Google Scholar]
  24. Haddock CK, Lando H, Klesges RC, Talcott GW, Renaud EA. A study of the psychometric and predictive properties of the Fagerström Test for Nicotine Dependence in a population of young smokers. Nicotine & Tobacco Research. 1999;1(1):59–66. doi: 10.1080/14622299050011161. [DOI] [PubMed] [Google Scholar]
  25. Hammen C. Stress and depression. Annual Review of Clinical Psychology. 2005;1:293–319. doi: 10.1146/annurev.clinpsy.1.102803.143938. [DOI] [PubMed] [Google Scholar]
  26. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics. 2009;42(2):377–381. doi: 10.1016/j.jbi.2008.08.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hayward C, Killen JD, Taylor CB. Panic attacks in young adolescents. American Journal of Psychiatry. 1989;146(8):1061–1062. doi: 10.1176/ajp.146.8.1061. [DOI] [PubMed] [Google Scholar]
  28. Hosokawa T, Ohyama M. Reliability and validity of a Japanese version of the short-form Eysenck Personality Questionnaire—Revised. Psychological Reports. 1993;72(3):823–832. [Google Scholar]
  29. Hudson WW. The Clinical Measurement Package: A Field Manual. The Dorsey Press; Illinois: 1982. [Google Scholar]
  30. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, Wang P. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. American Journal of Psychiatry. 2010;167(70):748–751. doi: 10.1176/appi.ajp.2010.09091379. [DOI] [PubMed] [Google Scholar]
  31. Jackson RW, Snieder H, Davis H, Treiber FA. Determination of twin zygosity: a comparison of DNA with various questionnaire indices. Twin Research and Human Genetics. 2001;4(1):12–18. doi: 10.1375/1369052012092. [DOI] [PubMed] [Google Scholar]
  32. Kasriel J, Eaves L. The zygosity of twins: Further evidence on the agreement between diagnosis by blood groups and written questionnaires. Journal of Biosocial Science. 1976;8(3):263–266. doi: 10.1017/s0021932000010737. [DOI] [PubMed] [Google Scholar]
  33. Kendler KS, Gardner CO. Monozygotic twins discordant for major depression: a preliminary exploration of the role of environmental experiences in the aetiology and course of illness. Psychological Medicine. 2001;31(3):411–423. doi: 10.1017/s0033291701003622. [DOI] [PubMed] [Google Scholar]
  34. Kendler KS, Karkowski LM, Prescott CA. Causal relationship between stressful life events and the onset of major depression. American Journal of Psychiatry. 1999;156(6):837–841. doi: 10.1176/ajp.156.6.837. [DOI] [PubMed] [Google Scholar]
  35. Kendler KS, Prescott CA, Myers J, Neale MC. The structure of genetic and environmental risk factors for common psychiatric and substance use disorders in men and women. Archives of General Psychiatry. 2003;60(9):929–937. doi: 10.1001/archpsyc.60.9.929. [DOI] [PubMed] [Google Scholar]
  36. Kessler RC, Andrews G, Mroczek D, Ustun B, Wittchen HU. The world health organization composite international diagnostic interview short‐form (cidi‐sf) International Journal of Methods in Psychiatric Research. 1998;7(4):171–185. [Google Scholar]
  37. Kessler RC, Avenevoli S, McLaughlin KA, Green JG, Lakoma MD, Petukhova M, Merikangas KR. Lifetime co-morbidity of DSM-IV disorders in the US national comorbidity survey replication adolescent supplement (NCS-A) Psychological Medicine. 2012;42(09):1997–2010. doi: 10.1017/S0033291712000025. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry. 2005;62(6):593–602. doi: 10.1001/archpsyc.62.6.593. [DOI] [PubMed] [Google Scholar]
  39. Khan AA, Jacobson KC, Gardner CO, Prescott CA, Kendler KS. Personality and comorbidity of common psychiatric disorders. The British Journal of Psychiatry. 2005;186(3):190–196. doi: 10.1192/bjp.186.3.190. [DOI] [PubMed] [Google Scholar]
  40. Khoo ST, West S, Wu W, Kwok OM. Longitudinal methods. Handbook of Multimethod Measurement in Psychology. 2006:301–317. [Google Scholar]
  41. Kimonis ER, Frick PJ, Skeem JL, Marsee MA, Cruise K, Munoz LC, Morris AS. Assessing callous–unemotional traits in adolescent offenders: Validation of the Inventory of Callous–Unemotional Traits. International Journal of Law and Psychiatry. 2008;31(3):241–252. doi: 10.1016/j.ijlp.2008.04.002. [DOI] [PubMed] [Google Scholar]
  42. Kimonis ER, Branch J, Hagman B, Graham N, Miller C. The psychometric properties of the Inventory of Callous–Unemotional Traits in an undergraduate sample. Psychological Assessment. 2013;25(1):84–93. doi: 10.1037/a0029024. [DOI] [PubMed] [Google Scholar]
  43. Kirschbaum C, Pirke KM, Hellhammer DH. The ‘Trier Social Stress Test’–a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology. 1993;28(1–2):76–81. doi: 10.1159/000119004. [DOI] [PubMed] [Google Scholar]
  44. Lee NK, Oei TP, Greeley JD, Baglioni AJ., Jr Psychometric properties of the Drinking Expectancy Questionnaire: a review of the factor structure and a proposed new scoring method. Journal of Studies on Alcohol. 2003;64(3):432–436. doi: 10.15288/jsa.2003.64.432. [DOI] [PubMed] [Google Scholar]
  45. Leyro TM, Zvolensky MJ, Bernstein A. Distress tolerance and psychopathological symptoms and disorders: a review of the empirical literature among adults. Psychological Bulletin. 2010;136(4):576. doi: 10.1037/a0019712. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Lilley ECH, Silberg JL. The Mid-Atlantic Twin Registry, Revisited. Twin Research and Human Genetics. 2013;16(1):424–428. doi: 10.1017/thg.2012.125. [DOI] [PubMed] [Google Scholar]
  47. Lissek S, Biggs AL, Rabin SJ, Cornwell BR, Alvarez RP, Pine DS, Grillon C. Generalization of conditioned fear-potentiated startle in humans: experimental validation and clinical relevance. Behaviour Research and Therapy. 2008;46(5):678–687. doi: 10.1016/j.brat.2008.02.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Lissek S, Powers AS, McClure EB, Phelps EA, Woldehawariat G, Grillon C, Pine DS. Classical fear conditioning in the anxiety disorders: a meta-analysis. Behaviour Research and Therapy. 2005;43(11):1391–1424. doi: 10.1016/j.brat.2004.10.007. [DOI] [PubMed] [Google Scholar]
  49. Lovibond SH, Lovibond PF. Manual for the depression anxiety stress scales. Sydney: Psychology Foundation; 1995. [Google Scholar]
  50. Maas CJ, Lensvelt-Mulders GJ, Hox JJ. A multilevel multitrait-multimethod analysis. Methodology. 2009;5(3):72–77. [Google Scholar]
  51. Mahmoud JSR, Hall LA, Staten R. The psychometric properties of the 21-Item Depression Anxiety and Stress Scale (DASS-21) among a sample of young adults. Southern Online Journal of Nursing Research. 2010;10(4):21–34. [Google Scholar]
  52. Marsh AA, Yu HH, Pine DS, Blair RJR. Oxytocin improves specific recognition of positive facial expressions. Psychopharmacology. 2010;209(3):225–232. doi: 10.1007/s00213-010-1780-4. [DOI] [PubMed] [Google Scholar]
  53. Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, Swendsen J. Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A) Journal of the American Academy of Child & Adolescent Psychiatry. 2010;49(10):980–989. doi: 10.1016/j.jaac.2010.05.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Miller MW, Greif JL, Smith AA. Multidimensional Personality Questionnaire profiles of veterans with traumatic combat exposure: externalizing and internalizing subtypes. Psychological Assessment. 2003;15(2):205. doi: 10.1037/1040-3590.15.2.205. [DOI] [PubMed] [Google Scholar]
  55. Mineka S, Zinbarg R. A contemporary learning theory perspective on the etiology of anxiety disorders: it’s not what you thought it was. American Psychologist. 2006;61(1):10. doi: 10.1037/0003-066X.61.1.10. [DOI] [PubMed] [Google Scholar]
  56. Mulraney MA, Melvin GA, Tonge BJ. Psychometric properties of the Affective Reactivity Index in Australian adults and adolescents. Psychological Assessment. 2014;26(1):148–155. doi: 10.1037/a0034891. [DOI] [PubMed] [Google Scholar]
  57. Muris P, Meesters C, de Kanter E, Timmerman PE. Behavioural inhibition and behavioural activation system scales for children: relationships with Eysenck’s personality traits and psychopathological symptoms. Personality and Individual Differences. 2005;38(4):831–841. [Google Scholar]
  58. Mynard H, Joseph S. Development of the multidimensional peer-victimization scale. Aggressive Behavior. 2000;26(2):169–178. [Google Scholar]
  59. NIMH. RDoC Matrix. 2017 Retrieved June 20, 2017, from https://www.nimh.nih.gov/research-priorities/rdoc/constructs/rdoc-matrix.shtml.
  60. Nugent NR, Tyrka AR, Carpenter LL, Price LH. Gene–environment interactions: early life stress and risk for depressive and anxiety disorders. Psychopharmacology. 2011;214(1):175–196. doi: 10.1007/s00213-010-2151-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Otowa T, Hek K, Lee M, Byrne EM, Mirza SS, Nivard MG, Hettema JM. Meta-analysis of genome-wide association studies of anxiety disorders. Molecular Psychiatry. 2016;21:1391–1399. doi: 10.1038/mp.2015.197. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. Papp LA, Klein DF, Martinez J, Schneier F, Cole R, Liebowitz MR, Gorman JM. Diagnostic and substance specificity of carbon-dioxide-induced panic. American Journal of Psychiatry. 1993;150:250–250. doi: 10.1176/ajp.150.2.250. [DOI] [PubMed] [Google Scholar]
  63. Parker G, Tupling H, Brown LB. A parental bonding instrument. British Journal of Medical Psychology. 1979;52(1):1–10. [Google Scholar]
  64. Parker G. The parental bonding instrument: psychometric properties reviewed. Psychiatric Developments. 1989;7(4):317–335. [PubMed] [Google Scholar]
  65. Peterson RA, Heilbronner RL. The anxiety sensitivity index:: Construct validity and factor analytic structure. Journal of Anxiety Disorders. 1987;1(2):117–121. [Google Scholar]
  66. Pine DS, Klein RG, Roberson-Nay R, Mannuzza S, Moulton JL, Woldehawariat G, Guardino M. Response to 5% carbon dioxide in children and adolescents: relationship to panic disorder in parents and anxiety disorders in subjects. Archives of General Psychiatry. 2005;62(1):73–80. doi: 10.1001/archpsyc.62.1.73. [DOI] [PubMed] [Google Scholar]
  67. Pomerleau CS, Carton SM, Lutzke ML, Flessland KA, Pomerleau OF. Reliability of the Fagerstrom tolerance questionnaire and the Fagerstrom test for nicotine dependence. Addictive Behaviors. 1994;19(1):33–39. doi: 10.1016/0306-4603(94)90049-3. [DOI] [PubMed] [Google Scholar]
  68. Power RA, Tansey KE, Buttenschøn N, Cohen-Woods S, Bigdeli T, Hall LS, Lewis CM. Genome-wide association for major depression through age at onset stratification: Major depressive disorder working group of the Psychiatric Genomics Consortium. Biological Psychiatry. 2017;81:325–335. doi: 10.1016/j.biopsych.2016.05.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Rappaport LM, Sheerin C, Savage JE, Hettema JM, Roberson-Nay R. Clinical characteristics of latent classes of CO 2 hypersensitivity in adolescents and young adults. Behaviour Research and Therapy. 2017;93:95–103. doi: 10.1016/j.brat.2017.03.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Reiss S, Peterson RA, Gursky DM, McNally RJ. Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behaviour Research and Therapy. 1986;24(1):1–8. doi: 10.1016/0005-7967(86)90143-9. [DOI] [PubMed] [Google Scholar]
  71. Roberson-Nay R, Klein DF, Klein RG, Mannuzza S, Moulton JL, Guardino M, Pine DS. Carbon dioxide hypersensitivity in separation-anxious offspring of parents with panic disorder. Biological psychiatry. 2010;67(12):1171–1177. doi: 10.1016/j.biopsych.2009.12.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Roberson-Nay R, Gorlin EI, Beadel JR, Cash T, Vrana S, Teachman BA. Temporal stability of multiple response systems to 7.5% carbon dioxide challenge. Biological Psychology. 2017;124:111–118. doi: 10.1016/j.biopsycho.2017.01.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Roberson‐Nay R, Moruzzi S, Ogliari A, Pezzica E, Tambs K, Kendler KS, Battaglia M. Evidence for distinct genetic effects associated with response to 35% CO2. Depression and Anxiety. 2013;30(3):259–266. doi: 10.1002/da.22038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Rubin KH, Coplan RJ, Bowker JC. Social withdrawal in childhood. Annual Review of Psychology. 2009;60:141. doi: 10.1146/annurev.psych.60.110707.163642. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. Sanderson WC, Rapee RM, Barlow DH. The influence of an illusion of control on panic attacks induced via inhalation of 5.5% carbon dioxide-enriched air. Archives of General Psychiatry. 1989;46(2):157–162. doi: 10.1001/archpsyc.1989.01810020059010. [DOI] [PubMed] [Google Scholar]
  76. Sato T. The Eysenck personality questionnaire brief version: Factor structure and reliability. The Journal of Psychology. 2005;139(6):545–552. doi: 10.3200/JRLP.139.6.545-552. [DOI] [PubMed] [Google Scholar]
  77. Saunders JB, Aasland OG, Babor TF, De la Fuente JR, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption‐II. Addiction. 1993;88(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
  78. Selin KH. Test-retest reliability of the Alcohol Use Disorder Identification Test in a general population sample. Alcoholism: Clinical and Experimental Research. 2003;27:1428–1435. doi: 10.1097/01.ALC.0000085633.23230.4A. [DOI] [PubMed] [Google Scholar]
  79. Semrud-Clikeman M. Social Competence in Children. Springer; US: 2007. Social competence in children; pp. 1–9. [Google Scholar]
  80. Sibley CG, Fischer R, Liu JH. Reliability and validity of the revised experiences in close relationships (ECR-R) self-report measure of adult romantic attachment. Personality and Social Psychology Bulletin. 2005;31(11):1524–1536. doi: 10.1177/0146167205276865. [DOI] [PubMed] [Google Scholar]
  81. Silva HAD, Passos MHPD, Oliveira VMAD, Palmeira AC, Pitangui ACR, Araújo RCD. Short version of the Depression Anxiety Stress Scale-21: is it valid for Brazilian adolescents? Einstein (São Paulo) 2016;14(4):486–493. doi: 10.1590/S1679-45082016AO3732. [DOI] [PMC free article] [PubMed] [Google Scholar]
  82. Slavich GM, Epel ES. The Stress and Adversity Inventory (STRAIN): An Automated System for Assessing Cumulative Stress Exposure. Los Angeles, CA: University of California, Los Angeles; 2010. [Google Scholar]
  83. Slavich GM, Shields GS. Assessing Lifetime Stress Exposure using the Stress and Adversity Inventory for Adults (Adult STRAIN): An Overview and Initial Validation. Psychosomatic Medicine. 2017 doi: 10.1097/PSY.0000000000000534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Stepniak B, Papiol S, Hammer C, Ramin A, Everts S, Hennig L, Begemann M, Ehrenreich H. Accumulated environmental risk determining age at schizophrenia onset: A deep phenotyping-based study. Lancet Psychiatry. 2014;1:444–453. doi: 10.1016/S2215-0366(14)70379-7. [DOI] [PubMed] [Google Scholar]
  85. Stringaris A, Goodman R, Ferdinando S, Razdan V, Muhrer E, Leibenluft E, Brotman MA. The Affective Reactivity Index: a concise irritability scale for clinical and research settings. Journal of Child Psychology and Psychiatry. 2012;53(11):1109–1117. doi: 10.1111/j.1469-7610.2012.02561.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  86. Strong DR, Lejuez CW, Daughters S, Marinello M, Kahler CW, Brown RA. Unpublished manual. 2003. The computerized mirror tracing task, version 1. [Google Scholar]
  87. Trentacosta CJ, Fine SE. Emotion Knowledge, Social Competence, and Behavior Problems in Childhood and Adolescence: A Meta-analytic Review. Social Development. 2010;19(1):1–29. doi: 10.1111/j.1467-9507.2009.00543.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Turner N, Joinson C, Peters TJ, Wiles N, Lewis G. Validity of the Short Mood and Feelings Questionnaire in late adolescence. Psychological Assessment. 2014;26(3):752–762. doi: 10.1037/a0036572. [DOI] [PubMed] [Google Scholar]
  89. Verhulst B. A Power Calculator for the Classical Twin Design. Behavior Genetics. 2016;47(2):1–7. doi: 10.1007/s10519-016-9828-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Vujanovic AA, Arrindell WA, Bernstein A, Norton PJ, Zvolensky MJ. Sixteen-item Anxiety Sensitivity Index: confirmatory factor analytic evidence, internal consistency, and construct validity in a young adult sample from the Netherlands. Assessment. 2007;14(2):129–143. doi: 10.1177/1073191106295053. [DOI] [PubMed] [Google Scholar]
  91. Young RM, Oei TPS. Drinking expectancy profile: Test manual. Behavior Research and Therapy Centre, University of Qld; 1996. [Google Scholar]
  92. Walker E, Downey G, Bergman A. The effects of parental psychopathology and maltreatment on child behavior: A test of the diathesis-stress model. Child Development. 1989;60(1):15–24. doi: 10.1111/j.1467-8624.1989.tb02691.x. [DOI] [PubMed] [Google Scholar]
  93. Weathers FW, Litz BT, Keane TM, Palmieri PA, Marx BP, Schnurr PP. The PTSD Checklist for DSM-5 (PCL-5) 2013 Scale available from the National Center for PTSD at www.ptsd.va.gov.
  94. Weissman MM, Paykel ES, Siegel R, Klerman GL. The social role performance of depressed women: comparisons with a normal group. American Journal of Orthopsychiatry. 1971;41(3):390. doi: 10.1111/j.1939-0025.1971.tb01126.x. [DOI] [PubMed] [Google Scholar]
  95. Wittchen HU. Reliability and validity studies of the WHO-composite international diagnostic interview (CIDI): A critical review. Journal of Psychiatric Research. 1994;28:57–84. doi: 10.1016/0022-3956(94)90036-1. [DOI] [PubMed] [Google Scholar]
  96. Wolpe J. The practice of behavior therapy. New York: Pergamon Press; 1969. [Google Scholar]

RESOURCES