Abstract
Objective
Exposure to psychotropic medications before the onset of bipolar disorder (BD) in children may have profound effects on the course of illness. Both antidepressant and stimulant exposure have been proposed to hasten the course of BD development, whereas mood stabilizers have been proposed as protective. We sought to describe psychotropic medication exposure in a cohort of children at risk for BD and retrospectively determine the effect of medication exposure on age at onset (AAO) of BD.
Methods
Subjects were 106 children and adolescents who had at least 1 parent with BD. Of these, 63 had BD I or BD II and 43 had subsyndromal symptoms of BD. AAO was determined as nearest month of first manic or hypomanic episode. Past psychotropic medication exposure prior to AAO was determined through interview and chart review.
Results
Both groups had high rates of exposure to psychotropic medications. Antidepressant or stimulant exposure was not correlated with an earlier AAO of BD. However, mood stabilizer exposure was associated with a later AAO.
Conclusions
Children with full or subsyndromal BD are frequently exposed to a variety of psychotropic medications before their first manic episode. Our findings do not support that early stimulant or antidepressant exposure leads to an earlier AAO of BD. However, early mood stabilizer exposure may be associated with delayed AAO. Longitudinal studies are needed to clarify these results.
Introduction
It is clear that certain psychotropic medications may trigger manic episodes or worsen manic symptoms in patients with bipolar disorder (BD). In adults, tricyclic antidepressants have been reported to carry the highest risk of switching into mania (Wehr and Goodwin 1987; Gijsman et al. 2004; Koszewska and Rybakowski 2009). Many other studies have reported that serotonin reuptake inhibitors (SSRIs) can also induce the switch into manic episodes in adults with BD (Howland 1996; Henry et al. 2001; Post et al. 2001). Less understood is the phenomenon of first manic episode induced by antidepressant treatment. Often these patients may go on to experience nonmedication-induced mania, but whether antidepressants directly caused a manic episode in these patients or uncovered a latent BD is unclear (Goldberg and Truman 2003). The unproven possibility remains that these patients might never have developed manic episodes without this intervention.
Controlled data in children with BD are lacking, but retrospective reports suggest that children with BD may be even more susceptible than adults to SSRI-induced mania (Biederman et al. 2000; Cicero et al. 2003; Faedda et al. 2004). More disturbing is the possibility that children with BD may have had SSRI exposure before their first manic episode, which may have led to or hastened the development of mania. This phenomenon has been reported (Guile 1996; Go et al. 1998); however, due to the difficult nature of prospectively studying such events, we are lacking clear data on who is at highest risk for this manic conversion. Nevertheless, an analysis of a health maintenance organization (HMO) database of over 80,000 patients 5–29 years old found children 10–14 years old to be at the highest risk for switching from a diagnosis of major depressive disorder (MDD) to BD after being prescribed an SSRI (Martin et al. 2004). This finding would suggest that children, perhaps during menarche/adrenarche, are at greatest risk for SSRI-induced manias. However, there have been no prospective studies of high-risk populations examining age at onset (AAO) of BD that control for exposure to psychotropic medications such as stimulants and antidepressants (Carlson et al. 2000a).
Stimulants also have been proposed to possess the propensity for causing or exacerbating mania in children (Koehler-Troy et al. 1986; Vitiello 2001; Scheffer et al. 2005). Whether these agents can hasten the development of BD in a patient who has not yet had a manic episode is again unclear. It has been argued that early stimulant exposure in certain subsets of children with attention-deficit/hyperactivity disorder (ADHD) may lead to an earlier AAO of BD compared to children who were not exposed to stimulants and who still later developed BD (DelBello et al. 2001b; Reichart and Nolen 2004). Furthermore, children with BD and a premanic exposure to stimulants may have a more severe course of BD than those who were not exposed (Soutullo et al. 2002). Yet other researchers have suggested that stimulant exposure in youth with ADHD and mood symptoms does not necessarily lead to high rates of bipolar development (Carlson et al. 2000a; Galanter et al. 2003). Again, rigorous retrospective or prospective studies of stimulant exposure effects on AAO would be helpful in this debate.
Alternately, it has been proposed that mood stabilizers could delay or prevent the onset of BD if used before the onset of the first manic episode (Chang et al. 2003b). The utility of these medications in preventing bipolar relapse and their neuroprotective potential (Manji et al. 2000) argues for the likelihood of this effect. We earlier reported that open divalproex was effective in treating acute mood symptoms of children with subsyndromal BD (Chang et al. 2003b). However, it is not clear whether this intervention could delay or prevent the onset of BD in these high-risk children, because a maintenance study of divalproex in such children was negative (Findling et al. 2007).
Due to the high heritability of BD, offspring of parents with BD (“bipolar offspring”) are clearly at increased risk for BD themselves (Chang et al. 2003a). Cross-sectional studies of bipolar offspring have reported 14–50% to have bipolar spectrum disorders, with 5–14% having BD I or BD II (Chang and Steiner 2003). Furthermore, bipolar offspring also have high rates of ADHD, depression, and anxiety (DelBello and Geller 2001). Many of these children, especially those who already have ADHD with mood symptoms and/or MDD, are likely experiencing a prodrome to full BD (Chang et al. 2006). Thus, these children may possess an underlying neurobiology similar to children with fully developed BD and therefore share a similar vulnerability to SSRI- or stimulant-induced mania. Yet, because they present with ADHD or depression, it is possible that they are being treated with these potentially deleterious agents. These offspring represent an important population to study for potential AAO effects, negative or positive, of early psychotropic medication exposure.
Therefore, we wished to examine the effects of psychotropic medication on the development of BD in children and adolescents. Although a prospective study would be a more powerful design, in this initial study we first sought to collect retrospective data regarding overall medication exposure in a cohort of bipolar offspring with either subsyndromal or fully developed BD. We also retrospectively assessed AAO of the first manic episode for those offspring already with BD. We hypothesized that offspring with BD would have had greater rates of past exposure to stimulants and antidepressants than those offspring with only subsyndromal BD, and that such medication exposure would be associated with an earlier AAO. Conversely, we hypothesized that those offspring with BD who had previous exposure to mood stabilizers would have a later AAO than those without such exposure.
Methods
This study was approved by the Stanford University Panel on Human Subjects in Medical Research. We collected medication histories from 106 children with at least one parent with BD I or BD II. These children were recruited as part of an ongoing larger longitudinal study of bipolar offspring (Chang et al. 2000). Signed written consent was obtained from parents or guardians and written assent was obtained from subjects. Subjects were recruited from parents who were patients at the Stanford University Bipolar Disorders Clinic, from local support groups for bipolar adults, and from the surrounding community. The sample used in this study was recruited selectively for having either suspected BD or early forms of BD (Fig. 1).
FIG. 1.
Demographics of Offspring with BD or Subsyndromal BD
Parents and offspring were diagnosed by semistructured interviews, using the Structured Clinical Interview for DSM-IVAxis I Disorders (SCID) (First et al. 1995) for parents and the Washington University in St. Louis Kiddie Schedule for Affective Disorders and Schizophrenia (WASH-U K-SADS) (Geller et al. 1996) for offspring.
We obtained family history of mood disorder using the Family History–Research Diagnostic Criteria (FH-RDC) (Andreasen et al. 1977) and parental history of ADHD using the behavioral disorders supplement from the K-SADS–Present and Lifetime version (K-SADS-PL) (Kaufman 1997). We also assessed current manic symptom severity using the Young Mania Rating Scale (YMRS) (Young et al. 1978) and depression symptom severity using the Children's Depression Rating Scale–Revised (CDRS-R) (Poznanski and Mokros 1995). Subjects were included in the BD group if they had a diagnosis of BD I or BD II, and the subsyndromal BD group if they had a diagnosis of ADHD with significant mood symptoms, as determined by a co-morbid mood disorder (MDD, dysthymia, cyclothymia) or a YMRS >12 or CDRS-R >28. We used the term “subsyndromal” to indicate that they did not meet the syndromal criteria for a full manic episode, even though subjects could have only depressive symptoms in addition to symptoms of ADHD.
Psychotropic medication exposure history was obtained through interviewing the child and parent(s), reviewing medical records, and interviewing the treating physician when possible. The medications examined were stimulants, antidepressants (SSRIs and tricyclic antidepressants [TCAs]), atypical antidepressants (venlafaxine, bupropion, trazodone), antipsychotics, mood stabilizers (lithium, divalproex, and carbamazepine), and other anticonvulsants (oxcarbazepine, topiramate, gabapentin). Duration of medication exposure was rounded to the nearest month. Exposure for less than 2 weeks of a medication was not counted as medication exposure (unless there was a clear reaction to the medication, such as a worsening of mood or mania). Total months exposed were calculated by adding all separate months of exposure for that particular medication type.
We considered the AAO of BD to be the age, rounded to the nearest month, at which the child first met criteria for a manic or hypomanic episode according to the Diagnostic and Statistical Manual of Mental Disorders–Text Revision (DSM-IV-TR) (American Psychiatric Association 2000). This was chosen over age at first affective episode due to the question of whether treatment with stimulants or antidepressants led to earlier mania. However, we did not consider a manic episode that was clearly linked to de novo antidepressant use to be the first “true” manic episode, because according to the DSM-IV-TR, this would be a manic episode due to medication. To obtain first presentation of manic symptoms, we used the questions within the WASH-U-K-SADS to find the earliest age at which children met criteria for mania. For example, if a child exhibited a significant episode of irritability at age 6 years 7 months, but did not have other symptoms of mania until meeting a full episode criteria at 9 years 4 months, we considered 9 years 4 months to be the AAO of mania.
Statistical analysis
Descriptive statistics, means, standard deviations (SD), and percentages were used for all continuous and categorical variables, respectively. Because AAO data were normally distributed, independent t-tests were used to compare AAO between groups with and without particular medication exposure. Significance threshold was considered to be p = 0.05, except for the analysis of medications thought to cause earlier AAO, for which a Bonferroni correction was used to set the threshold at p = 0.025. No corrections for multiple comparisons were used for exploratory analyses of effects of medications other than stimulants, antidepressants, and mood stabilizers on AAO.
Results
Medication exposure in offspring with subsyndromal BD
The offspring with subsyndromal BD consisted of 43 subjects (30 male, 13 female) with a mean age of 12.3 ± 2.8 years (Table 1). Of these subjects, 42% had at least two co-morbid psychiatric diagnoses, with 39.5% having a diagnosis of MDD, 41.9% generalized anxiety disorder (GAD), 34.5% oppositional defiant disorder (ODD), and 100% ADHD. Regarding parents, 53.5% had BD I, 46.5% had BD II, and 69.8% of parents with BD were mothers. The percent of first- or second-degree relatives (of the child) in each family having a history of mood disorder was 49% ± 13%. Four offspring subjects (9.3%) had a history of psychosis.
Table 1.
Demographics of Offspring with BD or Subsyndromal BD
| Demographics | Offspring with BD (n = 63) | Offspring with subsyndromal BD (n = 43) |
|---|---|---|
| Age at interview, years | 13.07 ± 3.5 | 12.3 ± 2.8 |
| Gender | ||
| Male | 42 (66.7) | 30 (69.8) |
| Female | 21 (33.3) | 13 (30.2) |
| Family history (% of first- or second-degree relatives with a mood disorder) | 53 ± 20 | 49 ± 13 |
| Diagnoses, n (%) | ||
| GAD | 20 (31.7) | 18 (41.9) |
| ADHD | 51 (81.0) | 43 (100.0) |
| ODD | 35 (55.6) | 17 (39.5) |
| MDD | N/A | 17 (39.5) |
| Dysthymia | N/A | 4 (9.3) |
| Cyclothymia | N/A | 2 (4.7) |
| BD | ||
| Type I | 49 (77.8) | N/A |
| Type II | 14 (22.2) | |
| YMRS score | 14.7 ± 5.3 | 13.9 ± 1.1 |
| CDRS score | 32.4 ± 7.5 | 31.8 ± 3.0 |
| Mean total number of diagnoses | 2.7 ± 1.0 | 2.2 ± .78 |
| Age at onset of BD, years | 11.3 ± 3.7 | N/A |
Abbreviations: BD = bipolar disorder; GAD = generalized anxiety disorder; ADHD = attention-deficit/hyperactivity disorder; ODD =oppositional defiant disorder; MDD = major depressive disorder; YMRS = Young Mania Rating Scale; CDRS = Children's Depression Rating Scale; N/A = not applicable.
The mean number of psychotropic medications ever taken by these subjects was 2.7 ± 1.9. Of these 43 offspring, 62.8% had been exposed to stimulants, 39.5% SSRIs, 25.6% atypical antidepressants (nefazadone, buproprion, or venlafaxine), 7.0% TCAs, 34.9% mood stabilizers (lithium, carbamazepine, valproate), and 27.9% atypical antipsychotics (risperidone, olanzapine, and quetiapine). Of the mood stabilizers, 43.3% took valproate, and 7.0% lithium (Table 2).
Table 2.
Comparison of Lifetime Medication Exposure Between Bipolar Offspring Groups
| Medication | Number exposed, bipolar(m = 63) | Number exposed, subsyndromal(m = 43) | Chi- squared | p | |
|---|---|---|---|---|---|
| Stimulants | Yes | 41 | 27 | 0.06 | 0.81 |
| No | 22 | 16 | |||
| SSRIs | Yes | 44 | 17 | 9.6 | 0.02 |
| No | 19 | 26 | |||
| Mood stabilizers | Yes | 44 | 15 | 12.7 | <0.001 |
| No | 19 | 28 | |||
| TCAs | Yes | 9 | 3 | 1.4 | 0.24 |
| No | 54 | 40 | |||
| Other anticonvulsants | Yes | 11 | 4 | 1.4 | 0.24 |
| No | 52 | 39 | |||
| Atypical antipsychotics | Yes | 35 | 12 | 7.9 | 0.01 |
| No | 28 | 31 | |||
| Valproate | Yes | 31 | 13 | 3.8 | 0.05 |
| No | 32 | 30 | |||
| Lithium | Yes | 17 | 3 | 6.7 | 0.01 |
| No | 46 | 40 | |||
| Atypical antidepressants | Yes | 31 | 11 | 6.0 | 0.02 |
| No | 32 | 32 | |||
Abbreviations: SSRIs = Selective serotonin reuptake inhibitors; TCAs = tricyclic antidepressants.
Medication exposure in offspring with BD
There were 63 offspring with BD (42 male, 21 female), diagnosed with BD I (77.8%) or BD II (22.2%), and with a mean age of 13.1 ± 3.5 years (Table 1). Of the parents with BD, 55% had BD I, 45% had BD II, and 76.7% were mothers. The mean percentage of first- or second-degree relatives in each family with a history of mood disorder was 53% ± 20%.
The mean AAO of BD was 11.3 ± 3.7 years and the mean duration of illness was 1.8 ± 1.9 years. The majority (88.3%) of subjects with BD had at least one co-morbid psychiatric diagnosis: 81.0% had ADHD, 55.6% ODD, and 31.7% GAD. Nineteen subjects (30.2%) had experienced psychotic symptoms in the past.
For offspring with BD, the mean number of medications ever taken prior to AAO was 2.2 ± 2.1. Six of the subjects did not have a complete medication history. Sixteen (25.4%) of the subjects had not been on any medications prior to AAO. Forty one of the remaining subjects had been exposed to psychotropic medications: 46.7% stimulants, 51.7% SSRIs, 15% TCAs, 39.7% atypical antidepressants, 23.7% mood stabilizers (11.9% lithium, 11.7% valproate), and 10.2% atypical antipsychotics (Table 3). Furthermore, 15.9% had been exposed to both SSRI and mood stabilizers, and 28.6% had been exposed to both SSRIs and stimulants.
Table 3.
Medication Exposure Prior to AAO
| Medication (number unknown if exposed) | Number exposed | AAO, years (SD) | T | P | |
|---|---|---|---|---|---|
| Stimulants (3) | Yes | 28 | 11.7 (3.3) | 0.60 | 0.55 |
| No | 32 | 11.1 (4.1) | |||
| SSRIs (3) | Yes | 31 | 12.1 (3.5) | 1.6 | 0.11 |
| No | 29 | 10.6 (3.8) | |||
| Mood stabilizers (4) | Yes | 14 | 13.0 (2.8) | 2.4 | 0.03 |
| No | 45 | 10.8 (3.8) | |||
| TCAs (3) | Yes | 9 | 11.3 (2.7) | 0.07 | 0.94 |
| No | 51 | 11.4 (3.9) | |||
| Other anticonvulsants (4) | Yes | 5 | 14.5 (2.9) | 1.98 | 0.05 |
| No | 54 | 11.1 (3.7) | |||
| Atypical antipsychotics (4) | Yes | 6 | 12.0 (3.3) | 0.43 | 0.67 |
| No | 53 | 11.3 (3.8) | |||
| Valproate (3) | Yes | 7 | 13.1 (3.2) | 1.34 | 0.19 |
| No | 53 | 11.1 (3.7) | |||
| Lithium (4) | Yes | 7 | 14.4 (1.9) | 2.1 | 0.04 |
| No | 52 | 10.9 (3.8) | |||
| Atypical antidepressants (5) | Yes | 23 | 12.0 (4.0) | 0.99 | 0.33 |
| No | 35 | 11.0 (3.6) | |||
Abbreviations: AAO = Age at onset of bipolar disorder; SD = standard deviation; SSRIs = selective serotonin reuptake inhibitors; TCAs = tricyclic antidepressants.
Lifetime medication exposure in offspring with BD
At time of assessment, 65.1% of the offspring with BD had been exposed any time in their life to stimulants, 14.3% TCAs, 69.8% SSRIs, 69.8% mood stabilizers (49.2% valproate, 27.0% lithium), 56.7% antipsychotics, and 55.6% atypical antidepressants (Table 2). The mean number of medications offspring with BD were exposed to was 4.2 ± 2.3.
Age at interview was not significantly different between the BD and subsyndromal BD groups (p = 0.24). In addition, parent AAO (p = 0.25), parent co-morbidity, and family history of mood disorder (p = 0.26) were not significantly different between the two groups. However, bipolar offspring with BD had significantly more exposure to most categories of psychotropic medications (stimulants, SSRIs, TCAs, antipsychotics, mood stabilizers) than offspring without BD (Table 2).
Age at onset of BD
Independent t-tests were performed to determine if type of medication exposure was predictive of an earlier or later AAO compared to those who did not have the same class exposure. In offspring with BD, AAO of mania was significantly later if a child had prior exposure to any mood stabilizer (13.0 ± 2.8 years vs. 10.8 ± 3.8 years; t = 2.4, degrees of freedom [df] = 55, p = 0.03). However, previous exposure to SSRIs or stimulants did not significantly affect AAO (Table 3). Exploratory analyses revealed that previous exposure to lithium alone (14.4 ± 1.9 years vs. 10.9 ± 3.8 years; t = 2.1, df = 55, p = 0.04), but not valproate or carbamazepine alone, was associated with later AAO (Table 3). Furthermore, atypical antidepressants, TCAs, and atypical antipsychotics did not have a significant effect on the child's AAO when examined independently (Table 3).
Bipolar offspring who took mood stabilizers prior to AAO did not have a significantly different percentage of first- and second-degree relatives with a mood disorder than those offspring who were not prescribed a mood stabilizer (p = 0.28, df = 53, t = 1.1). In addition, parental AAO of BD was not different between these two groups (p = 0.50, df = 57, t = 0.68). Similarly, bipolar offspring who took lithium prior to AAO did not have a significantly different family history of mood disorder (p = 0.66, df = 53, t = 0.43) or parental AAO of BD than those who did not take lithium (p = 0.87, df = 57, t = 0.17). Therefore, we did not covary post hoc for these possible factors contributing to AAO.
As a further exploratory analysis, we compared AAO of offspring with a history of mood stabilizer and SSRI exposure to those with only SSRI exposure. Offspring with both exposures tended to have a later AAO (14.1 ± 3.4 years vs. 10.8 ± 3.7 years; p = 0.05). However, offspring with a history of mood stabilizer and stimulant exposure had a similar AAO as those with exposure to stimulants alone (12.6 ± 2.0 years vs. 10.8 ± 3.6 years; p = 0.29).
Discussion
Children with BD and subsyndromal BD who are bipolar offspring have high rates of psychotropic medication exposure, even before the onset of a full manic episode. We found children with BD to have taken over two different classes of medications prior to their AAO, which is not surprising because children with BD in the community commonly take three to four medications concurrently (Bhangoo et al. 2003). As hypothesized, bipolar offspring with BD had much higher rates of exposure to all classes of psychotropic medication, including stimulants and antidepressants, than bipolar offspring with subsyndromal BD. However, a causal relation cannot be made; that is, offspring who had already developed BD may be assumed to have had a more severe course of illness before the first manic episode than those without BD. Because these subjects had high rates of premorbid ADHD and depression, it is likely that they would have been treated with psychotropics at a higher rate, and possibly for longer periods, simply due to their illness burden.
The second section of our analyses yielded surprising results. In the cohort of bipolar offspring with BD, AAO was not significantly related to prior exposure to stimulants or antidepressants. In fact, the mean AAO was later (but not significantly) for those subjects with SSRI exposure than those without.
These data are somewhat contrary to suggestions from other researchers with similar data. DelBello et al. (DelBello et al. 2001a) found prior stimulant exposure to be predictive of earlier AAO of BD in a cohort of manic adolescents. However, while the presence of ADHD was not different in both the group with and the group without stimulant exposure, severity of ADHD was not controlled for. Thus, it is possible that the adolescents who had earlier AAO also had more severe ADHD, which may have necessitated treatment with stimulants. This possibility is supported by studies suggesting earlier-onset BD to be more severe than later-onset BD (Carter et al. 2003). Indeed, a follow-up analysis of these adolescents found that those with stimulant exposure had a worse course of illness (Soutullo et al. 2002)—a finding that does not speak to which condition preceded the other.
Other researchers have noted that stimulant use in children with ADHD and moderate mood symptoms does not predict a bipolar outcome (Carlson et al. 2000b; Galanter et al. 2003) and in fact may be associated with a lower risk for a bipolar outcome (Tillman and Geller 2006). Furthermore, the phenomenon of stimulant rebound may also not be associated with BD in children (Carlson and Kelly 2003). Thus, while stimulants have been reported to trigger de novo manic episodes (Koehler-Troy et al. 1986), it seems unclear if overall stimulant exposure in at-risk children leads to an earlier age at onset of BD.
Similarly, we did not find exposure to antidepressants to be predictive of an earlier AAO of BD in our population. In a chart review of patients on a child inpatient unit, Carlson and Mick (Carlson and Mick 2003) found treatment with SSRIs to increase the risk of “behavioral disinhibition,” whereas stimulant treatment was actually protective for developing such disinhibition. SSRIs have also been reported widely to trigger or exacerbate mania in both adults (Goldberg and Truman 2003) and children (Cicero et al. 2003; Faedda et al. 2004). Martin and colleagues found that in an HMO database of 87,920 patients, those 10–14 years old were most likely to convert from a diagnosis of MDD to BD after being prescribed an SSRI (Martin et al. 2004). In this study of presumed manic conversion, the number needed to harm was 10. In a cohort of bipolar offspring overlapping with the one used for the current study, 50% of prodromal or syndromal children with BD with SSRI exposure had an SSRI-induced manic episode or worsening of mania (Baumer et al. 2006).
These types of reports have led some to hypothesize that the relatively low rate of pediatric-onset BD in Europe compared to the United States might be due to the increased prescribing of antidepressants (and/or stimulants) to American children (Reichart and Nolen 2004; Soutullo et al. 2005). Thus, we were surprised to find that SSRI exposure prior to first manic episode was not associated with an earlier AAO of BD. It is possible that there may be a ceiling effect in this cohort: Our mean AAO of BD was 11.3 years, already a very young age. In this very early-onset population, selected for their genetic propensity for BD development, early exposure to these medications may not have as significant effect on AAO than in a later-onset population. Another explanation is that SSRIs simply did not significantly change the natural course of illness.
While SSRIs clearly may cause a variety of psychiatric adverse effects in children (Wilens et al. 2003), these effects, including manic induction, might not significantly alter the natural course of BD development in a detectable manner. Because we did not count an SSRI-induced manic episode as true mania, children with these episodes may not be at risk for earlier spontaneous manias. Finally, as psychosocial stress is also considered a trigger for mania (Post 1992; Hillegers et al. 2004), it is possible that those offspring with BD who were not treated with SSRIs may have experienced more psychosocial stress, leading to a relatively earlier AAO. This occurrence may have come about coincidentally, or treatment with SSRIs may also have a protective effect in decreasing stress, while still simultaneously destabilizing mood. However, it is very difficult to prove this latter scenario without careful prospective assessments of psychosocial stress in each group.
Concordant with our hypotheses, we found that exposure to mood stabilizers prior to the first manic episode was associated with a later AAO of mania. The reasons that 24% of our sample had this early treatment may be due to the increasing recognition of possible BD in children in our catchment area as well as the increasing use (and comfort of clinicians with the use) of these agents in children. The likelihood that those children with more severe symptoms were the ones receiving mood stabilizer treatment also makes this finding even more impressive. It is possible that these agents provided amelioration of manic and depressive symptoms, leading to improvements in functioning. The improved functioning may have decreased psychosocial stress, leading to later onset of mania. For example, in a 12-week open prospective study, bipolar offspring with early signs of BD, but no history of manic episodes, responded well to divalproex monotherapy, with decreased symptoms of depression and mania and overall decreases in severity of their illnesses (Chang et al. 2003b).
Another similar study found no difference between divalproex and placebo in preventing relapse of mood symptoms in children at high-risk for BD I (Findling et al. 2007). However, no study has prospectively studied such high-risk children long enough to determine whether or not an active agent such as mood stabilizers are more effective than placebo for delaying the onset of full mania. According to the kindling hypothesis (Post 1992), any type of intervention, whether pharmacologic or psychosocial, that would acutely reduce mood symptoms and associated stress could then diminish the likelihood or delay the onset of fully expressed future episodes.
In exploratory analyses, we also found that subjects with a history of mood stabilizer and SSRI exposure tended to have later AAO than those who had only SSRI exposure. However, we could not be sure that this exposure happened concurrently; therefore, it is premature to comment further on the clinical implications of this finding.
Thus, mood stabilizers might lead to prevention of BD, not just treatment of acute symptoms. Agents such as lithium and valproate have been shown to have intrinsic neuroprotective qualities in vitro (Manji et al. 2000). In humans, lithium may acutely increase gray matter volume (Moore et al. 2000; Foland et al. 2008). We also reported that treatment with lithium or valproate in children with BD was associated with relatively normal amygdala gray matter volumes, significantly greater than children with BD without such exposure (Chang et al. 2005). Our post hoc analysis implicated lithium more strongly as being associated with later AAO, and thus lithium may hold more promise as a prophylactic agent despite its possible inefficacy in treating acute depression in bipolar offspring (Geller et al. 1998). It is possible that certain agents may only be effective if administered early enough in the course of illness. Further research also needs to be conducted with atypical antipsychotics in this regard, because, although we did not find that exposure to this class of medication was associated with delayed AAO of mania, a previous study found quetiapine effective acutely in reducing mood symptoms in an at-risk population (DelBello et al. 2007).
Limitations
Foremost, this was a retrospective study that relied on parental and child report for both AAO and medication exposure data. Although we did attempt to use medical records, this was not always possible. Therefore, some data regarding onset of manic symptoms and medications were subject to parental and subject memory. This type of reporting may be problematic, but we are not aware of any directly relevant research that found this type of AAO determination or medication report to be unreliable. One study of childhood depression found that parents reported earlier AAO for depression of their child than the child themselves (Braaten et al. 2001). Also, parent-report of bipolar symptoms in general appears to be more accurate than child report (Youngstrom et al. 2004).
Because children were newly diagnosed or within a few years of their AAO, this retrospective data may have been more accurate that retrospective studies of AAO in adults. We did not examine dosages or serum levels of medications; it is possible that some subjects were not adequately treated with full doses of these medications. We also were not able to determine if concurrent mood stabilizer treatment was somehow “protective” of SSRI or stimulant treatment, as many children had times of both monotherapy and concurrent treatment. Finally, we studied AAO of first manic episode rather than first mood episode or first behavioral disorder. For early-onset BD, it is often difficult to determine when the illness truly began (Chang et al. 2003a), but for purposes of distinguishing BD from other disorders such as uncomplicated ADHD or unipolar depression, we decided to use first manic episode as our AAO index event.
Clinicial implications
Despite the retrospective nature of data acquisition, this is the first study to report that treating children with mood stabilizers early in BD development may delay the onset of their first full manic episode. Furthermore, our results support other literature suggesting that stimulants do not lower AAO of mania in this population (Craney and Geller 2003; Tillman and Geller 2006). This finding may be important because many children with early-onset BD first present with ADHD before mania onset (Faraone et al. 1997; Chang et al. 2000; Tillman et al. 2003). Thus, treating these children at risk for BD carefully with stimulants may not lead to an earlier manic episode.
Our finding that SSRI exposure was not correlated with an earlier AAO should be regarded with some caution. It is clear that SSRIs can cause de novo manic episodes in children and adolescents (Jerome 1991; Go et al. 1998; Diler and Avci 1999; Martin et al. 2004), similar to adults (Goldberg and Truman 2003). As children in clinical trials of SSRIs have had greater adverse outcomes of increased suicidal behavior than those on placebo (Ryan 2005; Wong et al. 2004), it is possible that these children may have been in the first stages of a mixed or manic episode. For this study, it is important to remember that we did not consider antidepressant-induced mania as the first manic episode qualifying a child for full BD, because it was caused by an exogenous medication. Nonetheless, until further data exonerates the role of SSRIs in BD development, we would recommend that clinicians still carefully monitor those children and adolescents with early signs of mania or family histories of BD who are placed on these agents. Meanwhile, prospective longitudinal studies of children and adolescents at high risk for BD examining medication exposure will help to answer more definitively the questions surrounding the role of psychotropic medication exposure in BD development.
Footnotes
Portions of this manuscript were presented at the 2003 Annual Meeting of the American Psychiatric Association, San Francisco, California.
This work was supported in part by a grant from the Heinz C. Prechter Fund For Manic Depression, a NARSAD Young Investigators Award, a Klingenstein Third Generation Foundation Fellowship, and National Institutes of Health (NIH) grant MH64460-01 (Dr. Chang).
Disclosures
Kiki D. Chang, M.D., has done research for and received grants from AstraZeneca Pharmaceuticals, Eli Lilly and Company, Otsuka America Pharmaceutical, Inc., and GlaxoSmithKline; is on the Speakers' Bureau for AstraZeneca Pharmaceuticals, Bristol-Myers Squibb, and Eli Lilly and Company; is a consultant for AstraZeneca Pharmaceuticals, GlaxoSmithKline, and Eli Lilly and Company; and is on the Advisory Board of Eli Lilly and Company. Dr. Saxena, Ms. Howe, and Ms. Simeonova have no conflicts of interest or financial ties to disclose.
Acknowledgments
The authors gratefully acknowledge the assistance of Leena Khanzode, M.D. in the preparation of this manuscript.
References
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders–Text Revision (DSM-IV-TR) Washington (DC): American Psychiatric Association; 2000. [Google Scholar]
- Andreasen NC. Endicott J. Spitzer RL. Winokur G. The family history method using diagnostic criteria. Reliability and validity. Arch Gen Psychiatry. 1977;34:1229–1235. doi: 10.1001/archpsyc.1977.01770220111013. [DOI] [PubMed] [Google Scholar]
- Baumer FM. Howe M. Gallelli K. Simeonova DI. Hallmayer J. Chang KD. A pilot study of antidepressant-induced mania in pediatric bipolar disorder: Characteristics, risk factors, and the serotonin transporter gene. Biol Psychiatry. 2006;60:1005–1012. doi: 10.1016/j.biopsych.2006.06.010. [DOI] [PubMed] [Google Scholar]
- Bhangoo RK. Lowe CH. Myers FS. Treland J. Curran J. Towbin KE. Leibenluft E. Medication use in children and adolescents treated in the community for bipolar disorder. J Child Adolesc Psychopharmacol. 2003;13:515–522. doi: 10.1089/104454603322724904. [DOI] [PubMed] [Google Scholar]
- Biederman J. Mick E. Spencer TJ. Wilens TE. Faraone SV. Therapeutic dilemmas in the pharmacotherapy of bipolar depression in the young. J Child Adolesc Psychopharmacol. 2000;10:185–192. doi: 10.1089/10445460050167296. [DOI] [PubMed] [Google Scholar]
- Braaten EB. Biederman J. DiMauro A. Mick E. Monuteaux MC. Muehl K. Faraone SV. Methodological complexities in the diagnosis of major depression in youth: An analysis of mother and youth self-reports. J Child Adolesc Psychopharmacol. 2001;11:395–407. doi: 10.1089/104454601317261573. [DOI] [PubMed] [Google Scholar]
- Carlson GA. Kelly KL. Stimulant rebound: How common is it and what does it mean? J Child Adolesc Psychopharmacol. 2003;13:137–142. doi: 10.1089/104454603322163853. [DOI] [PubMed] [Google Scholar]
- Carlson GA. Mick E. Drug-induced disinhibition in psychiatrically hospitalized children. J Child Adolesc Psychopharmacol. 2003;13:153–163. doi: 10.1089/104454603322163871. [DOI] [PubMed] [Google Scholar]
- Carlson GA. Loney J. Salisbury H. Kramer JR. Arthur C. Stimulant treatment in young boys with symptoms suggesting childhood mania: A report from a longitudinal study. J Child Adolesc Psychopharmacol. 2000a;10:175–184. doi: 10.1089/10445460050167287. [DOI] [PubMed] [Google Scholar]
- Carlson GA. Loney J. Salisbury H. Kramer JR. Arthur C. Stimulant treatment in young boys with symptoms suggesting childhood mania: A report from a longitudinal study. J Child Adolesc Psychopharmacol. 2000b;10:175–184. doi: 10.1089/10445460050167287. [DOI] [PubMed] [Google Scholar]
- Carter TD. Mundo E. Parikh SV. Kennedy JL. Early age at onset as a risk factor for poor outcome of bipolar disorder. J Psychiatr Res. 2003;37:297–303. doi: 10.1016/s0022-3956(03)00052-9. [DOI] [PubMed] [Google Scholar]
- Chang KD. Steiner H. Offspring studies in child and early adolescent bipolar disorder. In: Geller B, editor; DelBello M, editor. Bipolar Disorder in Childhood and Early Adolescence. New York: The Guilford Press; 2003. pp. 107–129. [Google Scholar]
- Chang KD. Steiner H. Ketter TA. Psychiatric phenomenology of child and adolescent bipolar offspring. J Am Acad Child Adolesc Psychiatry. 2000;39:453–460. doi: 10.1097/00004583-200004000-00014. [DOI] [PubMed] [Google Scholar]
- Chang KD. Dienes K. Blasey C. Adleman N. Ketter T. Steiner H. Divalproex monotherapy in the treatment of bipolar offspring with mood and behavioral disorders and at least mild affective symptoms. J Clin Psychiatry. 2003b;64:936–942. doi: 10.4088/jcp.v64n0812. [DOI] [PubMed] [Google Scholar]
- Chang K. Howe M. Gallelli K. Miklowitz D. Prevention of pediatric bipolar disorder: Integration of neurobiological and psychosocial processes. Ann NY Acad Sci. 2006;1094:235–247. doi: 10.1196/annals.1376.026. [DOI] [PubMed] [Google Scholar]
- Chang K. Karchemskiy A. Barnea-Goraly N. Garrett A. Simeonova DI. Reiss A. Reduced amygdalar gray matter volume in familial pediatric bipolar disorder. J Am Acad Child Adolesc Psychiatry. 2005;44:565–573. doi: 10.1097/01.chi.0000159948.75136.0d. [DOI] [PubMed] [Google Scholar]
- Chang K. Steiner H. Dienes K. Adleman N. Ketter T. Bipolar offspring: A window into bipolar disorder evolution. Biol Psychiatry. 2003a;53:945–951. doi: 10.1016/s0006-3223(03)00061-1. [DOI] [PubMed] [Google Scholar]
- Cicero D. El-Mallakh RS. Holman J. Robertson J. Antidepressant exposure in bipolar children. Psychiatry. 2003;66:317–322. doi: 10.1521/psyc.66.4.317.25437. [DOI] [PubMed] [Google Scholar]
- Craney J. Geller B. Clinical implications of antidepressant and stimulant use on switching from depression to mania in children. J Child Adolesc Psychopharmacol. 2003;13:201–204. doi: 10.1089/104454603322163925. [DOI] [PubMed] [Google Scholar]
- DelBello MP. Geller B. Review of studies of child and adolescent offspring of bipolar parents. Bipolar Disord. 2001;3:325–334. doi: 10.1034/j.1399-5618.2001.30607.x. [DOI] [PubMed] [Google Scholar]
- DelBello MP. Adler CM. Whitsel RM. Stanford KE. Strakowski SM. A 12-week single-blind trial of quetiapine for the treatment of mood symptoms in adolescents at high risk for developing bipolar I disorder. J Clin Psychiatry. 2007;68:789–795. doi: 10.4088/jcp.v68n0520. [DOI] [PubMed] [Google Scholar]
- DelBello MP. Soutullo CA. Hendricks W. Niemeier RT. McElroy SL. Strakowski SM. Prior stimulant treatment in adolescents with bipolar disorder: Association with age at onset. Bipolar Disord. 2001;3:53–57. doi: 10.1034/j.1399-5618.2001.030201.x. [DOI] [PubMed] [Google Scholar]
- Diler RS. Avci A. SSRI-induced mania in obsessive-compulsive disorder. J Am Acad Child Adolesc Psychiatry. 1999;38:6–7. doi: 10.1097/00004583-199901000-00010. [DOI] [PubMed] [Google Scholar]
- Faedda GL. Baldessarini RJ. Glovinsky IP. Austin NB. Treatment-emergent mania in pediatric bipolar disorder: A retrospective case review. J Affect Disord. 2004;82:149–158. doi: 10.1016/j.jad.2003.12.011. [DOI] [PubMed] [Google Scholar]
- Faraone SV. Biederman J. Wozniak J. Mundy E. Mennin D. O'Donnell D. Is comorbidity with ADHD a marker for juvenile-onset mania? J Am Acad Child Adolesc Psychiatry. 1997;36:1046–1055. doi: 10.1097/00004583-199708000-00012. [DOI] [PubMed] [Google Scholar]
- Findling RL. Frazier TW. Youngstrom EA. McNamara NK. Stansbrey RJ. Gracious BL. Reed MD. Demeter CA. Calabrese JR. Double-blind, placebo-controlled trial of divalproex monotherapy in the treatment of symptomatic youth at high risk for developing bipolar disorder. J Clin Psychiatry. 2007;68:781–788. doi: 10.4088/jcp.v68n0519. [DOI] [PubMed] [Google Scholar]
- First MB. Spitzer RL. Gibbon M. Williams JBW. New York: Biometric Research, New York State Psychiatric Institute; 1995. Structured Clinical Interview for DSM-IV Axis I Disorders–Patient Edition (SCID-I/P, version 2.0) [Google Scholar]
- Foland LC. Altshuler LL. Sugar CA. Lee AD. Leow AD. Townsend J. Narr KL. Asuncion DM. Toga AW. Thompson PM. Increased volume of the amygdala and hippocampus in bipolar patients treated with lithium. Neuroreport. 2008;19:221–224. doi: 10.1097/WNR.0b013e3282f48108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Galanter CA. Carlson GA. Jensen PS. Greenhill LL. Davies M. Li W. Chuang SZ. Elliott GR. Arnold LE. March JS. Hechtman L. Pelham WE. Swanson JM. Response to methylphenidate in children with attention deficit hyperactivity disorder and manic symptoms in the multimodal treatment study of children with attention deficit hyperactivity disorder titration trial. J Child Adolesc Psychopharmacol. 2003;13:123–136. doi: 10.1089/104454603322163844. [DOI] [PubMed] [Google Scholar]
- Geller B. Cooper TB. Zimerman B. Frazier J. Williams M. Heath J. Warner K. Lithium for prepubertal depressed children with family history predictors of future bipolarity: A double-blind, placebo-controlled study. J Affect Disord. 1998;51:165–175. doi: 10.1016/s0165-0327(98)00178-5. [DOI] [PubMed] [Google Scholar]
- Geller BG. Williams M. Zimerman B. Frazier J. WASH-U-KSADS (Washington University in St. Louis Kiddie Schedule for Affective Disorders and Schizophrenia) St. Louis (Missouri): Washington University; 1996. [DOI] [PubMed] [Google Scholar]
- Gijsman HJ. Geddes JR. Rendell JM. Nolen WA. Goodwin GM. Antidepressants for bipolar depression: A systematic review of randomized, controlled trials. Am J Psychiatry. 2004;161:1537–1547. doi: 10.1176/appi.ajp.161.9.1537. [DOI] [PubMed] [Google Scholar]
- Go FS. Malley EE. Birmaher B. Rosenberg DR. Manic behaviors associated with fluoxetine in three 12- to 18-year-olds with obsessive-compulsive disorder. J Child Adolesc Psychopharmacol. 1998;8:73–80. doi: 10.1089/cap.1998.8.73. [DOI] [PubMed] [Google Scholar]
- Goldberg JF. Truman CJ. Antidepressant-induced mania: An overview of current controversies. Bipolar Disord. 2003;5:407–420. doi: 10.1046/j.1399-5618.2003.00067.x. [DOI] [PubMed] [Google Scholar]
- Guile JM. Sertraline-induced behavioral activation during the treatment of an adolescent with major depression. J Child Adolesc Psychopharmacol. 1996;6:281–285. doi: 10.1089/cap.1996.6.281. [DOI] [PubMed] [Google Scholar]
- Henry C. Sorbara F. Lacoste J. Gindre C. Leboyer M. Antidepressant-induced mania in bipolar patients: Identification of risk factors. J Clin Psychiatry. 2001;62:249–255. doi: 10.4088/jcp.v62n0406. [DOI] [PubMed] [Google Scholar]
- Hillegers MH. Burger H. Wals M. Reichart CG. Verhulst FC. Nolen WA. Ormel J. Impact of stressful life events, familial loading and their interaction on the onset of mood disorders: Study in a high-risk cohort of adolescent offspring of parents with bipolar disorder. Br J Psychiatry. 2004;185:97–101. doi: 10.1192/bjp.185.2.97. [DOI] [PubMed] [Google Scholar]
- Howland RH. Induction of mania with serotonin reuptake inhibitors. J Clin Psychopharmacol. 1996;16:425–427. doi: 10.1097/00004714-199612000-00003. [DOI] [PubMed] [Google Scholar]
- Jerome L. Hypomania with fluoxetine. J Am Acad Child Adolesc Psychiatry. 1991;30:850–851. [PubMed] [Google Scholar]
- Kaufman J. Birmaher B. Brent D. Rao U. Flynn C. Moreci P. Williamson D. Ryan N. Schedule for Affective Disorders and Schizophrenia for School-Age Children—Present and Lifetime Versions (K-SADS-PL): Initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997;36:980–988. doi: 10.1097/00004583-199707000-00021. [DOI] [PubMed] [Google Scholar]
- Koehler-Troy C. Strober M. Malenbaum R. Methylphenidate-induced mania in a prepubertal child. J Clin Psychiatry. 1986;47:566–567. [PubMed] [Google Scholar]
- Koszewska I. Rybakowski JK. Antidepressant-induced mood conversions in bipolar disorder: A retrospective study of tricyclic versus non-tricyclic antidepressant drugs. Neuropsychobiology. 2009;59:12–16. doi: 10.1159/000202824. [DOI] [PubMed] [Google Scholar]
- Manji HK. Moore GJ. Chen G. Clinical and preclinical evidence for the neurotrophic effects of mood stabilizers: Implications for the pathophysiology and treatment of manic-depressive illness. Biol Psychiatry. 2000;48:740–754. doi: 10.1016/s0006-3223(00)00979-3. [DOI] [PubMed] [Google Scholar]
- Martin A. Young C. Leckman JF. Mukonoweshuro C. Rosenheck R. Leslie D. Age effects on antidepressant-induced manic conversion. Arch Pediatr Adolesc Med. 2004;158:773–780. doi: 10.1001/archpedi.158.8.773. [DOI] [PubMed] [Google Scholar]
- Moore GJ. Bebchuk JM. Wilds IB. Chen G. Manji HK. Menji HK. Lithium-induced increase in human brain grey matter. Lancet. 2000;356:1241–1242. doi: 10.1016/s0140-6736(00)02793-8. [DOI] [PubMed] [Google Scholar]
- Post RM. Transduction of psychosocial stress into the neurobiology of recurrent affective disorder. Am J Psychiatry. 1992;149:999–1010. doi: 10.1176/ajp.149.8.999. [DOI] [PubMed] [Google Scholar]
- Post RM. Altshuler LL. Frye MA. Suppes T. Rush AJ. Keck PE., Jr McElroy SL. Denicoff KD. Leverich GS. Kupka R. Nolen WA. Rate of switch in bipolar patients prospectively treated with second-generation antidepressants as augmentation to mood stabilizers. Bipolar Disord. 2001;3:259–265. [PubMed] [Google Scholar]
- Poznanski EO. Mokros HB. Children's Depression Rating Scale, Revised (CDRS-R) Manual. Los Angeles (California): Western Psychological Services; 1995. [Google Scholar]
- Reichart CG. Nolen WA. Earlier onset of bipolar disorder in children by antidepressants or stimulants? An hypothesis. J Affect Disord. 2004;78:81–84. doi: 10.1016/s0165-0327(02)00180-5. [DOI] [PubMed] [Google Scholar]
- Ryan ND. Treatment of depression in children and adolescents. Lancet. 2005;366:933–940. doi: 10.1016/S0140-6736(05)67321-7. [DOI] [PubMed] [Google Scholar]
- Scheffer RE. Kowatch RA. Carmody T. Rush AJ. Randomized, placebo-controlled trial of mixed amphetamine salts for symptoms of comorbid ADHD in pediatric bipolar disorder after mood stabilization with divalproex sodium. Am J Psychiatry. 2005;162:58–64. doi: 10.1176/appi.ajp.162.1.58. [DOI] [PubMed] [Google Scholar]
- Soutullo CA. Chang KD. Diez-Suarez A. Figueroa-Quintana A. Escamilla-Canales I. Rapado-Castro M. Ortuno F. Bipolar disorder in children and adolescents: International perspective on epidemiology and phenomenology. Bipolar Disord. 2005;7:497–506. doi: 10.1111/j.1399-5618.2005.00262.x. [DOI] [PubMed] [Google Scholar]
- Soutullo CA. DelBello MP. Ochsner JE. McElroy SL. Taylor SA. Strakowski SM. Keck PE., Jr Severity of bipolarity in hospitalized manic adolescents with history of stimulant or antidepressant treatment. J Affect Disord. 2002;70:323–327. doi: 10.1016/s0165-0327(01)00336-6. [DOI] [PubMed] [Google Scholar]
- Tillman R. Geller B. Controlled study of switching from attention-deficit/hyperactivity disorder to a prepubertal and early adolescent bipolar I disorder phenotype during 6-year prospective follow-up: Rate, risk, and predictors. Dev Psychopathol. 2006;18:1037–1053. doi: 10.1017/S0954579406060512. [DOI] [PubMed] [Google Scholar]
- Tillman R. Geller B. Bolhofner K. Craney JL. Williams M. Zimerman B. Ages of onset and rates of syndromal and subsyndromal comorbid DSM-IV diagnoses in a prepubertal and early adolescent bipolar disorder phenotype. J Am Acad Child Adolesc Psychiatry. 2003;42:1486–1493. doi: 10.1097/00004583-200312000-00016. [DOI] [PubMed] [Google Scholar]
- Vitiello B. Long-term effects of stimulant medications on the brain: Possible relevance to the treatment of attention deficit hyperactivity disorder. J Child Adolesc Psychopharmacol. 2001;11:25–34. doi: 10.1089/104454601750143384. [DOI] [PubMed] [Google Scholar]
- Wehr TA. Goodwin FK. Can antidepressants cause mania and worsen the course of affective illness? Am J Psychiatry. 1987;144:1403–1411. doi: 10.1176/ajp.144.11.1403. [DOI] [PubMed] [Google Scholar]
- Wilens TE. Biederman J. Kwon A. Chase R. Greenberg L. Mick E. Spencer TJ. A systematic chart review of the nature of psychiatric adverse events in children and adolescents treated with selective serotonin reuptake inhibitors. J Child Adolesc Psychopharmacol. 2003;13:143–152. doi: 10.1089/104454603322163862. [DOI] [PubMed] [Google Scholar]
- Wong IC. Besag FM. Santosh PJ. Murray ML. Use of selective serotonin reuptake inhibitors in children and adolescents. Drug Safety. 2004;27:991–1000. doi: 10.2165/00002018-200427130-00002. [DOI] [PubMed] [Google Scholar]
- Young RC. Biggs JT. Ziegler V. Meyer DA. A rating scale for mania: Reliability, validity and sensitivity. Br J Psychiatry. 1978;133:429–435. doi: 10.1192/bjp.133.5.429. [DOI] [PubMed] [Google Scholar]
- Youngstrom EA. Findling RL. Calabrese JR. Effects of adolescent manic symptoms on agreement between youth, parent, and teacher ratings of behavior problems. J Affect Disord. 2004;82(Suppl 1):S5–S16. doi: 10.1016/j.jad.2004.05.016. [DOI] [PubMed] [Google Scholar]

