Abstract
Primary cultures of rat embryonic motor neurons deprived of brain-derived neurotrophic factor (BDNF) induce neuronal nitric oxide synthase (NOS) within 18 hr. Subsequently, >60% of the neurons undergo apoptosis between 18 and 24 hr after plating. Nitro-l-arginine and nitro-l-arginine methyl ester (l-NAME) prevented motor neuron death induced by trophic factor deprivation. Exogenous generation of nitric oxide at concentrations lower than 100 nm overcame the protection byl-NAME. Manganese tetrakis (4-benzoyl acid) porphyrin, a cell-permeant superoxide scavenger, also prevented nitric oxide-dependent motor neuron death. Motor neurons cultured without trophic support rapidly became immunoreactive for nitrotyrosine when compared with motor neurons incubated with BDNF, l-NAME, or manganese TBAP. Our results suggest that peroxynitrite, a strong oxidant formed by the reaction of NO and superoxide, plays an important role in the induction of apoptosis in motor neurons deprived of trophic factors and that BDNF supports motor neuron survival in part by preventing neuronal NOS expression.
Keywords: motor neuron, nitric oxide synthase, superoxide, peroxynitrite, nitrotyrosine, apoptosis, nitric oxide
The production of nitric oxide (NO) has been implicated in neuronal injury after ischemia, trauma, and numerous neurodegenerative disorders, including amyotrophic lateral sclerosis (ALS) (Huang et al., 1994; Beckman et al., 1996). Oxidative stress also is involved in the induction of neuron death in neurodegeneration (Coyle and Puttfarcken, 1993). Excessive stimulation of glutamate receptors may mediate neuron death by the production of both nitric oxide (Dawson et al., 1991, 1996) and superoxide (Lafon-Cazal et al., 1993a,b; Culcasi et al., 1994). Nitric oxide and superoxide combine by a diffusion-limited reaction to form the much stronger and more toxic oxidant peroxynitrite (ONOO−) (Beckman, 1996a). Peroxynitrite stimulates apoptosis of PC12 cells (Estévez et al., 1995; Troy et al., 1996;Spear et al., 1997) and cortical neurons in culture (Bonfoco et al., 1995). Peroxynitrite is a substrate for superoxide dismutase (SOD), which catalyzes the nitration of tyrosines on other proteins (Ischiropoulos et al., 1992). Indeed, we have suggested previously that SOD-catalyzed tyrosine nitration may be involved in the pathogenesis of ALS (Beckman et al., 1993). Nitrotyrosine immunoreactivity is found in Alzheimer’s disease (Good et al., 1996;Smith et al., 1997), ALS (Abe et al., 1995; Chou et al., 1996a,b), and animal models of Parkinson’s disease (Hantraye et al., 1996;Przedborski et al., 1996; Schulz et al., 1996).
Chronic treatment with trophic factors prevents programmed cell death of motor neurons during chicken spinal cord development (Oppenheim et al., 1992, 1995; Neff et al., 1993) and motor neuron loss after axonal injury in mammals (Sendtner et al., 1992; Yan et al., 1992, 1993;Hughes et al., 1993; Henderson et al., 1994; Li et al., 1995;Schmalbruch and Rosenthal, 1995; Pennica et al., 1996). Trophic factor deprivation leads to degeneration of cultured motor neurons by apoptosis (Milligan et al., 1995; Pennica et al., 1996), and a variety of neurotrophins, cytokines, and other factors can rescue motor neurons in culture from apoptosis (Arakawa et al., 1990; Henderson et al., 1993, 1994; Hughes et al., 1993; Gouin et al., 1996; Pennica et al., 1996). However, the mechanisms leading to apoptosis in motor neurons subjected to trophic factor deprivation remain elusive. Recent evidence suggests that the production of nitric oxide may be involved in the process of spinal motor neuron death stimulated by ventral root avulsion. After the injury, motor neurons induce nitric oxide synthase (NOS), and the subsequent cell death is prevented mainly by chronic administration of NOS inhibitors (Wu, 1993; Wu and Li, 1993). However, the mechanism of NO-mediated toxicity is still unknown. We therefore investigated whether endogenous production of NO contributed to apoptosis in high purity cultures of fetal rat motor neurons deprived of trophic support. We found that trophic factor deprivation increased both motor neuron expression of neuronal NOS and nitrotyrosine immunoreactivity. NOS inhibitors and a membrane-permeant SOD mimetic mainly prevented motor neuron death and blocked the increase in nitrotyrosine immunoreactivity. These results support a peroxynitrite-dependent induction of motor neuron apoptosis.
MATERIALS AND METHODS
Materials. Monoclonal antibodies to Islet-1/2 were isolated from media from 4D5 hybridoma cells obtained from the Developmental Studies Hybridoma Bank (Iowa City, IA) (Ericson et al., 1992; Tsuchida et al., 1994). Polyclonal antibodies to neuronal NOS were obtained from Transduction Laboratories (Lexington, KY) and the generous gift of Dr. B. Mayer (Graz, Austria). Affinity-purified anti-mouse IgG was obtained from Cappel (Durham, NC). Affinity-purified biotinylated goat anti-mouse and anti-rabbit antibodies and FITC- and Texas Red-conjugated streptavidin were obtained from Life Technologies (Grand Island, NY). Cy3-conjugated goat anti-mouse and anti-rabbit were from Jackson Laboratories (West Grove, PA). Mounting medium was SlowFade-Light antifade kit from Molecular Probes (Eugene, OR). Recombinant mouse BDNF was a generous gift from R. W. Scott and J. D. Hirsch (Cephalon, West Chester, PA). Manganese (III) 4,4′,4",4‴ (21H,2H-porphine-5,10,15,20-tetrayl)tetrakis (benzoic acid), better known as manganese TBAP, was purchased from Calbiochem (La Jolla, CA). Culture media, serum, insulin, and antibiotics were from Life Technologies. All other reagents used were obtained from Sigma (St. Louis, MO).
Motor neuron culture. Motor neurons were prepared from embryonic day 15 (E15) rat embryo spinal cord by a combination of metrizamide gradient centrifugation and immunopanning with the monoclonal antibody IgG192 (Chandler et al., 1984) against the p75 low-affinity neurotrophin receptor, as previously described (Henderson et al., 1995). Briefly, ventral spinal cords were dissected in PBS, treated with trypsin for 15 min at 37°C, and dissociated by gentle trituration in 0.1% bovine serum albumin (BSA) and 0.1 mg/ml DNase I in basal culture medium (L15 medium supplemented with 0.63 mg/ml sodium bicarbonate, 5 μg/ml insulin, 0.1 mm putrescine, 0.1 mg/ml conalbumin, 30 nm sodium selenite, 20 nmprogesterone, 20 mm glucose, 100 IU/ml penicillin, 100 μg/ml streptomycin, and 2% horse serum). The single-cell suspension was centrifuged on a 6.5% metrizamide cushion for 15 min at 500 × g. Motor neurons were removed from the interface. After dilution with basal medium, cells were resuspended in L15 medium and incubated for 30 min at room temperature in a bacteriological Petri dish previously coated with anti-mouse IgG and MC192 hybridoma supernatant. Nonadherent cells were removed by nine washes with L15 medium, and motor neurons were eluted by gentle agitation with MC192 hybridoma supernatant. Motor neurons were plated at a density of 200 cells·cm−2 on 35 mm dishes or at a density of 103 cells·cm−2 on glass coverslips precoated with polyornithine-laminin in basal culture medium. Cultures were maintained at 37°C in an atmosphere 5% CO2/95% humidified air.
Determination of mRNA expression. Total RNA from 50,000 motor neurons plated on 60 mm dishes was isolated with Trizol (Life Technologies), reverse-transcribed with an RT-PCR Kit (Stratagene, La Jolla, CA), and amplified with the GeneAmp PCR Reagent Kit (Perkin-Elmer, Emeryville, CA) (1 cycle at 91°C for 5 min and 54°C for 5 min, followed by 30 cycles of 91°C for 1 min, 54°C for 1 min, 72°C for 2 min, and a final cycle of 72°C for 10 min). Sense and antisense primers for neuronal NOS were 5′-GAATACCAGCCTGATCCATGGAA and 5′-TCCTCCAGGAGGGTGTCCACCGCATG-3′ (Shaul et al., 1995); for glyceraldehyde-3-phosphate dehydrogenase (GAPDH) the primers were 5′-ATTCTACCCACGGCAAGTTCAATGG and 5′-AGGGGCGGAGATGATGACCC-3′. GAPDH primers were used to normalize RNA levels. The products of the reaction were separated by electrophoresis in a 2% agarose gel and visualized in a UV transilluminator after staining with ethidium bromide. Gels were digitized, and the intensity of the bands was quantified by using National Institutes of Health Image version 1.60.
Immunofluorescence. Cultures were fixed for 15 min with 4% paraformaldehyde/0.1% glutaraldehyde in PBS on ice. The cells were rinsed successively with PBS (3×), permeabilized with 0.1% Triton X-100 for 15 min, blocked for 1 hr with 10% goat serum plus 2% BSA in PBS, incubated with the primary antibody overnight at 4°C, rinsed with PBS (three times), incubated with Cy3- or biotin-conjugated secondary antibody for 30 min at room temperature, rinsed with PBS (three times), incubated with FITC- or Texas Red-conjugated streptavidin, rinsed with PBS (three times), fixed with 4% paraformaldehyde, rinsed with PBS (three times), and after a final rinse with distilled water, mounted in SlowFade-Light antifade kit. Primary antibodies used were the supernatant from 4D5 hybridoma against Islet-1/2 (1:100), IgG 192 to p75 neurotrophin receptor (5 μg/ml), and affinity-purified rabbit polyclonal antibodies to nitrotyrosine (1:500; Beckman et al., 1994) and for the neuronal NOS (1:100). Controls included omission of primary antibody or permeabilization of the cells for neuronal NOS and Islet-1/2. Immunoreactivity with the neuronal NOS antibody was abolished by preincubation with N-terminal neuronal NOS peptide, as described by Herdergen et al. (1993). Nitrotyrosine staining was blocked by preincubation of the primary antibody (2 μg/ml) with either 5 mm nitrotyrosine or 100 μm alanyl-3-nitrotyrosyl-glycine (Ye et al., 1996). Terminal deoxynucleotidyl transferase-mediated dUTP-biotin nick end labeling (TUNEL) staining used the Apoptosis Detection System from Promega (Madison, WI) according to the manufacturer’s instructions.
Quantitative microscopy. Nitrotyrosine immunofluorescence was quantified by randomly selecting cells under interference contrast and then digitizing FITC-fluorescent images. Differential interference contrast and epifluorescence microscopy were performed with an inverted Sedival (Jena) microscope. Images were obtained and analyzed with a Series 200 cooled charge-coupled device camera system (Photometrics, Tucson, AZ) configured for a Macintosh IIci computer that used IPLab Spectrum 2.5.5 software (Signal Analytics, Vienna, VA). A 60× planachromat objective was used for all images. Illumination for epifluorescence was achieved with a 100 W mercury arc lamp. Standard filters (485–520 nm excitation filter; 520–560 emission filter) were used for visualizing FITC labeling for nitrotyrosine. Controls were performed by incubating the first antibody (2 μg/ml) in the presence of a 100 μm nitrotyrosine-containing peptide, 5 mm free nitrotyrosine, or by omission of the primary antibody. None of the controls exhibited significant staining. At least 15 images were collected from each slide. Slides from five independent experiments were digitized into pixels of 0.21 μm2. Cellular structures in each image were outlined manually with digital imaging techniques. The intensity value of each pixel within the outline area was measured, and a mean intensity was calculated. Fluorescence intensity in areas not covered by cellular structures of each image was measured in a manner identical to standardized conditions. Specific nitrotyrosine content was obtained by subtracting the fluorescence found in the presence of 100 μm alanyl-3-nitrotyrosyl-glycine, which blocks specific nitrotyrosine antibody binding, from the fluorescence obtained without the peptide.
Determination of motor neuron survival. Motor neuron survival was quantified 24 and 72 hr after plating by counting all neurons with neurites longer than 4 soma diameters in a 1 cm2 field in the center of the dish, as previously described (Henderson et al., 1993; Pennica et al., 1996). Motor neurons considered viable by this method also were stained with the vital dye fluorescein diacetate. To compare the results of different experiments, we took the number of cells attached with neurites 4 hr after plating in the presence of BDNF as 100% survival that corresponded to ∼50–60% of the cells that were plated initially (Henderson et al., 1993).
RESULTS
Trophic factor deprivation leads to apoptosis
Trophic factor-deprived motor neurons attached to the substrate and extended neurites during the first 15–18 hr in culture, as in BDNF-treated cultures, but then the motor neurons became shrunken and round and withdrew their neurites. These cells also showed nuclear condensation and evidence of DNA fragmentation, visualized by the TUNEL method at 24 hr (Fig. 1a,b). More than 60% of motor neurons in culture underwent apoptosis when they were deprived of trophic support during the first 24 hr. Further evidence for motor neuron apoptosis was provided by treating them with the caspase inhibitors Ac-YVAD-CHO and Ac-YAVD-CMK. Both agents significantly reduced motor neuron degeneration for 24 hr and up to 3 d (Fig. 2), as previously described for avian motor neurons in culture (Milligan et al., 1995).
Motor neurons cultured in the presence of BDNF or neurotrophin-4/5 (NT4/5) for 24 hr developed long, branched neurites. Over 96% of the cells were immunoreactive for the motor neuron markers p75 neurotrophin receptor and Islet-1/2 (Fig. 1b,c; Yan and Johnson, 1988;Tsuchida et al., 1994). However, motor neurons in L15 medium survived for a maximum of 72 hr before undergoing apoptosis even in the presence of BDNF or NT4/5 (see Fig. 6).
Trophic factor deprivation induces neuronal NOS
BDNF-deprived motor neurons expressed neuronal NOS mRNA that was not detected in BDNF-treated cultures (Fig.3). In contrast, 25% less mRNA for GAPDH was recovered by RT-PCR from trophic factor-deprived cultures as compared with BDNF-treated cultures. Similarly, trophic factor-deprived motor neurons became immunoreactive for neuronal NOS 24 hr after plating (Fig. 4). Although neuronal NOS immunoreactivity was restricted to specific areas of cytoplasm in some apoptotic cells (data not shown), in later stages of apoptotic degeneration the fluorescence was distributed throughout the cell because of the disorganization of cellular structures and nuclear condensation (Fig. 1b). Neither neuronal NOS mRNA nor immunoreactivity could be detected in BDNF-treated cultures. Identical results were obtained by using two different anti-neuronal NOS polyclonal antibodies. Fluorescence was not present in cultures that were not permeabilized and abolished by preincubation of the primary antibody with the N-terminal peptide of the neuronal NOS (Herdegen et al., 1993, 1994; Meyer et al., 1994).
NOS inhibitors prevent apoptosis
Inhibition of NOS activity by nitro-l-arginine (l-NA) and nitro-l-arginine methyl ester (l-NAME) prevented motor neuron death for up to 3 d (Fig. 5A). Both NOS inhibitors prevented motor neuron death in a dose-dependent manner, with an EC50 of 150 and 10 μm for l-NA and l-NAME, respectively (Fig. 5B). These concentrations were slightly higher than those reported to be effective in primary cortical cultures, but the motor neuron culture medium contained a fivefold greater concentration of l-arginine. 7-Nitroindazole (7-NI) protected to a lesser extent (Fig.5A), but the effect was limited by its low solubility. After 3 d the survival-promoting effects of BDNF and l-NAME decreased in parallel (Fig. 6).l-NAME protection was abolished by l-arginine but was not affected by d-arginine, and the inactive stereoisomer d-NAME provided no protection (Table1), indicating that l-NAME protection was attributable to NOS inhibition.
Table 1.
Treatment | Motor neuron survival* (%) | n |
---|---|---|
None | 35 ± 4 | 8 |
BDNF | 100 ± 4 | 8 |
l-NAME | 80 ± 6 | 4 |
l-NAME + l-arginine | 47 ± 3 | 4 |
l-NAME + d-arginine | 79 ± 4 | 4 |
d-NAME | 32 ± 6 | 4 |
*The percentage of motor neuron survival was determined 24 hr after plating, as indicated in Materials and Methods. The number of cells in BDNF-treated cultures at 24 hr was taken as 100%. Values are the mean ± SD of n determinations from at least two independent experiments. The concentrations were 100 pg/ml BDNF, 1 mml-NAME; 2 mml-arginine; 2 mmd-arginine; and 1 mmd-NAME.
Effects of exogenous NO
Protection from apoptosis by l-NAME could be overcome by the continuous generation of a physiologically plausible concentration of NO. NO was generated from 2-2′-(hydroxynitrosohydrazino) bis-ethanamine (DETA-NONOate), which has a half-life of 56 hr (Hrabie et al., 1993). At a concentration of 20 μm, DETA-NONOate produced a 100 nm steady-state concentration of NO over 24 hr, as measured in complete media (Beckman and Conger, 1995). DETA-NONOate causedl-NAME-treated motor neurons to undergo apoptosis but did not affect the survival of motor neurons cultured with or without BDNF (Table 2), suggesting that the NO itself did not induce apoptosis. The metabolites of the DETA moiety itself did not affect motor neuron viability.
Table 2.
Treatment | Motor neuron survival* (%) | n |
---|---|---|
None | 35 ± 4 | 10 |
BDNF | 100 ± 4 | 10 |
BDNF + DETA-NONOate | 102 ± 7 | 6 |
DETA-NONOate | 31 ± 4 | 4 |
DETA | 35 ± 5 | 4 |
l-NAME + DETA | 79 ± 8 | 4 |
l-NAME + DETA-NONOate | 50 ± 6 | 6 |
l-NAME + DETA-NONOate + SOD | 27 ± 4 | 4 |
SOD | 37 ± 8 | 4 |
*The percentage of motor neuron survival was determined 24 hr after plating, as described in Materials and Methods. The number of cells in BDNF-treated cultures at 24 hr was taken as 100%. Values are mean ± SD of n determination from at least two independent experiments. The concentrations were 100 pg/ml BDNF, 20 μm DETA-NONOate; 20 μm DETA; 1 mml-NAME; and 1000 U/ml SOD. Similar results were obtained by using up to 25,000 U/ml SOD.
The rate of decay of a bolus addition of NO in basal culture medium in darkness was lower in the presence (t1/2 = 2 min) than in the absence of SOD (t1/2 = 1 min), suggesting that autoxidation of culture medium produced a flux of superoxide sufficient to inactivate NO. The addition of SOD approximately doubled the amount of NO in the culture medium. Inclusion of SOD in the culture medium potentiated motor neuron death stimulated by DETA-NONOate in the presence of l-NAME (Table 2), but SOD had no effect on survival in the absence of BDNF, demonstrating that SOD increased the toxicity of extracellular NO.
Intracellular superoxide scavenging prevents apoptosis
Extracellular SOD had no effect on motor neuron survival in the absence of BDNF (Table 2). However, a membrane-permeable scavenger of superoxide, manganese TBAP (Faulkner et al., 1994; Szabo et al., 1996), increased survival of BDNF-deprived motor neurons at concentrations higher than 50 μm in a dose-dependent manner, with an EC50 of 75 μm (Fig.7), suggesting that an intracellular increase in superoxide was required to induce cell death.
Low concentrations of manganese TBAP also potentiated the protective effect of l-NAME on motor neuron survival. Individually, 10 μml-NAME and 50 μm manganese TBAP increased the survival of trophic factor-deprived motor neurons at 24 hr by only 30% and 10%, respectively (Fig.8). In combination, these low concentrations of l-NAME and manganese TBAP increased motor neuron survival by 55% to provide nearly complete protection (Fig.8).
Apoptosis is associated with increased nitrotyrosine
Motor neurons exhibited specific immunoreactivity for nitrotyrosine immediately after the 6 hr isolation procedure (data not shown), which was still evident in all experimental groups 24 hr later (Fig. 9). However, cells cultured without BDNF showed a threefold increase in nitrotyrosine immunofluorescence as compared with motor neurons cultured with BDNF or l-NAME (Fig. 10). Manganese TBAP also blocked nitrotyrosine immunoreactivity in BDNF-deprived neurons. In contrast, exogenous generation of NO by DETA-NONOate partially restored nitrotyrosine immunoreactivity in l-NAME-treated motor neurons (Fig. 10). Staining with nitrotyrosine antibodies was blocked completely by alanyl-3-nitrotyrosyl-glycine or 3-nitrotyrosine, but it was not affected by tyrosine at the same concentration.
DISCUSSION
Motor neuron apoptosis induced by trophic factor deprivationin vitro involved both increased NO production after the induction of neuronal NOS and augmented intracellular production of superoxide. Prevention of neuronal NOS expression by BDNF or inhibition of NO production as well as increased intracellular superoxide scavenging prevents motor neuron death and the increase in nitrotyrosine immunoreactivity (Fig. 10). These results suggest that motor neuron apoptosis was initiated by the endogenous formation of peroxynitrite from the reaction of NO with superoxide.
Loss of trophic support is well known to cause neuronal death in vitro and in animal models of motor neuron degeneration. Several lines of evidence suggest that the production of NO is involved in motor neuron death in vivo. Avulsion of ventral root in rat spinal neurons leads to a rapid induction of NOS (Wu, 1993), and chronic treatment with the NOS inhibitor nitro-l-arginine prevents motor neuron death (Wu and Li, 1993). Continuous infusion of BDNF after ventral root avulsion is reported to inhibit induction of NOS and cell death (Novikov et al., 1995). Distal axonal injury generally does not induce motor neuron degeneration, suggesting that Schwann cell-derived trophic support is sufficient to prevent the induction of neuronal NOS and motor neuron death. In addition to disrupting target- and Schwann cell-derived trophic support, ventral root avulsion can alter motor neuron activity (Greensmith and Vrbová, 1996) and disrupt spinal blood vessels, which are closely associated with the ventral root. Elucidation of the interdependent roles among trophic factor deprivation, NO production, and motor neuron death is nearly impossible to accomplish in vivo.
In the present study we found that purified embryonic motor neurons deprived of BDNF rapidly induced neuronal NOS, and the resulting production of NO contributed to the subsequent death by an apoptotic mechanism. Because motor neurons are maintained in a low-density culture (200 cells·cm−2), endogenous NO was acting predominantly on the same cell from which it was produced. Inhibition of NO synthesis protected the motor neurons from cell death, and the protection was reversed by a physiologically relevant extracellular steady-state concentration of NO (<100 nm). The same rate of NO production was not toxic to BDNF-treated motor neurons and did not potentiate cell death of BDNF-deprived motor neurons (Table 1), showing that NO itself was neither sufficient nor limiting to induce motor neuron apoptosis. Analogs of cGMP are protective for motor neurons (A. G. Estévez, unpublished observations); thus stimulation of soluble guanylate cyclase is unlikely to be responsible for the apoptosis induced by NO.
Our data suggest that the formation of peroxynitrite could account for NO-dependent cell death. In agreement with this hypothesis, trophic factor-deprived motor neurons were substantially more immunoreactive for nitrotyrosine. Although peroxynitrite may induce apoptosis by actions unrelated to tyrosine nitration, nitration is an excellent marker to show formation of peroxynitrite. NO itself does not produce nitrotyrosine, which implies that it had been transformed into a more powerful oxidant (Beckman et al., 1994; Beckman, 1996b). Manganese TBAP, a membrane-permeant SOD mimetic (Faulkner et al., 1994), protected motor neurons from apoptosis and reduced tyrosine nitration, supporting a role for intracellular superoxide reacting with NO to initiate apoptosis. Downregulation of SOD by using antisense oligonucleotides has been shown to stimulate apoptosis in PC12 cells (Troy and Shelanski, 1994; Troy et al., 1996) and motor neurons (Rothstein et al., 1994). Potentiation of the protection of low concentrations of l-NAME by manganese TBAP strongly supports a role for peroxynitrite in the induction of motor neuron apoptosis by trophic factor deprivation.
Extracellular SOD was not protective to BDNF-deprived motor neurons. This is consistent with the results of Saez et al. (1987) in ganglion cell cultures, who showed that SOD was protective to neurons only when it was delivered intracellularly. The addition of SOD increased the toxicity of NO generated from DETA-NONOate to BDNF-deprived neurons exposed to l-NAME. The superoxide flux generated by autoxidation of the culture media substantially lowered the steady-state concentration of NO. Although peroxynitrite was generated extracellularly, the vast majority of this peroxynitrite reacts with serum components before reaching a motor neuron. In the presence of extracellular SOD, the greater concentration of extracellular NO also increases the intracellular concentration of NO, which competes more effectively for intracellular superoxide and therefore produces more peroxynitrite within the motor neuron.
Approximately 50 missense mutations in Cu/Zn SOD have been associated with a subpopulation of familial ALS patients (Siddique and Hentati, 1996; Cudkowicz et al., 1997), although the mechanisms by which these mutations cause the selective degeneration of motor neurons remain unknown. Recently, the expression of a dominant-negative inhibitor of ICE in transgenic mice carrying the ALS mutant SOD G93A has been shown to slow the progression of the disease (Friedlander et al., 1997). Furthermore, overexpression of bcl-2 delays the onset of symptoms in the G93A mice (Kostic et al., 1997). These results suggest that the ALS SOD mutants induce apoptosis in adult motor neurons in transgenic mice.
Because all but one of the mutations are dominant in action and because transgenic mice expressing the mutant forms of SOD develop motor neuron disease, a gain-of-function generally is considered to be more likely than a loss of superoxide scavenging activity (Gurney et al., 1994). We have suggested that the gain-of-function by mutant SODs may result from increased efficiency of catalyzing tyrosine nitration by peroxynitrite (Beckman et al., 1993). Recent evidence indicates that nitrotyrosine is increased in upper and lower motor neurons of ALS (Abe et al., 1995;Chou et al., 1996a,b). Bruijn et al. (1997) have shown that the amino acid nitrotyrosine accumulates in transgenic mice bearing the G37R SOD mutation at the time when the disease develops but could not demonstrate an increase in nitrated proteins by Western blotting in ALS mice. The presence of nitrotyrosine suggests that peroxynitrite has been produced in motor neurons of ALS patients and in transgenic mice. Our results show that the endogenous formation of peroxynitrite after the induction of neuronal NOS is sufficient to induce apoptosis in embryonic motor neurons. Understanding how peroxynitrite induces apoptosis in cultured embryonic motor neurons may help to elucidate how mutations to SOD cause the death of adult motor neurons in ALS.
Footnotes
This work was supported by grants from National Institutes of Health and American Amyotrophic Lateral Sclerosis Association (to J.S.B.), Comisión Sectorial de Investigación Científica Universidad de la República (to A.G.E.), and Proyecto Banco Interamericano de Desarrollo-Consejo Nacional de Investigaciones Científicas y Técnicas (to L.B.). N.S. is supported in part by the Basic Mechanisms in Lung Disease Training Fellowship HL07533 from National Institutes of Health. We thank Drs. S. H. Snyder and A. M. Snowman from Johns Hopkins University for the generous gift of neuronal NOS cDNA; Genentech, Incorporated for neurotrophin-4/5; R. W. Scott and J. D. Hirsch from Cephalon, Incorporated for BDNF; Dr. B. Mayer for neuronal NOS antibodies and blocking peptide; S. Matalon for the use of the fluorescence microscope; Drs. K. Conger, Y. Zhuang, and Y. Z. Ye for helpful suggestions and assistance; and Drs. J. Crow, J. P. Eiserich, and J. A. Thompson for helpful comments on this manuscript.
Correspondence should be addressed to Dr. Alvaro G. Estévez, Department of Anesthesiology, Research Division, University of Alabama at Birmingham, 1900 University Boulevard, THT 958, Birmingham, AL 35233.
Dr. Manuel’s present address: School of Pharmacy, Texas Tech University Health Sciences Center, Amarillo, TX 79106.
REFERENCES
- 1.Abe K, Pan L-H, Watanabe M, Kato T, Itoyama Y. Induction of nitrotyrosine-like immunoreactivity in the lower motor neuron of amyotrophic lateral sclerosis. Neurosci Lett. 1995;199:152–154. doi: 10.1016/0304-3940(95)12039-7. [DOI] [PubMed] [Google Scholar]
- 2.Arakawa Y, Sendtner M, Thoenen H. Survival effect of ciliary neurotrophic factor (CNTF) on chick embryonic motoneurons in culture: comparison with other neurotrophic factors and cytokines. J Neurosci. 1990;10:3507–3515. doi: 10.1523/JNEUROSCI.10-11-03507.1990. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Beckman JS. The physiological and pathological chemistry of nitric oxide. In: Lancaster JR, editor. Nitric oxide: principles and actions. Academic; New York: 1996a. pp. 1–82. [Google Scholar]
- 4.Beckman JS. Oxidative damage and tyrosine nitration from peroxynitrite. Chem Res Toxicol. 1996b;9:836–844. doi: 10.1021/tx9501445. [DOI] [PubMed] [Google Scholar]
- 5.Beckman JS, Conger K. Direct measurement of nitric oxide in solutions with an ozone-based chemiluminescent detector. Methods. 1995;7:35–39. [Google Scholar]
- 6.Beckman JS, Carson M, Smith CD, Koppenol WH. ALS, SOD, and peroxynitrite. Nature. 1993;364:584. doi: 10.1038/364584a0. [DOI] [PubMed] [Google Scholar]
- 7.Beckman JS, Ye YZ, Anderson P, Chen J, Accavetti MA, Tarpey MM, White CR. Extensive nitration of protein tyrosines in human atherosclerosis detected by immunohistochemistry. Biol Chem Hoppe Seyler. 1994;375:81–88. doi: 10.1515/bchm3.1994.375.2.81. [DOI] [PubMed] [Google Scholar]
- 8.Beckman JS, Ye YZ, Chen J, Conger K. The interactions of nitric oxide with oxygen radicals and scavengers in cerebral ischemic injury. In: Siesjö BK, Wieloch T, editors. Advances in neurology 71: cellular and molecular mechanisms of ischemic brain damage. Lippincott–Raven; Philadelphia: 1996. pp. 339–354. [PubMed] [Google Scholar]
- 9.Bonfoco E, Krainc D, Ankarcrona M, Nicotera P, Lipton SA. Apoptosis and necrosis: two distinct events induced, respectively, by mild and intense insults with N-methyl-d-aspartate or nitric oxide/superoxide in cortical cell cultures. Proc Natl Acad Sci USA. 1995;92:7162–7166. doi: 10.1073/pnas.92.16.7162. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Bruijn LI, Beal MF, Becher MW, Schulz JB, Wong PC, Price DL, Cleveland DW. Elevated free nitrotyrosine levels, but not protein-bound nitrotyrosine or hydroxyl radicals, throughout amyotrophic lateral sclerosis (ALS)-like disease implicate tyrosine nitration as an aberrant in vivo property of one famillial ALS-linked superoxide dismutase 1 mutant. Proc Natl Acad Sci USA. 1997;94:7606–7611. doi: 10.1073/pnas.94.14.7606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Chandler CE, Parsons LM, Hosang M, Shooter EM. A monoclonal antibody modulates the interaction of nerve growth factor with PC12 cells. J Biol Chem. 1984;259:6882–6889. [PubMed] [Google Scholar]
- 12.Chou SM, Wang HS, Komai K. Colocalization of NOS and SOD1 in neurofilament accumulation within motor neurons of amyotrophic lateral sclerosis: an immunohistochemical study. J Chem Neuroanat. 1996a;10:249–258. doi: 10.1016/0891-0618(96)00137-8. [DOI] [PubMed] [Google Scholar]
- 13.Chou SM, Wang HS, Taniguchi A. Role of SOD-1 and nitric oxide/cyclic GMP cascade on neurofilament aggregation in ALS/MND. J Neurol Sci [Suppl] 1996b;139:16–26. doi: 10.1016/0022-510x(96)00090-1. [DOI] [PubMed] [Google Scholar]
- 14.Coyle JT, Puttfarcken P. Oxidative stress, glutamate, and neurodegenerative disorders. Science. 1993;262:689–695. doi: 10.1126/science.7901908. [DOI] [PubMed] [Google Scholar]
- 15.Cudkowicz ME, McKenna-Yasek D, Sapp PE, Chin W, Geller HR, Brown RH. Epidemiology of mutations in superoxide dismutase in amyotrophic lateral sclerosis. Ann Neurol. 1997;41:210–221. doi: 10.1002/ana.410410212. [DOI] [PubMed] [Google Scholar]
- 16.Culcasi M, Lafon-Cazal M, Pietri S, Bockaert J. Glutamate receptors induce a burst of superoxide via activation of nitric oxide synthase in arginine-depleted neurons. J Biol Chem. 1994;269:12589–12593. [PubMed] [Google Scholar]
- 17.Dawson VL, Dawson TM, London ED, Bredt DS, Snyder SH. Nitric oxide mediates glutamate neurotoxicity in primary cortical cultures. Proc Natl Acad Sci USA. 1991;88:6368–6371. doi: 10.1073/pnas.88.14.6368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Dawson VL, Kizushi VM, Huang KL, Snyder SH, Dawson TM. Resistance to neurotoxicity in cortical cultures from neuronal nitric oxide synthase-deficient mice. J Neurosci. 1996;16:2479–2487. doi: 10.1523/JNEUROSCI.16-08-02479.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ericson J, Thor S, Edlund T, Jessell T, Yamada T. Early stages of motor neuron differentiation revealed by expression of homeobox gene Islet-1. Science. 1992;256:1555–1560. doi: 10.1126/science.1350865. [DOI] [PubMed] [Google Scholar]
- 20.Estévez AG, Radi F, Barbeito L, Shin JT, Thompson JA, Beckman JS. Peroxynitrite-induced cytotoxicity in PC12 cells: evidence for an apoptotic mechanism differentially modulated by neurotrophic factors. J Neurochem. 1995;65:1543–1550. doi: 10.1046/j.1471-4159.1995.65041543.x. [DOI] [PubMed] [Google Scholar]
- 21.Faulkner KM, Liochev SI, Fridovich I. Stable Mn(III) porphyrins mimic superoxide dismutase in vitro and substitute for it in vivo. J Biol Chem. 1994;269:23471–23476. [PubMed] [Google Scholar]
- 22.Friedlander RM, Brown RH, Gagliardini V, Wang J, Yuan J. Inhibition of ICE slows ALS in mice. Nature. 1997;388:31. doi: 10.1038/40299. [DOI] [PubMed] [Google Scholar]
- 23.Good PF, Werner P, Hsu A, Olanow CW, Perl DP. Evidence for neuronal oxidative damage in Alzheimer’s disease. Am J Pathol. 1996;149:21–28. [PMC free article] [PubMed] [Google Scholar]
- 24.Gouin A, Bloch-Gallego E, Tanaka H, Rosenthal A, Henderson CE. Transforming growth factor-beta 3, glial cell line-derived neurotrophic factor, and fibroblast growth factor-2 act in different manners to promote motoneuron survival in vitro. J Neurosci Res. 1996;43:545–464. doi: 10.1002/(SICI)1097-4547(19960215)43:4<454::AID-JNR6>3.0.CO;2-E. [DOI] [PubMed] [Google Scholar]
- 25.Greensmith L, Vrbová G. Motoneurone survival: a functional approach. Trends Neurosci. 1996;19:450–455. doi: 10.1016/s0166-2236(96)20034-7. [DOI] [PubMed] [Google Scholar]
- 26.Gurney ME, Pu H, Chiu AY, Dal Corto MC, Polchow CY, Alexander DD, Caliendo J, Hentati A, Kwon YW, Deng H-X, Chen W, Zhai P, Sufit RL, Siddique T. Motor neuron degeneration in mice that express a human Cu,Zn superoxide dismutase mutation. Science. 1994;264:1772–1775. doi: 10.1126/science.8209258. [DOI] [PubMed] [Google Scholar]
- 27.Hantraye P, Brouillet E, Ferrante R, Palfi S, Bolan R, Matthews RT, Beal MF. Inhibition of neuronal nitric oxide synthase prevents MPTP-induced parkinsonism in baboons. Nat Med. 1996;2:1017–1021. doi: 10.1038/nm0996-1017. [DOI] [PubMed] [Google Scholar]
- 28.Henderson CE, Camu W, Mettling C, Gouin A, Poulsen K, Karihaloo M, Rullamas J, Evans T, McMahon SB, Armanini MP, Berkemeier L, Phillips HS, Rosenthal A. Neurotrophins promote motor neuron survival and are present in embryonic limb bud. Nature. 1993;363:266–270. doi: 10.1038/363266a0. [DOI] [PubMed] [Google Scholar]
- 29.Henderson CE, Phillips HS, Pollock RA, Davies AM, Lemeulle C, Armanini M, Simpson LC, Moffet B, Vandlen RA, Koliatsos VE, Rosenthal A. GDNF: a potent survival factor for motoneurons present in peripheral nerve and muscle. Science. 1994;266:1062–1064. doi: 10.1126/science.7973664. [DOI] [PubMed] [Google Scholar]
- 30.Henderson CE, Bloch-Gallego E, Camu W. Purification and culture of embryonic motor neurons. In: Cohen J, Wilkin G, editors. Neuronal cell culture: a practical approach. IRL; Oxford, UK: 1995. pp. 69–81. [Google Scholar]
- 31.Herdegen T, Brecht S, Mayer B, Leah J, Kummer W, Bravo R, Zimmermann M. Long-lasting expression of JUN and KROX transcription factors and nitric oxide synthase in intrinsic neurons of the rat brain following axotomy. J Neurosci. 1993;13:4130–4145. doi: 10.1523/JNEUROSCI.13-10-04130.1993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Herdegen T, Rudiger S, Mayer M, Bravo R, Zimmermann M. Expression of nitric oxide synthase and colocalisation with Jun, Fos, and Krox transcription factors in spinal cord neurons following noxious stimulation of the rat hindpaw. Mol Brain Res. 1994;22:245–258. doi: 10.1016/0169-328x(94)90053-1. [DOI] [PubMed] [Google Scholar]
- 33.Hrabie JA, Klose JR, Wink DA, Keefer LK. New nitric oxide-releasing zwitterions derived from polyamines. J Org Chem. 1993;58:1472–1476. [Google Scholar]
- 34.Huang Z, Huang PL, Panahian N, Dalkara T, Fishman MC, Moskowitz MA. Effects of cerebral ischemia in mice deficient in neuronal nitric oxide synthase. Science. 1994;265:1883–1885. doi: 10.1126/science.7522345. [DOI] [PubMed] [Google Scholar]
- 35.Hughes RA, Sendtner M, Thoenen H. Members of several gene families influence survival of rat motoneurons in vitro and in vivo. J Neurosci Res. 1993;36:663–671. doi: 10.1002/jnr.490360607. [DOI] [PubMed] [Google Scholar]
- 36.Ischiropoulos H, Zhu L, Chen J, Tsai HM, Martin JC, Smith CD, Beckman JS. Peroxynitrite-mediated tyrosine nitration catalyzed by superoxide dismutase. Arch Biochem Biophys. 1992;298:431–437. doi: 10.1016/0003-9861(92)90431-u. [DOI] [PubMed] [Google Scholar]
- 37.Kostic V, Jackson-Lewis V, de Bilbao F, Dubois-Dauphin M, Przedborski S. Bcl-2: prolonging life in a transgenic mouse model of familial amyotrophic lateral sclerosis. Science. 1997;277:559–562. doi: 10.1126/science.277.5325.559. [DOI] [PubMed] [Google Scholar]
- 38.Lafon-Cazal M, Pietri S, Culcasi M, Bockaert J. NMDA-dependent superoxide production and neurotoxicity. Nature. 1993a;364:535–537. doi: 10.1038/364535a0. [DOI] [PubMed] [Google Scholar]
- 39.Lafon-Cazal M, Culcasi M, Gaven F, Pietri S, Bockaert J. Nitric oxide, superoxide, and peroxynitrite: putative mediator of NMDA-induced cell death in cerebellar granule cells. Neuropharmacology. 1993b;32:1259–1266. doi: 10.1016/0028-3908(93)90020-4. [DOI] [PubMed] [Google Scholar]
- 40.Li L, Wu W, Lin L-FH, Lei M, Oppenheim RW, Houenou LJ. Rescue of adult mouse motoneurons from injury-induced cell death by glial cell line-derived neurotrophic factor. Proc Natl Acad Sci USA. 1995;92:9771–9775. doi: 10.1073/pnas.92.21.9771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Meyer W, Neurand K, Bartels T, Kojda G, Mayer B. Demonstration of NADPH-diaphorase (NO-synthase) in the apocrine and eccrine skin glands of domesticated mammals. Cell Mol Biol. 1994;40:175–181. [PubMed] [Google Scholar]
- 42.Milligan CE, Prevette D, Yaginuma H, Homma S, Cardwell C, Fritz LC, Tomasselli KJ, Oppenheim RW, Schwartz M. Peptide inhibitors of the ICE protease family arrest programmed cell death of motoneurons in vivo and in vitro. Neuron. 1995;15:385–393. doi: 10.1016/0896-6273(95)90042-x. [DOI] [PubMed] [Google Scholar]
- 43.Neff NT, Prevette D, Houenou LJ, Lewis ME, Glicksman A, Yin Q-W, Oppenheim RW. Insulin-like growth factors: putative muscle-derived trophic agents that promote motoneuron survival. J Neurobiol. 1993;24:1578–1588. doi: 10.1002/neu.480241203. [DOI] [PubMed] [Google Scholar]
- 44.Novikov L, Novikova L, Kellerth J-O. Brain-derived neurotrophic factor promotes survival and blocks nitric oxide synthase expression in adult rat spinal motoneurons after ventral root avulsion. Neurosci Lett. 1995;200:45–48. doi: 10.1016/0304-3940(95)12078-i. [DOI] [PubMed] [Google Scholar]
- 45.Oppenheim RW, Qin-Wei Y, Prevette D, Yan Q. Brain-derived neurotrophic factor rescues developing avian motoneurons from cell death. Nature. 1992;360:755–757. doi: 10.1038/360755a0. [DOI] [PubMed] [Google Scholar]
- 46.Oppenheim RW, Houenou LJ, Johnson JE, Lin L-FH, Li L, Lo AC, Newsome AL, Prevette DM, Wang S. Developing motor neurons rescued from programmed cell death by GDNF. Nature. 1995;373:344–346. doi: 10.1038/373344a0. [DOI] [PubMed] [Google Scholar]
- 47.Pennica D, Arce V, Swanson TA, Vejsada R, Pollock RA, Armanini M, Dudley K, Phillips HS, Rosenthal A, Kato AC, Henderson CE. Cardiotrophin-1, a cytokine present in embryonic muscle, supports long-term survival of spinal motoneurons. Neuron. 1996;17:63–74. doi: 10.1016/s0896-6273(00)80281-0. [DOI] [PubMed] [Google Scholar]
- 48.Przedborski S, Donaldson D, Jakowec M, Kish SJ, Guttman M, Rosoklija G, Hays AP. Brain superoxide dismutase, catalase, and glutathione peroxidase activities in amyotrophic lateral sclerosis. Ann Neurol. 1996;39:158–165. doi: 10.1002/ana.410390204. [DOI] [PubMed] [Google Scholar]
- 49.Rothstein JD, Bristol LA, Hosler B, Brown RH, Jr, Kuncl RW. Chronic inhibition of superoxide dismutase produces apoptotic death of spinal neurons. Proc Natl Acad Sci USA. 1994;91:4155–4159. doi: 10.1073/pnas.91.10.4155. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Saez JS, Kessler JA, Bennett MVL, Spray DC. Superoxide dismutase protects cultured neurons against death by starvation. Proc Natl Acad Sci USA. 1987;84:3056–3059. doi: 10.1073/pnas.84.9.3056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Schmalbruch H, Rosenthal A. Neurotrophin-4/5 postpones the death of injured motoneurons in newborn rats. Brain Res. 1995;700:254–260. doi: 10.1016/0006-8993(95)00982-v. [DOI] [PubMed] [Google Scholar]
- 52.Schulz JB, Huang PL, Matthews RT, Passov D, Fishman MC, Beal MF. Striatal malonate lesions are attenuated in neuronal nitric oxide synthase knockout mice. J Neurochem. 1996;67:430–433. doi: 10.1046/j.1471-4159.1996.67010430.x. [DOI] [PubMed] [Google Scholar]
- 53.Sendtner M, Holtmann B, Kolbeck R, Thoenen H, Barde Y-A. Brain-derived neurotrophic factor prevents the death of motoneurons in newborn rats after nerve section. Nature. 1992;360:757–759. doi: 10.1038/360757a0. [DOI] [PubMed] [Google Scholar]
- 54.Shaul PW, North AJ, Snyder SH, Star RA. Prolonged in vivo hypoxia enhances nitric oxide synthase type I and type III gene expression in adult rat lung. Am J Respir Cell Mol Biol. 1995;13:167–174. doi: 10.1165/ajrcmb.13.2.7542896. [DOI] [PubMed] [Google Scholar]
- 55.Siddique T, Hentati A. Familial amyotrophic lateral sclerosis. Clin Neurosci. 1996;3:338–347. [PubMed] [Google Scholar]
- 56.Smith MA, Harris PL, Sayre LM, Beckman JS, Perry G. Widespread peroxynitrite-mediated damage in Alzheimer disease. J Neurosci. 1997;17:2653–2657. doi: 10.1523/JNEUROSCI.17-08-02653.1997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Spear N, Estévez AG, Barbeito L, Beckman JS, Johnson GVW. Nerve growth factor protects PC12 cells against peroxynitrite-induced apoptosis via a mechanism dependent on phosphatidylinositol-3 kinase. J Neurochem. 1997;69:53–59. doi: 10.1046/j.1471-4159.1997.69010053.x. [DOI] [PubMed] [Google Scholar]
- 58.Szabo C, Day BJ, Salzman AL. Evaluation of the relative contribution of nitric oxide and peroxynitrite to the suppression of mitochondrial respiration in immunostimulated macrophages using a manganese mesoporphyrin superoxide dismutase mimetic and peroxynitrite scavenger. FEBS Lett. 1996;381:82–86. doi: 10.1016/0014-5793(96)00087-7. [DOI] [PubMed] [Google Scholar]
- 59.Troy CM, Shelanski ML. Down-regulation of copper/zinc superoxide dismutase causes apoptotic death in PC12 neuronal cells. Proc Natl Acad Sci USA. 1994;91:6384–6387. doi: 10.1073/pnas.91.14.6384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Troy CM, Derossi D, Prochiantz A, Greene LA, Shelanski ML. Downregulation of Cu/Zn superoxide dismutase leads to cell death via the nitric oxide–peroxynitrite pathway. J Neurosci. 1996;16:253–261. doi: 10.1523/JNEUROSCI.16-01-00253.1996. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Tsuchida T, Ensini M, Morton SB, Baldassare M, Edlund T, Jessell TM, Pfaff SL. Topographic organization of embryonic motor neurons defined by expression of LIM homeobox genes. Cell. 1994;79:957–970. doi: 10.1016/0092-8674(94)90027-2. [DOI] [PubMed] [Google Scholar]
- 62.Tukey JW. Exploratory data analysis. Addison-Wesley; Reading, MA: 1977. [Google Scholar]
- 63.Wu W. Expression of nitric-oxide synthase (NOS) in injured CNS neurons as shown by NADPH diaphorase histochemistry. Exp Neurol. 1993;120:153–159. doi: 10.1006/exnr.1993.1050. [DOI] [PubMed] [Google Scholar]
- 64.Wu W, Li L. Inhibition of nitric oxide synthase reduces motoneuron death due to spinal root avulsion. Neurosci Lett. 1993;153:121–124. doi: 10.1016/0304-3940(93)90303-3. [DOI] [PubMed] [Google Scholar]
- 65.Yan Q, Johnson EM., Jr An immunohistochemical study of the nerve growth factor receptor in developing rats. J Neurosci. 1988;8:3481–3498. doi: 10.1523/JNEUROSCI.08-09-03481.1988. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Yan Q, Elliot J, Snider WD. Brain-derived neurotrophic factor rescues spinal motor neurons from axotomy-induced cell death. Nature. 1992;360:753–755. doi: 10.1038/360753a0. [DOI] [PubMed] [Google Scholar]
- 67.Yan Q, Elliot JL, Matheson C, Sun J, Zhang L, Mu X, Rex KL, Snider WD. Influences of neurotrophins on mammalian motoneurons in vivo. J Neurobiol. 1993;24:1555–1577. doi: 10.1002/neu.480241202. [DOI] [PubMed] [Google Scholar]
- 68.Ye YZ, Strong M, Huang Z-Q, Beckman JS. Antibodies that recognize nitrotyrosine. Methods Enzymol. 1996;269:201–209. doi: 10.1016/s0076-6879(96)69022-3. [DOI] [PubMed] [Google Scholar]