Abstract
It is believed that depression impedes and motivation enhances functional recovery after neuronal damage such as spinal-cord injury and stroke. However, the neuronal substrate underlying such psychological effects on functional recovery remains unclear. A longitudinal study of brain activation in the non-human primate model of partial spinal-cord injury using positron emission tomography (PET) revealed a contribution of the primary motor cortex (M1) to the recovery of finger dexterity through the rehabilitative training. Here, we show that activity of the ventral striatum, including the nucleus accumbens (NAc), which plays a critical role in processing of motivation, increased and its functional connectivity with M1 emerged and was progressively strengthened during the recovery. In addition, functional connectivities among M1, the ventral striatum and other structures belonging to neural circuits for processing motivation, such as the orbitofrontal cortex, anterior cingulate cortex and pedunculopontine tegmental nucleus were also strengthened during the recovery. These results give clues to the neuronal substrate for motivational regulation of motor learning required for functional recovery after spinal-cord injury.
Introduction
Current basic researches on the neuro-rehabilitation focus mainly on neuronal plasticity and motor learning for functional restoration of affected limbs after neuronal damage such as spinal-cord injury and stroke. Depression is a common psychological problem after neuronal damage [1]–[4], and it has been shown to impede the recovery process [3]. Therefore, motivation is a key issue for enhancing the effect of rehabilitation therapy. However, the neuronal substrate underlying such psychological effects on functional recovery remains obscure.
Recently, we showed the neuronal mechanisms of functional recovery in a non-human primate model of partial spinal cord injury (Fig. 1A) [5]–[9]. Advantages of the experiments on non-human primate models are, for instance, that the extent of the lesion can be well defined and that the recovery time course can be controlled. Furthermore, longitudinal and quantitative behavioral evaluation from pre-lesional state are possible which is usually unavailable in patient studies [7], [10]. Moreover, especially the macaque monkeys are indispensable model animals for this kind of research, because they are close enough to humans both in the structure of the brain and body architecture [11], [12]. Especially loss of the dexterous hand movements is one of the major causes of suffering for the patients with spinal cord injury and such movement repertories are equipped only in higher primate species including humans and macaque monkeys. The macaque monkeys were trained to reach for a small piece of food through a narrow vertical slit, and to grasp it between the pads of their index finger and thumb (Fig. 1B, see Video S1 for details). We performed a near-complete or complete lesion of the lateral corticospinal tract (l-CST) at the mid-cervical spinal segment, which impaired the direct cortico-motoneuronal connections while the indirect pathways from the motor cortex to motoneurons, mediated by brainstem or spinal cord interneurons whose axons were located ventrally to those of the l-CST, were mostly left intact (Fig. 1A). As described in the previous study, the precision grip was impaired immediately after the spinal-cord injury. However, the success rate of precision grip recovered almost completely within 4–5 weeks in all the 3 monkeys tested (Fig. 1B and C, see Video S1 for details). We performed PET scans during the preoperative, early (approximately 3 weeks to 1.5 month postoperatively) and late stages of recovery (approximately 3–4 months postoperatively) and measured the regional cerebral blood flow (rCBF) as an index of the neuronal activity. We found that activities of the bilateral M1 increased during the early recovery stage (Fig. 2Ab). During the later stage of recovery, the activity of the bilateral ventral premotor cortices (PMv) increased and the activated area of the contralesional M1 was expanded, while activation of the ipsilesional M1 was reduced. Moreover, the contribution of these cortical regions to recovery has been demonstrated by a reversible inactivation with the microinjection of muscimol. On the other hand, we also found that the activity of the contralesional ventral striatum (VSt), including the nucleus accumbens (NAc), increased during the recovery (Fig. 2Aa) [6], [7]. In this study, in order to explore the relationship between these motor cortices and motivation centers, we examined the functional connectivity of the VSt with other brain regions by the correlational analysis of rCBF [13], [14] using the same set of the PET data in our preceding study [6].
Results
Functional recovery of finger dexterity after l-CST lesion
As described in previous study [6], dexterous finger control was impaired immediately after the spinal-cord injury. The success rate of precision grip recovered to more than 80% of that before the lesion within 3 weeks in all the 3 monkeys. Then the success rate recovered almost completely within 4–5 weeks (Fig. 1A and B). The recovery time course of each animal was not uniform (Fig. 1C), although we intended the lesions to be as similar in size as possible (Fig. 1A). The timing of PET scans at each stage was determined by the recovery level in the behavioral test. We performed the PET scans when each monkey reached similar performance level. On the basis of recovery course of precision grip, we performed PET scanning during the following three stages: (i) preoperative stage, (ii) early recovery stage, and (iii) late recovery stage. PET scans during the early recovery stage were initiated when the success rate for retrieval reached 80%. PET scans during the late recovery stage were initiated when the success rate for retrieval consistently reached 100% at 3 months post-operation. In Monkey H, PET scans during the early recovery stage were conducted between postoperative days 15 to 29, and those during the late recovery stage were conducted between postoperative days 90 to 112. In Monkey K, PET scans during the early stage were conducted between postoperative days 22 to 41, and those during the late stage were conducted between postoperative days 92 to 115. In Monkey T, PET scans during the early stage were conducted between postoperative days 36 to 64, and those during the late stage were conducted between postoperative days 106 to 122.
Functional connectivity between the ventral striatum and motor cortex emerged and was strengthened through the recovery course
Regions of interest (ROIs) for the contralesional ventral striatum (co-VSt, Fig. 2Aa), contralesional motor cortex (co-M1, Fig. 2Ab) and ipsilesional motor cortex (ip-M1, Fig. 2Ab), which included the activated foci revealed by SPM analysis, was determined by the results of the main effect of the functional recovery, which were reported in our previous study [6]. Scatter plot diagrams in Figure 2B show the correlations of signal intensity in the co-VSt with that in the co- (Fig. 2Ba–d) or ip- (Fig. 2Be–h) M1 in each monkey before and after the spinal-cord injury. A positive correlation between the co-VSt and both the co- and ip-M1 was not observed prior to the lesion (Fig. 2Ba and e), but emerged during the recovery, especially during the late recovery stage (Fig. 2Bb–d, Bf–h) in all the 3 monkeys. All the r- and p-values of correlation at the individual stages are indicated in Table S1.
Functional connectivity of the ventral striatum with other motivation centers
Summary of multiple comparisons of the whole brain regions of the 3 monkeys are shown in Figure 3 and Table 1. During the recovery, significant positive correlations with the VSt (ROI in Fig. 2Aa) were also observed in bilateral orbitofrontal cortices (OBF, Fig. 3Bd), the rostral part of the anterior cingulate cortex (rACC, Fig. 3Be), the caudal part of the ACC (cACC, Fig. 3Bf and g), the ipsilesional pedunculopontine tegmental nucleus (PPTN, Fig. 3Bi) and the putamen (Pu, Fig. 3Bg), all of which have been described to be involved in the processing of motivation and emotion [15]–[28] (see also Table 1). Such correlation was not observed preoperatively, but, emerged during recovery (Fig. 3).
Table 1. Statistical analysis of correlation of the rCBF in the co-VSt with that in other brain regions during the recovery stage.
Brain region | Laterality | t-value | Location in Fig. 3B |
OBF | contra | 3.73 | d |
OBF | ipsi | 3.42 | d |
rACC | ipsi | 3.18 | e |
cACC | ipsi | 3.37 | f |
Pu | contra | 4.26 | g |
M1 | contra | 5.46 | H |
M1 | ipsi | 3.19 | h |
IPS | contra | 4.31 | i |
PPTN | ipsi | 3.06 | i |
Cb | ipsi | 3.40 | j |
Cb | Contra | 3.94 | j |
The level of the significance was set at P<0.001 (t>3.15). The t-values at the center of individual masses of activation (the locations are indicated with letters that correspond with those in Fig. 3Bd–j) are indicated.
To confirm whether these brain sites are mutually correlated, we calculated correlation of signal intensity within these brain sites. In figure 4, the significant level of correlation between two areas among M1, ACC, OBF, VSt, PPTN and Ventral Tegmental Area (VTA) in the intact state and during the recovery process is indicated with the color of the lines connecting the two areas. As clearly indicated, only the M1 and ACC showed positive correlation in the intact state (Figure S2Ab–c and S4Aa, Table S2 and S5 in intact). However, the correlation between the M1 and these motivation centers including the ACC, OBF, VSt, PPTN and VTA, and correlation within motivation centers were strengthened during the recovery process (Figure S1, S2, S3, S4, S5, S6, Table S2, S3, S4, S5, S6, S7). Thus, functional connectivity between the M1 and the motivation centers and mutual functional connection among the motivation centers were strengthened throughout the period of recovery process.
Discussion
The present study has shown that the functional connectivity among the M1, the VSt and other structures belonging to the neural circuits for processing motivation emerged and were strengthened during recovery. The present study thus demonstrated plasticity in the functional connectivity of the motivational networks with the M1, which might be specifically correlated with the extent of functional recovery of finger dexterity after the spinal-cord injury.
The VSt, in particular the NAc, has been shown to be important in information processing for motivation and reward. Neuronal activity [21] and dopamine [22] release in the NAc have been reported to increase during expectation and experience of rewards. Patients with dysfunction of the NAc suffer from depression [24], and the NAc may act as a gateway to enhance or degrade processing of motivational information that controls emotional actions and behaviors [18], [19], [23], [24]. A recent clinical study demonstrated that deep brain stimulation to the NAc alleviated anhedonia during depression, and accompanied increases in activity of the fronto-striatal networks and limbic system [26]. Furthermore, repetitive transcranial magnetic stimulation (rTMS) to the prefrontal cortex has been used as a potential treatment in neuropsychiatric disorders such as depression [16], [17], [20]. In addition, the ACC has been shown to play an important role in effort-related decision-making [27], [28]. Thus, activity of fronto-striatal networks including the NAc may play a critical role in the control of motivation and its activation might be helpful to enhance motivational state during the functional recovery of finger dexterity after the spinal-cord injury.
It is important to examine how the “functional connectivity” of the motivational networks with the M1 observed in the present study emerged. One possibility that should be excluded is that it simply reflects the change in amount of reward. On this aspect, because the PET scans were performed after the success rate exceeded 80%, the amount of reward that the monkeys got during the sessions was constant both preoperatively and postoperatively, or slightly less only during the early recovery stage. Therefore, the correlation observed in this study was not likely to have resulted from pseudo-correlation between the increase in the reward amount and increased activity of M1, both of which might be parallel the recovery of success rate.
On the other hand, task difficulty would be increased after spinal cord injury, which needs higher level of motivation to achieve the demanding task that requires activation of mesolimbic system. Task difficulty might also require higher level of M1 activation, that might lead to emergence of the correlation between the two areas. We assume this may not be the sole explanation of the present result, because correlation became higher at the later stage of recovery when performance of the task became easier, than the early phase, when the performing the task was difficult. Thus, at this stage, it is difficult to make clear explanation on how the correlation between the VSt and M1 emerged during the recovery from the spinal-cord injury. Further experiments are needed, such as recording of neural activity from VSt, and testing the effects of activation/inactivation of the VSt neural activity on the M1 activity and functional recovery of the hand dexterity. However, it might be suggested that functional recovery of finger dexterity requires skill learning and may require higher level of M1 activity, and increased synaptic efficacy in the pathways between M1 and motivation centers through the NAc might underlie such reorganization of the neural circuits involving the M1. Then a question may arise on how the M1 and NAc are connected with each other. By using transsynaptic labeling technique, it has been shown that the NAc provides strong multisynaptic projections to all the body-part representations in the M1 through the substantia innominata [29], which is also a part of the VSt. rTMS on the M1 can evoke the release of dopamine in the VSt, including the NAc, in anesthetized monkeys [30]. Thus, the M1 and NAc have oligosynaptic mutual interconnections.
It has been reported that the dopaminergic system is essential for reinforcement learning [31]–[33]. Currently, skill learning and reinforcement learning tend to be discussed in different contexts. Our results might have identified the neural substrates that bridge the reinforcement learning to motor learning for functional recovery after the neuronal damage. The present findings may promote the development of psychological therapies that enhance the efficacy and quality of rehabilitation.
Methods
Subjects
Three monkeys [two Macaca mulatta (Monkey T: male 8.1 kg, Monkey K: male 6.5 kg) and a Macaca fuscata (Monkey H: female 6.7 kg)] were used in the present study. The data of the present study were obtained for our previous studies [6], [29] and re-analyzed with a different method for the present study. The experiments were approved by the animal experimental committee of the National Institute of Natural Sciences (Approved No.: A15-85-58) and were performed in accordance with the NIH Guidelines for the Care and Use of Laboratory. Monkeys were monitored closely and animal welfare was assessed on a daily basis, and if necessary several times a day. This includes veterinary examinations to make sure animals are not suffering. If animals experience pain they receive pain medications. If pain cannot be relieved, or if veterinary examination reveals signs of suffering that cannot be relieved by analgesics, antiemetics, or antibiotic therapy, animals are euthanized. The details of animal welfare and steps taken to ameliorate suffering were in accordance with the recommendations of the Weatherall report, “The use of non-human primates in research”.
Spinal Cord Injury
In order to obtain a partial spinal-cord injury, the l-CST located in the dorsolateral funiculus of the spinal cord was transected under general deep anesthesia [5]–[9]. Briefly, the border between the C4 and C5 segments was exposed by laminectomy of the C3 and C4 vertebrae, and a transverse opening was made in the dura. The CST lesion was made under a surgical microscope. First, a small opening in the pia mater was made at the lateral convexity of the spinal cord. A horizontal strip in a mediolateral direction relative to the lateral funiculus was made by inserting a minute L-shape hook that could not be inserted the gray matter. Next, the dorsal part of the lateral funiculus was transected using forceps from the dorsal root entry zone ventrally to the level of the horizontal strip of the lesion described above. Finally, the lesion was extended ventrally to the most lateral part of the lateral funiculus. The opened dura mater was closed, and skin and back muscles were sutured with nylon or silk strings.
Behavioral test
As described in a previous report [5]–[9], in order to assess the capacity of dexterous finger movements before and after spinal cord injury, the monkeys were trained to be seated on a monkey chair and to reach, grasp and retrieve a small piece of sweet potato or carrot (about 7 mm cubic) through a narrow vertical slit using both the index finger and thumb of the forelimb (Fig. 1B, see also Video S1). The food piece was positioned in the center of a vertical slit located at the height of the monkey's shoulder and at a sagittal distance of 15 cm. Each experiment (approximately 30 min every third day) consisted of 100 trials. In each trial, the animal reached for the food piece from a fixed position. A high-speed digital video camera (33 frames/s at a shutter speed of 1/1000 of a second) was used to record the reach-retrieval sequences from a lateral view. A successful trial was defined as any trial that resulted in the successful precision grip with the index finger and thumb, and removal of the food from the pin without dropping it.
PET experiments
A series of PET scans was conducted during the intact and recovery stages as descried elsewhere [6], [34] (see also text in RESULTS). Briefly, thirty-one slices of 3.6 mm intervals were collected simultaneously by the PET scanner. After the delivery of a bolus of [15O]H2O via a cannula placed into the sural vein, the scan was initiated automatically when the radioactivity in the brain reached greater than 30 kcps. The monkey was allowed to begin the behavioral task (20 trials) at about 10 s before the start of the PET scan. During the scan, the monkeys performed a series of reach-grip-retrieve-eat movements every 5 s. PET data were collected for 80 s (one 40 s frame followed by four 10 s frames). Video recording of the scanning session was performed, and if the monkey did not start from the fixed starting point or did not start reaching immediately (within less than 15 frames = 500 ms) after presentation of the food or did not move the hand directly to the food piece, the data from the session was excluded from analysis. Twenty scans were conducted in Monkey H and K in both tasks for every stage, and 24 scans were conducted in Monkey T.
Data Analysis
The reconstruction was performed on projection data, after which images were corrected for attenuation using a transmission scan with a 4.0 mm Hanning filter. Reconstructed brain images (voxel size, 1.2×1.2×3.6 mm), which were scalped and smoothed with a 4.0 mm FWHM isotropic kernel, were processed using statistical analysis of the parametric mapping (SPM99) software. For the inter-subject analysis, brain shapes of individual monkeys were morphologically normalized to a pseudo-brain template MRI, which was constructed by averaging 8 brain MRI images from young adult male macaque monkeys using a [18F]FDG-PET image of each subject. PET images obtained from the scan sessions that satisfied the behavioral criteria were summated for their first 60 s epochs, and were used for statistical analysis by parametric mapping (SPM99) software (see Text S1). Regions of interest (ROIs) for the co-VSt, which included the activated foci revealed by SPM analysis, was determined by the results of the main effect of the functional recovery (Fig. 2Ab), which was reported in our previous study [6]. The correlations were calculated between rCBF values in the VSt on the contralesional hemisphere and in other regions during the precision grip task. Additional ROIs for the neuronal substrate for motivation such as the rostral and caudal part of the anterior cingulated cortex (rACC Fig. 3Be and cACC Fig. 3Bf), orbitofrontal cortex (OBF, Fig. 3Bd on contralesional side), and pedunculopontine tegmental nucleus (PPTN, Fig. 3Bi on ipsilesional mid-brain) were determined by the results of correlation analysis with rCBF on the VSt during the precision grip task at the recovery stage. Additional ROI for the motor center such as the primary motor cortex (M1, Fig. 3Bh on contralesional side) were also determined by the results of correlation analysis with rCBF on the VSt during the precision grip task at the recovery stage. The rCBF values of 9 voxels around the center voxel on each activation spot during each scan session were used for correlation analysis. The statistical threshold was set at P<0.01, uncorrected (t>2.38 for intact, early and late stage, t>2.35 for recovery stage).
Histological assessment of lesion completeness
At the end of the experiments, the monkeys were deeply anesthetized with an overdose of sodium pentobarbital (50–75 mg/kg, i.v.) and perfused transcardially with 0.1 M phosphate-buffered saline (PBS, pH 7.3), followed by 4% paraformaldehyde in 0.1 M PBS (pH 7.3) and, finally, the same fresh PBS containing 10%, 20% and then 30% sucrose. The spinal cords were removed from the bone immediately, saturated with 30% sucrose in 0.1 M PBS (pH 7.3), then cut serially into 50 µm thick coronal sections on the freezing microtome. The sections processed for Klüver-Barrera staining or Nissl-staining with 1% Cresyl Violet were used for assessing the lesion extent.
Supporting Information
Acknowledgments
We thank H. Oba, D. Fukumoto and K. Isa for technical support.
Footnotes
Competing Interests: The authors have declared that no competing interests exist.
Funding: The research was supported by Precursory Research for Embryonic Science and Technology (PRESTO) and Core Research for Evolutional Science and Technology (CREST), Japan Science and Technology Agency (JST), the Molecular Imaging Program on “Research Base for Exploring New Drugs” from the Ministry of Education, Culture, Sports, Science and Technology (MEXT) and Nakayama Foundation for Human Science. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Chemerinski E, Robinson RG, Kosier JT. Improved recovery in activities of daily living associated with remission of poststroke depression. Stroke. 2001;32:113–117. doi: 10.1161/01.str.32.1.113. [DOI] [PubMed] [Google Scholar]
- 2.Osteråker AL, Levi R. Indicators of psychological distress in postacute spinal cord injured individuals. Spinal Cord. 2005;43:223–229. doi: 10.1038/sj.sc.3101703. [DOI] [PubMed] [Google Scholar]
- 3.Saxena SK, Ng TP, Koh G, Yong D, Fong NP. Is improvement in impaired cognition and depressive symptoms in post-stroke patients associated with recovery in activities of daily living? Acta Neurol Scand. 2007;115:339–346. doi: 10.1111/j.1600-0404.2006.00751.x. [DOI] [PubMed] [Google Scholar]
- 4.Graves DE, Bombardier CH. Improving the efficiency of screening for major depression in people with spinal cord injury. J Spinal Cord Med. 2008;31:177–184. doi: 10.1080/10790268.2008.11760709. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Sasaki S, Isa T, Pettersson LG, Alstermark B, Naito K, et al. Dexterous finger movements in primate without monosynaptic corticomotoneuronal excitation. J Neurophysiol. 2004;92:3142–3147. doi: 10.1152/jn.00342.2004. [DOI] [PubMed] [Google Scholar]
- 6.Nishimura Y, Onoe H, Morichika Y, Perfiliev S, Tsukada H, et al. Time-depent central compensatory mechanisms of finger dexterity after spinal cord injury. Science. 2007;318:1150–1155. doi: 10.1126/science.1147243. [DOI] [PubMed] [Google Scholar]
- 7.Nishimura Y, Isa T. Compensatory changes at the cerebral cortical level after spinal cord injury. Neuroscientist. 2009;15:436–444. doi: 10.1177/1073858408331375. [DOI] [PubMed] [Google Scholar]
- 8.Nishimura Y, Morichika Y, Isa T. A subcortical oscillatory network contributes to recovery of hand dexterity after spinal cord injury. 2009;132:709–721. doi: 10.1093/brain/awn338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Higo N, Nishimura Y, Murata Y, Oishi T, Yoshino-Saito K, et al. Increased expression of the growth-associated protein 43 gene in the sensorimotor cortex of the macaque monkey after lesioning the lateral corticospinal tract. J Comp Neurol. 2009;516:493–506. doi: 10.1002/cne.22121. [DOI] [PubMed] [Google Scholar]
- 10.Nishimura Y, Isa T. Cortical and subcortical compensatory mechanisms after spinal cord injury in monkeys. Exp Neurol. 2011 doi: 10.1016/j.expneurol.2011.08.013. Epub ahead of print. [DOI] [PubMed] [Google Scholar]
- 11.Lemon RN, Griffiths J. Comparing the function of the corticospinal system in different species: organizational differences for motor specialization? Muscle Nerve. 2005;32:261–279. doi: 10.1002/mus.20333. [DOI] [PubMed] [Google Scholar]
- 12.Courtine G, Bunge MB, Fawcett JW, Grossman RG, Kaas JH, et al. Can experiments in nonhuman primates expedite the translation of treatments for spinal cord injury in humans? Nat Med. 2007;13:561–566. doi: 10.1038/nm1595. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Horwitz B. Simulating functional interactions in the brain: a model for examining correlations between regional cerebral metabolic rates. Int J Biomed Comput. 1990;26:149–170. doi: 10.1016/0020-7101(90)90039-w. [DOI] [PubMed] [Google Scholar]
- 14.Horwitz B. Functional interactions in the brain: use of correlations between regional metabolic rates. J Cereb Blood Flow Metab. 1991;11:114–120. doi: 10.1038/jcbfm.1991.46. [DOI] [PubMed] [Google Scholar]
- 15.Nauta WJ, Domesick VB. Afferent and efferent relationships of the basal ganglia. Ciba Found Symp. 1984;107:3–29. doi: 10.1002/9780470720882.ch2. [DOI] [PubMed] [Google Scholar]
- 16.Pascual-Leone A, Rubio B, Pallardo F, Catala MD. Rapid-rate transcranial magnetic stimulation of left dorsolateral prefrontal cortex in drug-resistant depression. Lancet. 1996;348:233–237. doi: 10.1016/s0140-6736(96)01219-6. [DOI] [PubMed] [Google Scholar]
- 17.George MS, Wassermann EM, Kimbrell TA, Little JT, Williams WE, et al. Mood improvement following left daily prefrontal repetitive transcranial magnetic stimulation in patients with depression: A placebo-controlled crossover trial. Ann J Psychiatry. 1997;154:1752–1756. doi: 10.1176/ajp.154.12.1752. [DOI] [PubMed] [Google Scholar]
- 18.Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 2001;12:3683–3687. doi: 10.1097/00001756-200112040-00016. [DOI] [PubMed] [Google Scholar]
- 19.Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D. A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage. 2003;18:263–272. doi: 10.1016/s1053-8119(02)00057-5. [DOI] [PubMed] [Google Scholar]
- 20.Berman RM, Narasimhan M, Sanacora G, Miano AP, Hoffman RE, et al. A randomized clinical trial of repetitive transcranial magnetic stimulation in the treatment of major depression. Biol Psychiatry. 2000;47:332–337. doi: 10.1016/s0006-3223(99)00243-7. [DOI] [PubMed] [Google Scholar]
- 21.Schultz W. Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioral ecology. Curr Opin Neurobiol. 2004;14:139–147. doi: 10.1016/j.conb.2004.03.017. [DOI] [PubMed] [Google Scholar]
- 22.Doyon WM, Anders SK, Ramachandra VS, Czachowski CL, Gonzales RA. Effect of operant self-administration of 10% ethanol plus 10% sucrose on dopamine and ethanol concentrations in the nucleus accumbens. J Neurochem. 2005;93:1469–1481. doi: 10.1111/j.1471-4159.2005.03137.x. [DOI] [PubMed] [Google Scholar]
- 23.Tremblay LK, Naranjo CA, Graham SJ, Herrmann N, Mayberg HS, et al. Functional neuroanatomical substrates of altered reward processing in major depressive disorder revealed by a dopaminergic probe. Arch Gen Psychiatry. 2005;62:1228–1236. doi: 10.1001/archpsyc.62.11.1228. [DOI] [PubMed] [Google Scholar]
- 24.Juckel G, Schlagenhauf F, Koslowski M, Filonov D, Wüstenberg T, et al. Dysfunction of ventral striatal reward prediction in schizophrenic patients treated with typical, not atypical, neuroleptics. Psychopharmacology (Berl) 2006;187:222–228. doi: 10.1007/s00213-006-0405-4. [DOI] [PubMed] [Google Scholar]
- 25.Kobayashi Y, Okada K. Reward prediction error computation in the pedunculopontine tegmental nucleus neurons. Ann NY Acad Sci. 2007;1104:310–323. doi: 10.1196/annals.1390.003. [DOI] [PubMed] [Google Scholar]
- 26.Schlaepfer TE, Cohen MX, Frick C, Kosel M, Brodesser D, et al. Deep Brain Stimulation to Reward Circuitry Alleviates Anhedonia in Refractory Major Depression. Neuropsychopharmacology. 2008;33:368–377. doi: 10.1038/sj.npp.1301408. [DOI] [PubMed] [Google Scholar]
- 27.Walton ME, Bannerman DM, Rushworth MF. The role of rat medial frontal cortex in effort-based decision making. J Neurosci. 2002;22:10996–11003. doi: 10.1523/JNEUROSCI.22-24-10996.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Walton ME, Bannerman DM, Alterescu K, Rushworth MF. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J Neurosci. 2003;23:6475–6479. doi: 10.1523/JNEUROSCI.23-16-06475.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Miyachi S, Lu X, Imanishi M, Sawada K, Nambu A, et al. Somatotopically arranged inputs from putamen and subthalamic nucleus to primary motor cortex. Neurosci. Res. 2006;56:300–308. doi: 10.1016/j.neures.2006.07.012. [DOI] [PubMed] [Google Scholar]
- 30.Ohnishi T, Hayashi T, Okabe S, Nonaka I, Matsuda H, et al. Endogenous dopamine release induced by repetitive transcranial magnetic stimulation over the primary motor cortex: an [11C]raclopride positron emission tomography study in anesthetized macaque monkeys. Biol Psychiatry. 2004;55:484–489. doi: 10.1016/j.biopsych.2003.09.016. [DOI] [PubMed] [Google Scholar]
- 31.Matsumoto N, Hanakawa T, Maki S, Graybiel AM, Kimura M. Nigrostriatal Dopamine System in Learning to Perform Sequential Motor Tasks in a Predictive Manner. J Neurophysiol. 1999;82:978–998. doi: 10.1152/jn.1999.82.2.978. [DOI] [PubMed] [Google Scholar]
- 32.Teulings HL, Contreras-Vidal JL, Stelmach GE, Adler CH. Adaptation of handwriting size under distorted visual feedback in patients with Parkinson's disease and elderly and young controls. J Neurol Neurosurg Psychiatry. 2002;72:315–324. doi: 10.1136/jnnp.72.3.315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Paquet F, Bedard MA, Levesque M, Tremblay PL, Lemay M, et al. Sensorimotor adaptation in Parkinson's disease: evidence for a dopamine dependent remapping disturbance. Exp Brain Res. 2008;185:227–236. doi: 10.1007/s00221-007-1147-1. [DOI] [PubMed] [Google Scholar]
- 34.Nishimura Y, Onoe H, Morichika Y, Tsukada H, Isa T. Activation of parieto-frontal stream during reaching and grasping studied by positron emission tomography in monkeys. Neurosci Res. 2007;59:243–250. doi: 10.1016/j.neures.2007.07.003. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.