Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2013 Jul 15.
Published in final edited form as: Biol Psychiatry. 2012 Mar 20;72(2):101–106. doi: 10.1016/j.biopsych.2012.02.017

Mechanistic Classification of Neural Circuit Dysfunctions: Insights from Neuroeconomics Research in Animals

Steve W C Chang 1,2, David L Barack 2,3, Michael L Platt 1,2,4,5,*
PMCID: PMC3383404  NIHMSID: NIHMS361146  PMID: 22440615

Abstract

Many psychiatric conditions present complex behavioral symptoms, and the type and magnitude of underlying neural dysfunction may vary drastically. This review introduces a classification scheme for psychiatric symptoms describing them in terms of the state of a dysfunctional neural circuit. We provide examples of two kinds of functional deficits: variance-shifted functionality, in which a damaged circuit continues to function albeit suboptimally, and state-shifted functionality, resulting in an absent or qualitatively different functional state. We discuss, from the perspective of neuroeconomics and related areas of behavioral investigation, three broad classes of commonly occurring symptoms in psychopathology based on selected studies of decision-making in animals: temporal discounting, social preferences, and decision-making under environmental volatility. We conclude that the proposed mechanistic categorization scheme offers promise for understanding neural circuit dysfunctions underlying psychopathology.

Keywords: Neuroeconomics, Variance Shifted, State Shifted, Suboptimal, Electronic Circuit, Animals, Psychopathology, Reward, Decision

Introduction

Comprised of constellations of behavioral symptoms, psychiatric disorders frequently frustrate any simple attempt to translate observed phenotype into neurobiological mechanism. Even at the individual symptom level, such translation is challenging and not easily quantifiable. Behavioral symptoms are often compound and thus difficult to interpret. This presents a challenge for understanding their core neurobiological features, creating practical barriers to designing behavioral or diagnostic tests. This difficulty may be amplified when studying the illnesses manifested as a result of dysfunctions in the prefrontal, limbic, and paralimbic regions, which are less well-understood, compared to, for example, the occipital cortex. A promising alternative to understanding the neurobiology of psychiatric disorders begins by classifying them according to the ways the underlying mechanisms may fail. In this issue exploring the benefits of a neuroeconomics approach for understanding psychopathology, we outline a mechanistic classification scheme grounded in the principles of neuroeconomic studies of cognition and behavior in animals.

Variance-shifted versus state-shifted functionality: Insights from electronics

Dysfunctional neural circuitry can be functionally classified into two different states based on the outputs of disrupted circuits. As an illustration, consider an electronic circuit designed to produce a specific output. A variance-shifted circuit operates with added noise and, therefore, generates a broadened output distribution, resulting in suboptimal performance. However, a suboptimal circuit may continue to process information (1). By contrast, a state-shifted circuit may generate a completely different functional output, either beyond the expectation of a downstream circuit or failing to generate any output at all, producing a qualitatively different or absent output and resulting in behavior drawn from a different distribution altogether (1).

As a simplified analogy, a simple band-pass filter illustrates the different classes of damage-induced functional states. A change to circuit resistance or capacitance will change the effective cut-off frequency, while a short in the system effectively halts filtering (1). Changes in a circuit’s resistance will result in a noisier output, analogous to psychiatric conditions in which afflicted individuals show difficulty in evaluating changes in the environment. Such damage to the circuit reveals its critical role for producing adaptive, normal behavior. In contrast, the presence of a short in the system will prevent filtering of relevant information, analogous to situations where afflicted individuals completely lose sensitivity to changes in the environment. In this case, the state-shifted circuit reveals its necessary role in the production of a particular behavior.

The intricate balance between circuit components can result in functional changes that are either large and noticeable or small and subtle. Some neuropsychiatric symptoms only differ from others slightly, whereas others are so specific to a condition that they serve as a diagnostic hallmark. Furthermore, because of the complex and multilayered nature of neural circuits, initial perturbations may result at first in a state-shifted circuit that, due to neural plasticity, resolves back to a variance-shifted, or even fully restored, state. In summary, psychiatric symptoms may result from a relatively preserved neural circuit operating with added noise, producing deviant and suboptimal behavior (variance-shifted functionality). Alternatively, it may arise from a shorted circuit producing completely different or absent behaviors (state-shifted functionality).

The two damaged states can be described in terms of neural network models as well. In a trained neural network, the organizational principles involve individual computational units, or nodes, whose functionalities may be obscure and may encode information idiosyncratically (2, 3). A variance-shifted functional state may result from damage to peripheral nodes, whereas a state-shifted state may be induced by damage to a central node in the network. The two functionalities can also be described based on the output statistics of an implicated circuit. A variance-shifted dysfunction in a neural circuit may produce circuit (or behavioral) outputs characterized by a broadened and/or attenuated distribution compared to optimal functionality (thus less specific or more noisy). In contrast, a state-shifted dysfunction in a circuit may produce an output drawn from a completely different distribution (thus qualitatively different), or may result in a complete failure to produce any output. It is worthwhile to note that a state-shift could occur in the direction of extreme enhancement, resulting in exaggerated behavior such as positive symptoms in schizophrenia.

Our classification scheme, though neither exceptionless nor exhaustive, provides insight into the possible mechanisms underlying psychiatric symptoms. The two deficit types may occur simultaneously or sequentially (and the distinction sometimes can be ambiguous until a given circuit is fully understood), but may provide novel mechanistic insights into psychopathology and inform the relationship of pathology to health. This approach differs fundamentally from the DSM (Diagnostic and Statistical Manual), ICD (International Classification of Disease) and the like, which are designed to describe a disorder using a list of behavioral symptoms for diagnostic purposes. The present scheme is useful for directly comparing the functionality of neural mechanisms and their corresponding behaviors across normal and dysfunctional states of the brain. A successful distinction between variance- and state-shifted dysfunction is constrained by our understanding of a given circuit. For example, a variance-shifted dysfunction under one functional criterion could be seen as a state-shifted condition under a different framework. Such ambiguity, which is present in any classification scheme, can only be resolved through more comprehensive understanding of a circuit.

Examples from oculomotor neurophysiology

Examples from oculomotor neurophysiology help illustrate the two distinct dysfunctional states described above. The superior colliculus (SC) and frontal eye fields (FEF) belong to a distributed oculomotor circuit spanning cortical and subcortical structures (4, 5). FEF lesions increase variability in saccade trajectories and severely disrupt selection of targets in the contralesional hemifield (6). FEF lesioned animals, however, can still saccade (6). By contrast, SC lesions temporarily abolish contralesional saccades altogether (7). It also permanently increase saccade latencies and eliminate the animal’s ability to make express saccades (saccades with reaction times less than 100 msec in monkeys) in a gap task (7), designed to bypass the time required to disengage from visual fixation by inserting a “gap” between the offset of a fixation stimulus and target onset (8). Therefore, for saccades, FEF disruption results in noisy (i.e., variable) performance but preserves overall functionality, a variance-shifted dysfunction. SC damage alone, by contrast, is sufficient to temporarily abolish saccades, which is consistent with a state-shifted dysfunction. These examples demonstrate that distinct mechanistic deficits can impair or abolish normal function.

Neuroeconomics of decision-making in animals

Neuroeconomics, a discipline that marries the mathematical formalisms of classical economics, the psychophysical methods of behavioral economics, and contemporary neurosciences (911), provides an illuminating test of the functionality-based classification scheme for defining mechanistic pathologies in decision-making. (For a review regarding the benefits of animal models in neuroeconomics, see 12.) The approach applies mathematically-tractable economic formalizations to the nervous system, and focuses on basic economic concepts such as utility (9, 1315), risk (16, 17), and temporal discounting (18, 19), providing quantitative frameworks for examining the neural mechanisms underlying cognitive processes (12).

The neuroeconomic framework in animal models is advantageous for studying complex forms of decision-making by tapping into their innate reward-seeking behaviors while maintaining ethological validity. Unlike in humans, animal models offer access to studying complex behaviors at the resolution of single neurons. Further, insights into different types of mechanistic deficits in neuropsychiatric symptoms can be obtained by studying decisions animals make following perturbation of neural circuits. Thus, animal models of decision-making provide valuable insights into characterizing the biological mechanisms of behavior, detailing the formal operations the brain performs in realizing different cognitive capacities.

We discuss a selection of experiments, categorizing the observed deficits as the variance-shifted and state-shifted model of neural circuit dysfunctions. We organize this discussion around three examples of circuit dysfunction in light of neuroeconomics and other related disciplines: disorders of temporal discounting in addiction, social and other regarding preferences, and decision-making under environmental volatility. Our intention is not to establish necessary and sufficient conditions for connecting a specific dysfunction and a specific neural circuit. Doing so would not be practically possible. Instead, in this exercise, we attempt to label experimentally-induced behavioral deficits observed in animals as dysfunctions arising from either a variance- or state-shifted functional state in the implicated circuit. Although this classification scheme can be just as easily applied to any perturbation results (e.g., microstimulation or drug infusion), we focus on lesion studies for their blunt effectiveness in perturbing circuit function.

Addiction as a disorder of temporal discounting

Single-unit recordings in animals, as well as neuroimaging in humans, have found that striatal dopaminergic signaling is critical for reward-related processing, including motivation and learning (2022), and that dysfunctional dopaminergic signaling disrupts reward anticipation in drug addiction (for a review, see 2325). Firing rates of midbrain dopamine neurons compute economic decision parameters, such as reward probability, reward delay, and reward uncertainty (2628). Dopaminergic signaling is also involved in evaluating the economic costs and benefits of upcoming rewards. For example, neurons in rodent nucleus accumbens (NAc) encode anticipated reward benefits, without encoding response costs to achieve the reward (28). Such economic computations by the mesolimbic dopamine system may contribute to addiction and other motivation-related disorders.

Temporal discounting describes a time-dependent devaluation of economic value (18). It is a phenomenon observed across multiple species including rodents, monkeys, and humans (18, 29, 30). When provided an option to choose an immediate but smaller reward over a larger reward with a longer delay, animals reliably prefer the immediate option (31). Addicted individuals discount more than non-addicted individuals (24, 32), as evidenced by behaviors manifested in addiction to cocaine, alcohol, opioid, nicotine, and gambling (for a review, see 32). Therefore, a disruption in temporal discounting may be a common mechanistic deficit shared by many classes of addiction.

Single-unit recordings in monkeys demonstrate that neurons in the striatum mediate computations underlying temporal discounting (33). Rats with NAc lesions display severe difficulty in choosing a delayed reward option in an inter-temporal choice task, suggesting a critical role of NAc in computing economic values of rewards in time (34). Further, NAc lesions do not abolish reward sensitivity altogether, but impair the implementation of an optimal (reward-maximizing) strategy (35), as if these animals cannot accurately compute temporally discounted utility to guide decisions. Similarly, addicted individuals rarely lose the ability to seek addicted substances. Rather, they display impaired impulsive control in pursuing immediate rewards, consistent with atypical temporal discounting. Thus, addiction related deficits resemble a variance-shifted functionality, resulting in disrupted decisions in time, though retaining some sensitivity to reward (i.e., performance does not become random, and the discounting function does not become flat). Deficits resulting from perturbations to dopamine circuits performing economic calculations seem to cause noisy mappings, or variance shifts in the representations, among reward, action, and time.

Neural correlates of temporal discounting are also found in the prefrontal cortex (for a review, see 36). Neurons in dorsolateral prefrontal cortex (dlPFC) encode the temporally discounted value of upcoming rewards (19). A cocaine self-administration study in monkeys found that activity in the anterior cingulate cortex (ACC) is enhanced upon cocaine intake (37), consistent with human neuroimaging studies showing that drug-seeking in addiction are linked to the prefrontal cortex (38, 39). ACC involvement in reward-guided decision-making is not limited to processing directly-experienced outcomes, but also includes fictive outcomes (40), similar to the human ventral striatum (41). Correctly utilizing such fictive signals may be critical in addiction. Individuals with chronic nicotine addiction fail to utilize these signals to adjust their choices in an investment task (42). Furthermore, gambling addiction seems to require rewards that are delivered according to a partial or a variable schedule (43), coupled with “near-miss” fictive reward signals.

Disorders of social and other-regarding preferences

Precisely how social information is integrated into economic decisions in neural circuits remains obscure. Understanding whether social disorders are manifested by a deficit in a decision circuit or a circuit purely involved in evaluating social information from the environment remains a challenge. Other-regarding preferences (ORP) describe a consideration for the economic well-being of others. ORP computation may reflect a stage where decision-making and social information processing is partially integrated. Consider autism spectrum disorder (ASD), which handicaps social and communicative abilities of ~1/110 children in the United States (44). ASD individuals show little interest in others (45). This lack of interest is associated with other complex social deficits, including reduced empathy and joint attention, thus further disrupting the capacity for normal social interactions (46, 47). Differences between ASD and typically developing individuals are illustrated by performance in economic bargaining games designed to elicit ORP. While healthy individuals readily engage in reciprocal cooperation in these games, ASD individuals adopt simple rules which are both less flexible and more laboriously employed (48). It remains unclear whether circuit dysfunctions in ASD more closely resemble variance-shifted or state-shifted states. Comparison with other disorders marked by social deficits, such as schizophrenia, psychopathy and eating disorders, may help to illuminate the underlying pathology in ASD.

ACC is critical for social processing. ACC gyrus lesions in monkeys abolish the animal’s ability to evaluate social information, as measured by response latencies to retrieve food in the presence of socially arousing images, such as staring monkeys (49). Although the changes in response latencies in ACC-lesioned animals can differ substantially depending on the types of social stimuli and often on the individuals, sensitivity to social stimuli can be eliminated by the lesion (49). This social evaluation deficit therefore resembles a state-shifted functionality, in which social evaluation processing is no longer intact. In contrast, ACC sulcus and OFC lesions produce deviant behaviors, but fail to abolish the sensitivity to social stimuli (49), resembling a noisy suboptimal state and a variance-shifted functionality.

Closely related to ORP, empathy-related processing by ACC has been investigated in the context of perceiving painful events of others. The brain areas involved in pain perception in humans, namely ACC and frontal insula, are more metabolically active when perceiving a painful stimulus delivered to fair compared to unfair players in an economic game (50). In rodents, ACC, along with other medial pain systems, mediates observational fear conditioning while watching a conspecific receive a shock (51). Both lidocaine-induced inactivation and targeted deletion of a voltage-gated calcium channels in ACC can substantially reduce observational fear conditioning, but not eliminate it (51). A dysfunction in empathy-related processing in ACC might be driven by variance-shifted dysfunctional states, resulting in degraded sensitivities to process or simulate the painful events of others.

A link between ORP and emotional processing remains elusive. Amygdala is one of the primary structures linked to emotional processing, and is reciprocally connected to ACC and OFC (52, 53). Amygdala dysfunction is related to a number of psychiatric symptoms, including major depression and bipolar disorder, and affective psychosis in schizophrenia (54). Typically, amygdala contribution to emotional processing has been investigated using fear-inducing or social stimuli. Monkeys with bilateral amygdala lesions show abolished fear responses, as measured by response latencies to retrieve food in the presence of a fearful stimulus (52, 55). Consistent with these observations, amygdala-lesioned rats completely lose the ability to acquire conditioned fear, even when the lesion occurs a month after the initial Pavlovian training, suggesting a necessary role in emotional memory (56, 57) (i.e., state-shifted due to an absent distribution). Notably, in many psychiatric conditions involving emotion, the gain on emotional processing in amygdala might be set too high, possibly due to impaired communication with other structures, such as prefrontal cortex, that modulate amygdala activity (58). Such unregulated emotional processing might lead to exaggerated behavior, presumably due to a state-shift. For example, this state-shift might result in a more responsive and less regulated state. The reciprocal information transmission among the amygdala, ACC, and OFC (52, 53) suggest that the emotional component of ORP may originate from the amygdala.

Disorders of decision-making under environmental volatility

Several neurological and psychiatric disorders compromise the adaptive abilities of cognitive systems, whether updating the expected values of targets according to task demands or appropriately reorienting to reflect changes in the environment. Notably, some cognitive deficits such as inflexibility to adapt to environmental changes are shared across multiple neurological and psychiatric conditions. For example, degeneration of mechanisms that contribute to adaptive decision-making, including task set switching, task set maintenance, and inhibitory control, characterizes cognitive and executive deficits in schizophrenia (59, 60). From a neuroeconomic perspective, these may emerge from failures in updating reward valuation, risk, and volatility. In the Wisconsin card sorting task (WCST), typically used to probe the ability to adjust to changing environments without explicit cues, participants sort a deck of cards according to unpredictably changing rules (61). During the task, schizophrenic patients perseverate more on choosing incorrect responses, persisting longer with a previous rule despite negative feedback (62). These individuals also show increased response times and make more errors in the Stroop task (6367).

Schizophrenia is accompanied by both negative symptoms, such as lack of emotion, and positive symptoms, such as hallucinations and delusions (68). In addition, schizophrenia is associated with deficits in executive and cognitive functions (68). Such deficits include inflexible adjustments in behavioral strategies, or policies, which require computing expected value of reinforcers on the basis of the accumulation of evidence over time, assessment of value on the basis of reinforcer identity, and projecting these evaluations into the future (69). Schizophrenic patients also show decreased abilities to stay on task (70, 71). Deficits related to executive control are suggested to be caused by noisy dopaminergic gating of prefrontal neurons (70). Symptoms in the domain of executive control may thus reflect variance-shifted processing. Positive and negative symptoms, on the other hand, are associated with exaggerated (e.g., hallucinations) and abolished (e.g., lack of emotion) processing, respectively, and thus are more consistent with a state-shifted condition.

In schizophrenia, the posterior cingulate cortex (PCC) is associated with increased default network connectivity, with the degree of enhanced connectivity positively correlating with the severity of psychopathology, and these patients show increased cannabinoid receptor expression (mediating inhibitory neurotransmitters like GABA) (72, 73). A case study of lesions in the human PCC found an inability to adapt to new environments (74). Consistent with this, neuronal activity in monkey PCC tracks the level of risk in changing environments (17) and is correlated with setting a behavioral strategy to explore or exploit different options (75, 76). Thus, disruptions to PCC seem to compromise an ability to detect and incorporate discontinuities in environmental statistics such as changes in expected value and risk. It remains unclear whether volatility-related deficits in PCC lesions reflect variance- or state-shifted functionalities.

An explicit task-switching paradigm, in which a correct response on a given trial or group of successive trials is explicitly cued, is often used to investigate executive control. In such a task, neurons in ACC increase responses following task switches (77), suggesting sensitivity to changes in reward information used in executive control. Lesions to ACC gyrus increase the frequency of consecutive errors, whereas more comprehensive lesions in ACC (gyrus and sulcus) result in slowed response times, errors in switching, and greater overall consecutive errors (78). Critically, although ACC lesions increase switch-related errors, monkeys are still able to switch tasks above the chance level, suggesting the mechanisms responsible for cognitive flexibility are not completely abolished (78). These results implicate a variance-shifted deficit inducing suboptimality in the ability to adapt to changing environments by explicit changes in the expected values of the targets.

Perseveration of maladaptive behavior is one of the most striking features of prefrontal lesions. Such deficits are apparent in environments without explicit rule-changing cues. In WCST, patients with dlPFC lesions fail to switch to a correct response and instead perseverate on an incorrect response (79). Indeed, schizophrenia is associated with inefficient dlPFC function, particularly with respect to working memory (80). Activity of dlPFC neurons in monkeys is correlated with the level of conflict in WCST (81) and different strategies employed within the task (82, 83). In a WCST analog, lesions to monkey OFC, ACC, or dlPFC in and around the principal sulcus (but not superior and medial to the sulcus) all result in fewer uncued rule-guided behavioral shifts, though the animals still execute switches, indicating variance-shifted, as opposed to fully state-shifted, dysfunction (84). In contrast, dlPFC-lesioned animals no longer show a stereotypical increase in response times as a function of conflict, an abolition of conflict-induced changes in motor responses (81), consistent with the full destruction of conflict-detection mechanisms in dlPFC (state-shifted). Conflict detection and resolution in these tasks may map onto running calculations of instantaneous utility and uncertainty, though this remains a topic of ongoing debate. By perturbing circuits that detect conflict or encode strategy, dlPFC damage leads to a computational deficiency in value updating for flexible environmental adaptation.

Concluding Remarks

We are just beginning to understand what constitutes a psychiatric disease. Neuroeconomic studies in animals provide new insights into the affected neural circuits (85). Our proposed classification scheme establishes a new framework for thinking about psychiatric disorders formulated in the language of neural circuits. It remains to be seen how the circuit-based classification could augment the existing typological schemes to help assess and treat psychiatric disorders. As a first step, we have focused on deficits tied to specific breakdowns in selected neural circuits. Some deficits are shared and thus might appear in multiple classically defined illnesses. Our interpretation is intended to point out that what superficially might appear to be very different syndromes may in fact share common disruptions in the underlying neural circuitry.

Psychopathological symptoms can be approached based on the precise type of deficits induced in neural circuits. A neural circuit will show different outputs depending on the affected circuit components. A noisy state broadens the width of the output distribution, leading to suboptimal performance, but may not alter the basic functionality of a given circuit. In contrast, a circuit could break down or be extensively modified, introducing a new state into the system with abnormal or absent functionalities that are qualitatively different from the norm.

Most psychiatric disorders present compound symptoms. It is not surprising then that a single psychiatric illness arises from a combination of variance-shifted and state-shifted circuit dysfunctions, involving multiple brain areas. For example, under a connectionist neural network framework, variance-shifted dysfunctions may result from damages to peripheral processing nodes. When the most critical region of the distributed network is disrupted, however, we may observe a fully compromised, state-shifted dysfunction instead (though the deficits may eventually be restored by other areas in the network on a much longer time scale). Note that there are clear cases of state-shifted psychopathology when the deficits are not due to targeted traumatic brain injury. For example, in visual or auditory hallucinations, commonly found with severe schizophrenia, individuals experience percepts in the absence of actual sensory signals. The circuits that mediate these experiences are clearly behaving very differently, and seem likely to be induced by a state-shifted process.

Our circuit-based scheme may be relevant for the ongoing debate in psychiatry over the need for incorporating dimensional diagnosis to traditional categorical diagnosis (8690). The variance- and state-shifted models effectively re-describe such dimensional criteria at the level of neural circuits. For example, the severity or idiosyncrasy of a given symptom for a given individual could be linked to either the degree of variance shift (e.g., the magnitude of change in sigma of the distribution) or the degree of state shifts (e.g., the magnitude of mean shifts in the distribution) in behavioral or cognitive output according to the proposed scheme. Translating psychiatric symptoms into dimensional outcomes of neural circuit dysfunction may open up new avenues for improved therapeutic intervention.

The circuit-based classification does not describe a relationship between implicated circuits and psychiatric disorder types. Our classification scheme, which critically depends on our understanding of the functionality of a given circuit, is not intended to replace existing typologies of psychopathology. Rather, it describes a mechanistic relationship between implicated circuits and behavioral deficits caused by failures of those circuits. In our view, the current scheme can provide easily quantifiable grounds for hypothesis testing for linking a circuit-level dysfunction and an afflicted behavior (e.g., Supplement 1) and thus may provide novel insights into the mechanistic dysfunctions underlying psychiatric conditions.

Supplementary Material

01

Acknowledgments

We are grateful to Nancy L. Zucker and Geoffrey K. Adams for helpful feedback. This work is supported by N.I.H. 5T32NS051156-07 (S.W.C.C.), N.I.M.H. 5R01MH086712-03 (D.L.B. and M.L.P.), and D.O.D. AR100035 (S.W.C.C. and M.L.P.).

Footnotes

Financial Disclosures

All authors declare no biomedical financial interests or potential conflicts of interest.

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

References

  • 1.Horowitz P, Hill W. The art of electronics. 2. Cambridge England; New York: Cambridge University Press; 1989. [Google Scholar]
  • 2.Poggio T, Edelman S. A network that learns to recognize three-dimensional objects. Nature. 1990;343:263–266. doi: 10.1038/343263a0. [DOI] [PubMed] [Google Scholar]
  • 3.Poggio T. A theory of how the brain might work. Cold Spring Harb Symp Quant Biol. 1990;55:899–910. doi: 10.1101/sqb.1990.055.01.084. [DOI] [PubMed] [Google Scholar]
  • 4.Corbetta M, Akbudak E, Conturo TE, Snyder AZ, Ollinger JM, Drury HA, et al. A common network of functional areas for attention and eye movements. Neuron. 1998;21:761–773. doi: 10.1016/s0896-6273(00)80593-0. [DOI] [PubMed] [Google Scholar]
  • 5.Ferraina S, Pare M, Wurtz RH. Comparison of cortico-cortical and cortico-collicular signals for the generation of saccadic eye movements. J Neurophysiol. 2002;87:845–858. doi: 10.1152/jn.00317.2001. [DOI] [PubMed] [Google Scholar]
  • 6.Schiller PH, Chou IH. The effects of frontal eye field and dorsomedial frontal cortex lesions on visually guided eye movements. Nature Neuroscience. 1998;1:248–253. doi: 10.1038/693. [DOI] [PubMed] [Google Scholar]
  • 7.Schiller PH, Sandell JH, Maunsell JH. The effect of frontal eye field and superior colliculus lesions on saccadic latencies in the rhesus monkey. J Neurophysiol. 1987;57:1033–1049. doi: 10.1152/jn.1987.57.4.1033. [DOI] [PubMed] [Google Scholar]
  • 8.Pare M, Munoz DP. Saccadic reaction time in the monkey: advanced preparation of oculomotor programs is primarily responsible for express saccade occurrence. Journal of Neurophysiology. 1996;76:3666–3681. doi: 10.1152/jn.1996.76.6.3666. [DOI] [PubMed] [Google Scholar]
  • 9.Glimcher PW. Neuroeconomics: decision making and the brain. 1. London; San Diego, CA: Academic Press; 2009. [Google Scholar]
  • 10.Loewenstein G, Rick S, Cohen JD. Neuroeconomics. Annual review of psychology. 2008;59:647–672. doi: 10.1146/annurev.psych.59.103006.093710. [DOI] [PubMed] [Google Scholar]
  • 11.Camerer CF. Neuroeconomics: opening the gray box. Neuron. 2008;60:416–419. doi: 10.1016/j.neuron.2008.10.027. [DOI] [PubMed] [Google Scholar]
  • 12.van Wingerden M, Kalenscher T. Why We Should Use Animals to Study Economic Decision Making – A Perspective. Frontiers in Neuroscience. 2011;5 doi: 10.3389/fnins.2011.00082. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Platt ML, Glimcher PW. Neural correlates of decision variables in parietal cortex. Nature. 1999;400:233–238. doi: 10.1038/22268. [DOI] [PubMed] [Google Scholar]
  • 14.Montague PR, Berns GS. Neural economics and the biological substrates of valuation. Neuron. 2002;36:265–284. doi: 10.1016/s0896-6273(02)00974-1. [DOI] [PubMed] [Google Scholar]
  • 15.Kable JW, Glimcher PW. The neural correlates of subjective value during intertemporal choice. Nature Neuroscience. 2007;10:1625–1633. doi: 10.1038/nn2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Platt ML, Huettel SA. Risky business: the neuroeconomics of decision making under uncertainty. Nat Neurosci. 2008;11:398–403. doi: 10.1038/nn2062. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.McCoy AN, Platt ML. Risk-sensitive neurons in macaque posterior cingulate cortex. Nat Neurosci. 2005;8:1220–1227. doi: 10.1038/nn1523. [DOI] [PubMed] [Google Scholar]
  • 18.Green L, Myerson J. A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin. 2004;130:769–792. doi: 10.1037/0033-2909.130.5.769. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kim S, Hwang J, Lee D. Prefrontal coding of temporally discounted values during intertemporal choice. Neuron. 2008;59:161–172. doi: 10.1016/j.neuron.2008.05.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997;275:1593–1599. doi: 10.1126/science.275.5306.1593. [DOI] [PubMed] [Google Scholar]
  • 21.Montague PR, Hyman SE, Cohen JD. Computational roles for dopamine in behavioural control. Nature. 2004;431:760–767. doi: 10.1038/nature03015. [DOI] [PubMed] [Google Scholar]
  • 22.McLaren I. The computational unit as an assembly of neurones: an implementation of an error correcting learning algorithm. In: Durbin R, Miall C, Mitchison G, editors. The Computing Neuron. Amsterdam: Addison-Wesley; 1989. pp. 160–178. [Google Scholar]
  • 23.Hyman SE, Malenka RC, Nestler EJ. Neural mechanisms of addiction: the role of reward-related learning and memory. Annu Rev Neurosci. 2006;29:565–598. doi: 10.1146/annurev.neuro.29.051605.113009. [DOI] [PubMed] [Google Scholar]
  • 24.Schultz W. Potential vulnerabilities of neuronal reward, risk, and decision mechanisms to addictive drugs. Neuron. 2011;69:603–617. doi: 10.1016/j.neuron.2011.02.014. [DOI] [PubMed] [Google Scholar]
  • 25.Wise RA. Neurobiology of addiction. Current opinion in neurobiology. 1996;6:243–251. doi: 10.1016/s0959-4388(96)80079-1. [DOI] [PubMed] [Google Scholar]
  • 26.Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science. 2003;299:1898–1902. doi: 10.1126/science.1077349. [DOI] [PubMed] [Google Scholar]
  • 27.Morris G, Nevet A, Arkadir D, Vaadia E, Bergman H. Midbrain dopamine neurons encode decisions for future action. Nature Neuroscience. 2006;9:1057–1063. doi: 10.1038/nn1743. [DOI] [PubMed] [Google Scholar]
  • 28.Gan JO, Walton ME, Phillips PE. Dissociable cost and benefit encoding of future rewards by mesolimbic dopamine. Nature Neuroscience. 2010;13:25–27. doi: 10.1038/nn.2460. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hwang J, Kim S, Lee D. Temporal discounting and inter-temporal choice in rhesus monkeys. Front Behav Neurosci. 2009 doi: 10.3389/neuro.08.009.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Hayden BY, Platt ML. Temporal discounting predicts risk sensitivity in rhesus macaques. Curr Biol. 2007;17:49–53. doi: 10.1016/j.cub.2006.10.055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Myerson J, Green L. Discounting of delayed rewards: Models of individual choice. Journal of the experimental analysis of behavior. 1995;64:263–276. doi: 10.1901/jeab.1995.64-263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Bickel WK, Miller ML, Yi R, Kowal BP, Lindquist DM, Pitcock JA. Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. Drug and alcohol dependence. 2007;90(Suppl 1):S85–91. doi: 10.1016/j.drugalcdep.2006.09.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cai X, Kim S, Lee D. Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron. 2011;69:170–182. doi: 10.1016/j.neuron.2010.11.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science. 2001;292:2499–2501. doi: 10.1126/science.1060818. [DOI] [PubMed] [Google Scholar]
  • 35.Parkinson JA, Olmstead MC, Burns LH, Robbins TW, Everitt BJ. Dissociation in effects of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. The Journal of neuroscience: the official journal of the Society for Neuroscience. 1999;19:2401–2411. doi: 10.1523/JNEUROSCI.19-06-02401.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Kim S, Lee D. Prefrontal cortex and impulsive decision making. Biological psychiatry. 2011;69:1140–1146. doi: 10.1016/j.biopsych.2010.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Baeg EH, Jackson ME, Jedema HP, Bradberry CW. Orbitofrontal and anterior cingulate cortex neurons selectively process cocaine-associated environmental cues in the rhesus monkey. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2009;29:11619–11627. doi: 10.1523/JNEUROSCI.3206-09.2009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Garavan H, Pankiewicz J, Bloom A, Cho JK, Sperry L, Ross TJ, et al. Cue-induced cocaine craving: neuroanatomical specificity for drug users and drug stimuli. The American journal of psychiatry. 2000;157:1789–1798. doi: 10.1176/appi.ajp.157.11.1789. [DOI] [PubMed] [Google Scholar]
  • 39.Goldstein RZ, Alia-Klein N, Tomasi D, Carrillo JH, Maloney T, Woicik PA, et al. Anterior cingulate cortex hypoactivations to an emotionally salient task in cocaine addiction. P Natl Acad Sci USA. 2009;106:9453–9458. doi: 10.1073/pnas.0900491106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Hayden BY, Pearson JM, Platt ML. Fictive reward signals in the anterior cingulate cortex. Science. 2009;324:948–950. doi: 10.1126/science.1168488. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Lohrenz T, McCabe K, Camerer CF, Montague PR. Neural signature of fictive learning signals in a sequential investment task. Proc Natl Acad Sci U S A. 2007;104:9493–9498. doi: 10.1073/pnas.0608842104. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Chiu PH, Lohrenz TM, Montague PR. Smokers’ brains compute, but ignore, a fictive error signal in a sequential investment task. Nature Neuroscience. 2008;11:514–520. doi: 10.1038/nn2067. [DOI] [PubMed] [Google Scholar]
  • 43.Sharpe L, Tarrier N. Towards a cognitive-behavioural theory of problem gambling. The British journal of psychiatry: the journal of mental science. 1993;162:407–412. doi: 10.1192/bjp.162.3.407. [DOI] [PubMed] [Google Scholar]
  • 44.Rice C. Prevalence of autism spectrum disorders - Autism and Developmental Disabilities Monitoring Network, United States, 2006. MMWR Surveillance summaries: Morbidity and mortality weekly report Surveillance summaries/CDC. 2009;58:1–20. [PubMed] [Google Scholar]
  • 45.Kanner L. Autistic disturbances of affective contact. Nervous Child. 1943;2:217–250. [PubMed] [Google Scholar]
  • 46.Batson C, Duncan B, Ackerman P, Buckley T, Birch K. Is empathic emotion a source of altruistic motivation? Journal of Personality and Social Psychology. 1981;40:290–302. [Google Scholar]
  • 47.Goldman A. Ethics and cognitive science. Ethics. 1993;103:337–360. [Google Scholar]
  • 48.Sally D, Hill E. The development of interpersonal strategy: Autism, theory-of-mind, cooperation and fairness. Journal of Economic Psychology. 2006;27:73–97. [Google Scholar]
  • 49.Rudebeck PH, Buckley MJ, Walton ME, Rushworth MF. A role for the macaque anterior cingulate gyrus in social valuation. Science. 2006;313:1310–1312. doi: 10.1126/science.1128197. [DOI] [PubMed] [Google Scholar]
  • 50.Singer T, Seymour B, O’Doherty JP, Stephan KE, Dolan RJ, Frith CD. Empathic neural responses are modulated by the perceived fairness of others. Nature. 2006;439:466–469. doi: 10.1038/nature04271. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Jeon D, Kim S, Chetana M, Jo D, Ruley HE, Lin S-Y, et al. Observational fear learning involves affective pain system and Cav1.2 Ca2+ channels in ACC. Nature Neuroscience. 2010;13:482–488. doi: 10.1038/nn.2504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Murray EA. The amygdala, reward and emotion. Trends in cognitive sciences. 2007;11:489–497. doi: 10.1016/j.tics.2007.08.013. [DOI] [PubMed] [Google Scholar]
  • 53.Phelps EA, LeDoux JE. Contributions of the amygdala to emotion processing: from animal models to human behavior. Neuron. 2005;48:175–187. doi: 10.1016/j.neuron.2005.09.025. [DOI] [PubMed] [Google Scholar]
  • 54.Krishnamoorthy ES. A differential role for the hippocampus and amygdala in neuropsychiatric disorders. Journal of neurology, neurosurgery, and psychiatry. 2007;78:1165–1166. doi: 10.1136/jnnp.2006.108084. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Izquierdo A, Murray EA. Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J Neurosci. 2007;27:1054–1062. doi: 10.1523/JNEUROSCI.3616-06.2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Fanselow MS, LeDoux JE. Why we think plasticity underlying Pavlovian fear conditioning occurs in the basolateral amygdala. Neuron. 1999;23:229–232. doi: 10.1016/s0896-6273(00)80775-8. [DOI] [PubMed] [Google Scholar]
  • 57.Maren S, Aharonov G, Fanselow MS. Retrograde abolition of conditional fear after excitotoxic lesions in the basolateral amygdala of rats: absence of a temporal gradient. Behavioral neuroscience. 1996;110:718–726. doi: 10.1037//0735-7044.110.4.718. [DOI] [PubMed] [Google Scholar]
  • 58.Cardinal RN, Parkinson JA, Hall J, Everitt BJ. Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience and biobehavioral reviews. 2002;26:321–352. doi: 10.1016/s0149-7634(02)00007-6. [DOI] [PubMed] [Google Scholar]
  • 59.Kerns JG, Nuechterlein KH, Braver TS, Barch DM. Executive functioning component mechanisms and schizophrenia. Biological psychiatry. 2008;64:26–33. doi: 10.1016/j.biopsych.2008.04.027. [DOI] [PubMed] [Google Scholar]
  • 60.Meiran N, Levine J, Henik A. Task set switching in schizophrenia. Neuropsychology. 2000;14:471–482. doi: 10.1037//0894-4105.14.3.471. [DOI] [PubMed] [Google Scholar]
  • 61.Monchi O, Petrides M, Petre V, Worsley K, Dagher A. Wisconsin Card Sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2001;21:7733–7741. doi: 10.1523/JNEUROSCI.21-19-07733.2001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Everett J, Lavoie K, Gagnon JF, Gosselin N. Performance of patients with schizophrenia on the Wisconsin Card Sorting Test (WCST) J Psychiatry Neurosci. 2001;26:123–130. [PMC free article] [PubMed] [Google Scholar]
  • 63.Barch DM, Carter CS, Perlstein W, Baird J, Cohen JD, Schooler N. Increased stroop facilitation effects in schizophrenia are not due to increased automatic spreading activation. Schizophrenia research. 1999;39:51–64. doi: 10.1016/s0920-9964(99)00025-0. [DOI] [PubMed] [Google Scholar]
  • 64.Henik A, Salo R. Schizophrenia and the stroop effect. Behavioral and cognitive neuroscience reviews. 2004;3:42–59. doi: 10.1177/1534582304263252. [DOI] [PubMed] [Google Scholar]
  • 65.Crider A. Perseveration in schizophrenia. Schizophrenia bulletin. 1997;23:63–74. doi: 10.1093/schbul/23.1.63. [DOI] [PubMed] [Google Scholar]
  • 66.McNeely HE, West R, Christensen BK, Alain C. Neurophysiological evidence for disturbances of conflict processing in patients with schizophrenia. Journal of abnormal psychology. 2003;112:679–688. doi: 10.1037/0021-843X.112.4.679. [DOI] [PubMed] [Google Scholar]
  • 67.Koren D, Seidman LJ, Harrison RH, Lyons MJ, Kremen WS, Caplan B, et al. Factor structure of the Wisconsin Card Sorting Test: dimensions of deficit in schizophrenia. Neuropsychology. 1998;12:289–302. doi: 10.1037//0894-4105.12.2.289. [DOI] [PubMed] [Google Scholar]
  • 68.Barch DM. The cognitive neuroscience of schizophrenia. Annual review of clinical psychology. 2005;1:321–353. doi: 10.1146/annurev.clinpsy.1.102803.143959. [DOI] [PubMed] [Google Scholar]
  • 69.Daw ND, Niv Y, Dayan P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience. 2005;8:1704–1711. doi: 10.1038/nn1560. [DOI] [PubMed] [Google Scholar]
  • 70.Braver TS, Barch DM, Cohen JD. Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function. Biological psychiatry. 1999;46:312–328. doi: 10.1016/s0006-3223(99)00116-x. [DOI] [PubMed] [Google Scholar]
  • 71.Kieffaber PD, Kappenman ES, Bodkins M, Shekhar A, O’Donnell BF, Hetrick WP. Switch and maintenance of task set in schizophrenia. Schizophrenia research. 2006;84:345–358. doi: 10.1016/j.schres.2006.01.022. [DOI] [PubMed] [Google Scholar]
  • 72.Newell KA, Deng C, Huang XF. Increased cannabinoid receptor density in the posterior cingulate cortex in schizophrenia. Experimental brain research Experimentelle Hirnforschung Experimentation cerebrale. 2006;172:556–560. doi: 10.1007/s00221-006-0503-x. [DOI] [PubMed] [Google Scholar]
  • 73.Whitfield-Gabrieli S, Thermenos HW, Milanovic S, Tsuang MT, Faraone SV, McCarley RW, et al. Hyperactivity and hyperconnectivity of the default network in schizophrenia and in first-degree relatives of persons with schizophrenia. P Natl Acad Sci USA. 2009;106:1279–1284. doi: 10.1073/pnas.0809141106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Katayama K, Takahashi N, Ogawara K, Hattori T. Pure topographical disorientation due to right posterior cingulate lesion. Cortex; a journal devoted to the study of the nervous system and behavior. 1999;35:279–282. doi: 10.1016/s0010-9452(08)70801-3. [DOI] [PubMed] [Google Scholar]
  • 75.Pearson JM, Heilbronner SR, Barack DL, Hayden BY, Platt ML. Posterior cingulate cortex: adapting behavior to a changing world. Trends in cognitive sciences. 2011;15:143–151. doi: 10.1016/j.tics.2011.02.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Hayden BY, Nair AC, McCoy AN, Platt ML. Posterior cingulate cortex mediates outcome-contingent allocation of behavior. Neuron. 2008;60:19–25. doi: 10.1016/j.neuron.2008.09.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Johnston K, Levin HM, Koval MJ, Everling S. Top-down control-signal dynamics in anterior cingulate and prefrontal cortex neurons following task switching. Neuron. 2007;53:453–462. doi: 10.1016/j.neuron.2006.12.023. [DOI] [PubMed] [Google Scholar]
  • 78.Rushworth MF, Hadland KA, Gaffan D, Passingham RE. The effect of cingulate cortex lesions on task switching and working memory. J Cogn Neurosci. 2003;15:338–353. doi: 10.1162/089892903321593072. [DOI] [PubMed] [Google Scholar]
  • 79.Stuss DT, Levine B, Alexander MP, Hong J, Palumbo C, Hamer L, et al. Wisconsin Card Sorting Test performance in patients with focal frontal and posterior brain damage: effects of lesion location and test structure on separable cognitive processes. Neuropsychologia. 2000;38:388–402. doi: 10.1016/s0028-3932(99)00093-7. [DOI] [PubMed] [Google Scholar]
  • 80.Potkin SG, Turner JA, Brown GG, McCarthy G, Greve DN, Glover GH, et al. Working memory and DLPFC inefficiency in schizophrenia: the FBIRN study. Schizophrenia bulletin. 2009;35:19–31. doi: 10.1093/schbul/sbn162. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Mansouri FA, Buckley MJ, Tanaka K. Mnemonic function of the dorsolateral prefrontal cortex in conflict-induced behavioral adjustment. Science. 2007;318:987–990. doi: 10.1126/science.1146384. [DOI] [PubMed] [Google Scholar]
  • 82.Genovesio A, Brasted PJ, Mitz AR, Wise SP. Prefrontal cortex activity related to abstract response strategies. Neuron. 2005;47:307–320. doi: 10.1016/j.neuron.2005.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Tsujimoto S, Genovesio A, Wise SP. Comparison of strategy signals in the dorsolateral and orbital prefrontal cortex. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2011;31:4583–4592. doi: 10.1523/JNEUROSCI.5816-10.2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Buckley MJ, Mansouri FA, Hoda H, Mahboubi M, Browning PG, Kwok SC, et al. Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science. 2009;325:52–58. doi: 10.1126/science.1172377. [DOI] [PubMed] [Google Scholar]
  • 85.Kishida KT, King-Casas B, Montague PR. Neuroeconomic approaches to mental disorders. Neuron. 2010;67:543–554. doi: 10.1016/j.neuron.2010.07.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 86.Pickles A, Angold A. Natural categories or fundamental dimensions: on carving nature at the joints and the rearticulation of psychopathology. Development and psychopathology. 2003;15:529–551. doi: 10.1017/s0954579403000282. [DOI] [PubMed] [Google Scholar]
  • 87.Krueger RF, Watson D, Barlow DH. Introduction to the special section: toward a dimensionally based taxonomy of psychopathology. Journal of abnormal psychology. 2005;114:491–493. doi: 10.1037/0021-843X.114.4.491. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Goldberg D. Plato versus Aristotle: categorical and dimensional models for common mental disorders. Comprehensive psychiatry. 2000;41:8–13. doi: 10.1016/s0010-440x(00)80002-4. [DOI] [PubMed] [Google Scholar]
  • 89.Haslam N. Categorical versus dimensional models of mental disorder: the taxometric evidence. The Australian and New Zealand journal of psychiatry. 2003;37:696–704. doi: 10.1080/j.1440-1614.2003.01258.x. [DOI] [PubMed] [Google Scholar]
  • 90.Helzer JE, Kraemer HC, Krueger RF. The feasibility and need for dimensional psychiatric diagnoses. Psychological medicine. 2006;36:1671–1680. doi: 10.1017/S003329170600821X. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

01

RESOURCES