We rely on habits to get us through life. Grab your keys, back your car out of the driveway, navigate to work – each of these daily actions is made more fluid, and less error prone, with repetition and habit. As the father of modern psychology, William James, put it:
The more of the details of our daily life we can hand over to the effortless custody of automatism, the more our higher powers of mind will be set free for their own proper work. There is no more miserable human being than one in whom nothing is habitual but indecision, and for whom the lighting of every cigar, the drinking of every cup, the time of rising and going to bed every day, and the beginning of every bit of work, are subjects of express volitional deliberation.
But how do we transfer actions from express volitional control to automatism? Generally, a great deal of repetitive practice is required to perfect a new skill. Why? What about practice encourages the brain to consolidate a new action into an old habit?
Several major brain areas are implicated in the habit formation process. Among the most prominent are the dorsal striatum and the midbrain dopamine system. As habits form, patterns of neural activity in the dorsal striatum shift. In the dorsomedial striatum, neural activity during the performance of a new task peaks in early acquisition then fades as habits form, while in the dorsolateral striatum activity emerges and solidifies over time, in sync with habit’s emergence.1 These habit-linked changes are likely caused by synaptic plasticity. A large body of evidence points to the dopamine-dependent plasticity of cortical inputs onto striatal neurons as indispensable to habit formation,2–4 and my own graduate thesis focused on the molecular mechanisms by which dopamine acts as a master controller of the timing and direction of corticostriatal synaptic plasticity.5 The dopamine that controls striatal synaptic plasticity is supplied by the midbrain dopamine system.
As a postdoc at Stanford in the laboratory of Karl Deisseroth, I sought to examine the structure of the dopamine system as it relates to the control of habit formation. I hypothesized that dopamine circuits are structured to support the transfer of information between largely parallel corticostriatal systems, enabling the observed coordinated shifts in activity between striatal subregions. By understanding how dopamine signals to the dorsomedial and dorsolateral regions of the striatum might be differentially controlled, I could gain insight into the mechanisms by which habit formation circuitry is engaged to participate in action selection and how feedback from these habit circuits might then suppress volitional control.
To begin, I employed whole-brain circuit mapping and imaging techniques that were just then being developed at Stanford. Colleagues in Liqun Luo’s lab were developing a rabies-mediated circuit tracing strategy that allowed the mapping of whole-brain inputs to a cell type defined by its output. This technique, termed “TRIO,”6 was perfectly suited to determine whether dopamine signals to the dorsomedial and dorsolateral striatum could be generated by distinct combinations of inputs. I combined TRIO mapping with a tissue clearing method developed in the Deisseroth Lab called CLARITY, which then enabled intact imaging of mapped dopamine circuits using light-sheet microscopy.7,8 From these studies, I concluded that dopamine neurons did indeed receive differential inputs depending on their output targets. In particular, there was a bias towards reciprocal connectivity of striatal subregions with the dopamine neurons that project to those subregions.9
To confirm my anatomical observations, I performed functional studies on the connection probabilities and synaptic strengths of striatal inputs to dopamine neurons using optogenetics and slice electrophysiology. This alternative method of circuit mapping broadly confirmed my TRIO findings, but to my surprise it also led to the startling new observation that dorsolateral striatal inputs to dopamine neurons are substantially stronger than inputs from the dorsomedial striatum.9 This observation suggests a potential route for the suppression of dopamine transients to the dorsomedial striatum following heightened activity in the dorsolateral striatum as habits emerge.
Finally, I addressed the question of whether dopamine carries information differently to the dorsomedial than to the dorsolateral striatum. Using fiber photometry, another new technique I helped develop in the Deisseroth lab, in which the activity of a genetically-defined population of neurons is recorded as a bulk fluorescence signal through a fiber optic brain implant, I tracked the activity of dopamine neurons during rewarding and aversive experiences. I compared the responses of dopamine neurons projecting to the dorsomedial striatum to those projecting to the dorsolateral striatum and found that aversive events in particular provoked profoundly different, indeed opposite, responses in the two populations. 9 In parallel experiments using and elaborating on the fiber photometry technology to include sampling signals from multiple brain regions simultaneously, my colleagues and I further showed that dopaminergic projections to additional output regions such as the prefrontal cortex can also carry distinct information.10 Together, these studies present a strong case for using circuit features to help define dopaminergic (and other) cell types in the brain.11
Looking forward, I hypothesize that input-output defined dopamine neurons are at the crux of the brain’s habit engagement circuitry. As animals learn and explore, the shift from volitional to habitual control of their actions will depend on cost-benefit calculations made by the circuits and synapses I have studied and will continue to study in my own lab. As we unravel the mysteries of habit formation across many levels of neurobiological investigation – from molecules to behavior – we will learn how to more efficiently slip new skills into the effortless custody of automatism while also developing strategies to wrench back conscious control of our more counterproductive habits from its sometimes defiant, iron grip.
References:
- 1.Thorn CA, Atallah H, Howe M & Graybiel AM Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66, 781–795 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Yin HH et al. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 12, 333–341 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kreitzer AC & Malenka RC Striatal Plasticity and Basal Ganglia Circuit Function. Neuron 60, 543–554 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Reynolds JN, Hyland BI & Wickens JR A cellular mechanism of reward-related learning. Nature 413, 67–70 (2001). [DOI] [PubMed] [Google Scholar]
- 5.Lerner TN & Kreitzer AC RGS4 is required for dopaminergic control of striatal LTD and susceptibility to Parkinsonian motor deficits. Neuron 73, 347–359 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Schwarz LA et al. Viral-genetic tracing of the input-output organization of a central noradrenaline circuit. Nature 524, 88–92 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Chung K et al. Structural and molecular interrogation of intact biological systems. Nature 497, 332–337 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Tomer R, Ye L, Hsueh B & Deisseroth K Advanced CLARITY for rapid and high-resolution imaging of intact tissues. Nat Protoc 9, 1682–1697 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Lerner TN et al. Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine Subcircuits. Cell 162, 635–647 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Kim CK et al. Simultaneous fast measurement of circuit dynamics at multiple sites across the mammalian brain. Nat Meth 1–8 (2016). doi: 10.1038/nmeth.3770 [DOI] [PMC free article] [PubMed]
- 11.Lerner TN, Ye L & Deisseroth K Communication in Neural Circuits: Tools, Opportunities, and Challenges. Cell 1–21 (2016). doi: 10.1016/j.cell.2016.02.027 [DOI] [PMC free article] [PubMed]
