Abstract
Inhibitory control is a critical executive function that allows animals to suppress their impulsive behavior in order to achieve certain goals or avoid punishment. We investigated norepinephrine (NE) and acetylcholine (ACh) dynamics and population neuronal activity in the prefrontal cortex during inhibitory control. Using fluorescent sensors to measure extracellular levels of NE and ACh, we simultaneously recorded the dynamics of prefrontal NE and ACh in mice performing an inhibitory control task. The prefrontal NE and ACh signals exhibited strong coherence at 0.4–0.8 Hz. Chemogenetic inhibition of locus coeruleus (LC) neurons that project to the basal forebrain region reduced inhibitory control performance to chance levels. However, this manipulation did not diminish the difference in NE/ACh signals between successful and failed trials; instead, it abolished the difference in NE-ACh phase synchrony between the successful and failed trials, indicating that NE-ACh phase synchrony is a task-relevant neuromodulatory feature. Chemogenetic inhibition of cholinergic neurons that project to the LC region did not impair the inhibitory control performance, nor did it abolish the difference in NE-ACh phase synchrony between successful or failed trials, further confirming the relevance of NE-ACh phase synchrony to inhibitory control. To understand the possible effect of NE-ACh synchrony on prefrontal population activity, we employed Neuropixels to record from the prefrontal cortex with and without inhibiting LC neurons that project to the basal forebrain during inhibitory control. The LC inhibition reduced the number of prefrontal neurons encoding inhibitory control. Demixed principal component analysis (dPCA) further revealed that population firing patterns representing inhibitory control were impaired by the LC inhibition. Disparities in NE-ACh phase synchrony relevant to inhibitory control occurred only in the prefrontal cortex, but not in the parietal cortex, somatosensory cortex, and the somatosensory thalamus. Taken together, these findings suggest that the LC modulates inhibitory control through its collective effect with cholinergic systems on population activity in the prefrontal cortex. Our results further revealed that NE-ACh phase synchrony is a critical neuromodulatory feature with important implications for cognitive control.
Keywords: Locus coeruleus, basal forebrain, impulsivity, inhibitory control, pupil, prefrontal cortex, noradrenergic system, cholinergic system
Introduction
Whether “biting one’s tongue” at the Thanksgiving table during a political conversation or laying off a pitch out of the strike zone, the ability to inhibit inappropriate behavior to achieve a specific goal is a critical element of our executive function. In general, inhibitory control enables animals to suppress their impulsive behavior until conditions are appropriate, preventing undesired or sub-optimal outcomes1. Impulsivity is a complex neuropsychiatric trait and is often referred to as the tendency of rapid but often premature actions without foresight. Impulsive behavior is widely believed to result from impaired “top-down” inhibitory control. It is a hallmark of several major clinical conditions, including substance abuse disorder, attention deficit hyperactivity disorder (ADHD), and antisocial personality disorder2. A growing body of research suggests that the prefrontal cortex is a central node in the brain’s impulsivity network, playing a crucial role in inhibitory control3–5. Moreover, several neurotransmitter systems profoundly influence cognitive functions, including inhibitory control6–12. The dopaminergic system has long been implicated in impulse control. This is due to the dramatic therapeutic efficacy of amphetamine, a dopamine agonist, and methylphenidate, a dopamine and norepinephrine reuptake inhibitor, in treating impulsivity symptoms in ADHD patients. More recently, several lines of evidence from preclinical and clinical studies have indicated the involvement of the noradrenergic and cholinergic systems in inhibitory control7–12. For example, Robinson et al.8 found that administering Atomoxetine, a selective norepinephrine reuptake inhibitor, significantly improved the impulse control of rats across various behavioral tasks measuring impulsivity.
Norepinephrine (NE), along with acetylcholine (ACh), are two essential neurotransmitters in the brain. NE/ACh, released from the axon terminals of noradrenergic/cholinergic neurons, exerts an effect on noradrenergic and cholinergic receptors mainly through volume transmission to influence a variety of sensorimotor and cognitive functions13–15. The brainstem noradrenergic nucleus, the locus coeruleus (LC), provides the primary source of norepinephrine input to the entire forebrain16,17. The LC modulates various brain functions through its diffuse projections throughout the brain18–25. Similarly, cholinergic neurons within the basal forebrain region are the primary source of cholinergic input to the cortex26. The prefrontal cortex (PFC) is heavily innervated by cholinergic and noradrenergic systems. PFC neurons co-express adrenergic and cholinergic receptors, suggesting that the two neurotransmitters may engage competing intracellular signaling pathways27–29. However, little is known about the dynamics of NE and ACh in the prefrontal cortex during inhibitory control. Moreover, although previous work utilizing anatomic tracing, pharmacological manipulation and modeling has suggested the role of interaction between the NE and ACh systems in modulating cognitive functions30,31, the extent to which the NE-ACh interaction modulates prefrontal population activity and, in turn, inhibitory control remains poorly understood.
To address these questions, in the present study, we simultaneously measured extracellular NE and ACh levels using florescent GRABNE and GRABACh sensors in mice performing an inhibitory control task, which required the mice to suppress impulsive licking. to uncover the dynamics of prefrontal NE and ACh during inhibitory control. Here, we show that the phase relationship between prefrontal NE and ACh signals was dynamic during inhibitory control, with the two signals more likely being in-phase. Chemogenetic inhibition of LC neurons that project to the basal forebrain region reduced behavioral performance to a chance level. Surprisingly, this manipulation abolished the difference in NE-ACh phase synchrony, but not the difference in the NE/ACh signals between successful and failed trials. Chemogenetic inhibition of cholinergic neurons projecting to the LC did not alter prefrontal NE-ACh phase synchrony, nor did it affect inhibitory control performance. Subsequent Neuropixels recordings from the prefrontal cortex confirmed that inhibition of LC neurons that project to the basal forebrain region also disrupted population dynamics representing inhibitory control, suggesting a modulatory effect of NE-ACh phase synchrony on neural activity. Interestingly, this behavior-relevant NE-ACh phase synchrony only occurred in the prefrontal cortex but not in the parietal cortex, somatosensory cortex, or the thalamus during inhibitory control. Taken together, these results revealed that prefrontal NE-ACh phase synchrony is a novel neuromodulatory feature that indexes neuromodulation of population activity mediating inhibitory control.
Results
Correlated fluctuations of NE and ACh levels in the prefrontal cortex
To investigate the interaction between the noradrenergic and cholinergic signals in inhibitory control, we used AAV vectors to express genetically encoded NE and ACh fluorescent biosensors GRABNE and GRABACh in the prefrontal cortex of head-fixed mice (Figure 1a, b; one biosensor in each hemisphere, randomly assigned, GRABNE in the left prefrontal cortex of 9 mice out of 19 mice). During the initial shaping period, we observed a transient increase of both NE and ACh levels following the random delivery of sweet water, confirming the ability of these biosensors to index behavior (Figure 1c, d). Furthermore, the amplitude of the transient ACh increase elicited by sweet water rewards (and possibly consequent licking activities) was comparable to that of transient NE responses (Figure 1e, p=0.62; Wilcoxon signed-rank test). We also found a significant difference in the peak response latency between NE and ACh responses. (Figure 1e, 1p<0.02; Wilcoxon signed-rank test). The level of both NE and ACh in the brain fluctuated spontaneously (Figure 1f). However, the fluctuation of the neurotransmitters was correlated. Cross-correlation analysis revealed a positive correlation between NE and ACh with a peak correlation coefficient of 0.331±0.041, significantly greater than 0 (p<1.3e-4, Wilcoxon signed-rank test). Consistent with previous work, NE dynamics preceded ACh dynamics by 0.03±0.01 seconds (p<0.0056, Wilcoxon signed-rank test, Figure 1g)32. Coherence analysis revealed that the two neuromodulatory signals exhibited a maximum correlation at a frequency range of 0.4–0.8 Hz, indicating a strong interplay at this frequency band (Figure 1h).
Prior studies have established that pupil size can track the activity of noradrenergic and cholinergic axons in the sensory cortices32. To further examine if pupil size can also track NE and ACh fluctuations in the prefrontal cortex, we performed cross-correlation analysis between pupil size and GRABNE/GRABACh signals. As expected, the cross-correlogram revealed a positive correlation between pupil size and NE/ACh signals, with ACh exhibiting a slightly higher peak correlation coefficient (p<4.1e-4; paired t-test) (Figure 1i, j). We also found that both NE and ACh signals preceded pupil fluctuations (NE: −0.54±0.05 s, significantly differs from 0 with p<1.2e-4, Wilcoxon signed-rank test; ACh: −0.26±0.03 s, significantly differs from 0, p=1.2e-4, Wilcoxon signed-rank test). Consistent with the direct cross-correlation results between NE and ACh, NE signals preceded pupil signals more than ACh signals did (p<2.4e-4, paired t-test) (Figure 1j). As tonic LC stimulation evoked continuous pupil dilation33, we further correlated NE/ACh signals with the first derivative of pupil size32 (Figure 1k). Interestingly, although the peak value of the cross-correlogram between NE signals and pupil size derivative was comparable to that between ACh signals and pupil derivative (p=0.14, paired t-test), the peak latency was larger for ACh than NE signals (p<2.5e-4, paired t-test, Figure 1l). The correlated fluctuations between cortical NE/ACh signals and pupil size were further confirmed by aligning NE and ACh fluctuations to one canonical cycle of pupil dilation and constriction derived from the Hilbert transform. Similar to previous findings32, we found that both NE and ACh exhibited peak amplitude at a negative pupil phase, confirming that both NE and ACh signals preceded pupil fluctuations (Figure 1m; Supplemental figure 1).
Prefrontal NE and ACh dynamics during inhibitory control
After verifying the functionality of the biosensors, we focused on understanding the NE and ACh dynamics during inhibitory control. In pursuit of this, we trained 30 mice to perform an inhibitory control task, from 27 of which we simultaneously measured the NE and ACh signals in the prefrontal cortex (Figure 2a). In this task, mice were required to withhold their impulsive licking. During the initial shaping period, once naïve mice associated the waterspout with sweet water delivery (usually on the first day), they constantly licked to check for sweet water even though a sweet water drop was randomly delivered every 12–22 seconds. This habitual behavior was evidenced by elevated licking frequencies during subsequent sessions (Figure 2b, p=3e-10, one-way ANOVA test). In the inhibitory control task, mice were trained to suppress the impulsive licking. At the beginning of each trial, the animals could freely lick with no penalty during a free period (5 to 7 s uniform distribution). Subsequently, an inhibition tone (duration randomly drawn from an exponential distribution varying from 5 to 12 s with λ=4.5, Figure 2a) was played. During the inhibition tone period, a lick resulted in a brief air puff (20 psi, 200 ms, see Methods) to the animal’s face, while successful withholding of licking resulted in a sweet water reward at the end of the inhibition tone. Our data demonstrated that the mice could effectively suppress their impulsive licking once the tone started, and their success rate gradually increased during the initial training sessions, suggesting that their inhibitory control is a learned behavior (Supplemental Figure 2a). The licking frequency within 2 seconds following the inhibition tone onset was significantly lower than during a 2-second window immediately prior to the tone onset (Figure 2c, Supplemental Figure 2b, p<4.2e-10; Wilcoxon signed-rank test). Furthermore, the animals’ success rates were significantly higher than the chance levels (Figure 2d, p<7.1e-9, paired t-test; Supplemental Figure 2c). As we expected, the longer the inhibition tone period (trials were grouped into three inhibition tone periods: 5–7.5, 7.5–10, and 10–12 seconds), the less likely that the mice were able to suppress their impulsive licking (Figure 2e, p<7.4e-10, one-way ANOVA test). The animals typically collected water rewards within 500 ms (Supplemental Figure 2d). The duration of the inhibition tone had no effect on the reaction time, defined as the interval between the offset of the inhibition tone and the animal’s first lick to collect water reward, suggesting that the animals were generally vigilant during the task (Figure 2f, p=0.96, one-way ANOVA test). Together, these behavioral results suggested that the animals exercised cognitive control to suppress impulsive licking in the inhibitory control task.
Previous work using pharmacological manipulations suggested an important role of NE in the PFC in inhibitory control34. We then explored prefrontal NE and ACh dynamics during inhibitory control. Consistent with previous work demonstrating phasic LC firing in response to salient stimuli21,25,35,36, as we expected, the onset of inhibition tone elicited a phasic increase of NE levels in the PFC (Figure 2g). Interestingly, ACh concentration also exhibited a dramatic increase following the onset of inhibition tone. When comparing the phasic responses between successful and failed trials, we found that there was no significant difference in either NE or ACh levels prior to the inhibition tone between the two behavioral outcomes (Figure 2h, NE: p=0.30, Wilcoxon signed-rank test; ACh: p=0.09, Wilcoxon signed-rank test). We also failed to find significant differences in the peak amplitude or latency of evoked transient NE and ACh responses between successful and failed trials (Figure 2i,j; peak amplitude: NE: p=0.12, Wilcoxon signed-rank test; ACh: p=0.44, Wilcoxon signed-rank test. Latency: NE: p=0.92, Wilcoxon signed-rank test; ACh: p=0.79, Wilcoxon signed-rank test).
Given our results suggesting that NE and ACh dynamics prior to the inhibition tone do not index inhibitory control performance, we then examined the NE and ACh dynamics in the PFC within the 5 seconds preceding the behavioral outcome for each trial (i.e. reward at the end of inhibition tone or punishment resulting from licking during the inhibition tone). We chose the 5-second window because it represents the minimum duration of the inhibition tone so we can include all successful trials in our analysis. Although both NE and ACh signals were generally decreasing before both behavioral outcomes, they initiated an increase at approximately 0.5 s before impulsive licking in failed trials (Figure 2k–m). The trough time for NE slightly preceded ACh (Figure 2n, p<0.008, paired t-test). We found that there was a difference in the extracellular level of both neurotransmitters between successful and failed trials (Figure 2l; NE: p<0.009, Wilcoxon signed-rank test; ACh: p<0.002, Wilcoxon signed-rank test). The difference in the descending slope of NE/ACh signals was only significant for ACh, not for NE (Figure 2m; NE: p=0.18, Wilcoxon signed-rank test; ACh: p<0.01, Wilcoxon signed-rank test). To further quantify the discriminability between NE/ACh levels in successful versus failed trials, we performed ROC analysis37. In this analysis, the area under the ROC curve (AUROC) is a quantitative measure of the discriminability (i.e. normalized difference) between two stochastic signals. Consistent with the results shown in Figure 2k, the AUROC associated with ACh signals was greater than that associated with NE signals, suggesting that ACh dynamics associated with successful and failed outcomes were more separated than NE (Figure 2o, p<0.006, Wilcoxon signed-rank test).
The dynamics of either NE or ACh in the PFC are not reliable indicators of inhibitory control
Our results just suggested that both NE and ACh levels in the prefrontal cortex appeared to be linked to inhibitory control, as the neurotransmitter levels associated with success or failure in impulse control differed for both NE and ACh. However, if NE/ACh levels prior to behavioral outcomes truly index inhibitory control, their difference between successful and failed trials would diminish or even vanish if inhibitory control is impaired. To test this, we conducted experiments in which we manipulated the LC-NE system in the behaving mice. To this end, we injected AAVrg-hSyn-DIO-hM4D(Gi)-mCherry into the basal forebrain region of DBh-Cre mice to retrogradely express inhibitory DREADD receptors in LC neurons that project to the basal forebrain area (Figure 3a, see Methods). Post-mortem IHC confirmed the expression of DREADD in LC neurons (Figure 3b and Supplemental Figure 3a). In control sessions where the mice received saline administration, their inhibitory control performance was significantly greater than the chance level (Figure 3c, p<0.02, paired t-test), similar to WT mice (Supplemental Figure 3b,c). However, when CNO was administered to inactivate LC neurons projecting to the basal forebrain region, the mice’s performance dramatically dropped (Figure 3c. p<5.8e-3, paired t- test). Indeed, the performance with CNO was not significantly different from the chance level (p=0.28, paired t-test), suggesting their inhibitory control was totally impaired. To control for the effect of CNO alone (i.e. not through its effect on DREADD receptors), we administered CNO to 4 WT mice, and found that CNO alone had on effect on these animals’ inhibitory control (Supplemental Figure 4a).
While CNO administration slowed their reaction time (Figure 3d, p<5.7e-3, paired t-test), it did not significantly affect the licking frequency during the free period (Figure 3e, p=0.68, paired t- test). Interestingly, there was an inconspicuous difference in NE/ ACh dynamics before behavior outcomes between CNO treatment sessions and saline control sessions (Figure 3f). Because CNO-mediated inhibition of LC neurons greatly disrupted inhibitory control, we expected it also to abolish the difference in NE/ACh levels between successful and failed trials. Surprisingly, when we segregated the NE and ACh signals based on behavioral outcomes, contrary to what we expected, we found that the inactivation of LC neurons did not diminish the difference between successful and failed trials for either NE or ACh signals. Instead, the difference in the ACh signal appeared to be enhanced while the inhibitory control performance was at the chance level, suggesting that the difference in mean NE/ACh signals between successful or failed trials is not a reliable indicator of inhibitory control (Figure 3g–i). To quantify these results, we again used ROC analysis. The AUROC from ACh signals indeed increased, while AUROC from NE signals remained the same (Figure 3j. ACh: p<6e-26, Wilcoxon signed-rank test; NE: p<0.96, Wilcoxon signed-rank test). Taken together, these results suggest that the averaged NE or ACh signals are not correlated with inhibitory control.
Phase synchrony between NE and ACh signals in the PFC indexes inhibitory control
Given that our results suggested that mean NE and ACh levels are not reliably linked to inhibitory control, we then asked what other features of the NE and ACh signals could be reliably linked to the behavior. As the NE and ACh system exhibited the strongest coherence at 0.4–0.8 Hz, we first explored whether the phase of NE and ACh fluctuations at this frequency band depends on inhibitory control (Figure 4a). We found that CNO-induced LC manipulation did not eliminate the difference in the phase distributions of ACh and NE signals between successful and failed trials, suggesting the phase is also not linked to inhibitory control (Figure 4b). Upon closer examination of NE and ACh signal fluctuations, we noticed that the phase relationship between NE and ACh signals was dynamic. Specifically, NE and ACh exhibited similar phases (i.e. in-phase) during some periods but had opposite phases (i.e. out-of-phase) during the other periods. This phenomenon has been observed in other physiological signals38. We calculated the value of a phase encoder as a quantitative measure of phase synchrony between NE and ACh signals (see Methods)38. In this measure, a value of one indicates that the two signals share the same phase angle and thus are in-phase, while the value of zero indicates that the two signals have a phase difference of 180 degrees (i.e. out-of-phase). We found that the phase synchrony between successful and failed trials began to diverge approximately 3 seconds before behavioral outcomes (Figure 4c, left panel). While CNO did not significantly alter the overall phase synchrony during the 5 second period before behavioral outcomes (Figure 4d), it abolished the difference in phase synchrony between successful and failed trials (Figure 4c, e. Saline: p<0.006, paired t-test; CNO: p=0.26, paired t-test), resulting in a decreased AUROC with CNO compared to saline controls (Figure 4f, p<4e-41, Wilcoxon signed-rank test). To confirm that the observed phase difference really reflects the relationship between the two neurotransmitters, we performed a negative control experiment in which we used GRABNE-mut and GRABACh-mut instead of GRABNE and GRABACh sensors. Because GRAB-mut sensors have similar constructs with GRABACh/GRABACh except they do not index NE/ACh levels, as expected, GRABACh-mut and GRABACh-mut signals exhibited no difference in phase synchrony between behavioral outcomes (Figure 4e right, p = 0.98, paired t-test). This control experiment confirmed that the observed phase synchrony is a task-relevant neuromodulatory feature.
Furthermore, the difference in NE-ACh phase synchrony between successful and failed trials was positively correlated with behavioral performance and this correlation again vanished when BF-projecting LC neurons were inhibited by CNO (Figure 4g), suggesting that the NE and ACh interplay in the prefrontal cortex is reliably linked to inhibitory control.
While the average phase synchrony between NE and ACh signals in the PFC was generally weaker in failed trials than in successful trials, we wondered whether there were other features of the phase synchrony linked to inhibitory control. We found that the distribution of phase synchrony was non-uniform. Rather, the distribution was heavily skewed towards the value of 1, indicating that the NE and ACh activity were mostly in phase (Figure 4d, insets). Indeed, upon close inspection of the phase synchrony, we observed occasional rapid decreases to around 0, signifying a transient out-of-phase state between the noradrenergic and cholinergic systems for a short period (Figure 4a, second to the bottom panel). Although the mechanism through which the NE and ACh systems were transiently out-of-phase remains unknown, we examined whether switching from in-phase to out-of-phase between the NE and ACh systems was linked to behavior. To this end, we assessed the number of switches before the behavioral outcome. We found a noticeable difference in the switching rate between successful and failed trials approximately 3 seconds before the behavioral outcome (Figure 4g). More importantly, similar to its effect behavioral performance, the CNO-mediated silencing of LC neurons projecting to the basal forebrain region significantly reduced the difference between successful and failed outcomes (Figure 4h. Saline: p<3.97e-11, paired t-test; CNO: p=0.08, paired t-test). For all 19 animals in which we recorded NE and ACh from the prefrontal cortex, the difference in the switching rate between successful and failed trials appeared to be positively correlated with their behavioral performance (Supplemental figure 4b, p<0.005).
Inactivation of cholinergic projections to the LC did not affect prefrontal NE-ACh phase synchrony and inhibitory control
As silencing LC neurons projecting to the basal forebrain regions profoundly disrupted inhibitory control and behavior-dependent phase synchrony, we further explored if possible basal forebrain projections to the LC have a similar effect on inhibitory control39,40. We again injected the retrograde AAV virus into the LC of ChAT-Cre mice to retrogradely express inhibitory DREADD receptors in cholinergic neurons projecting to the LC (Supplemental Figure 5a). IHC analysis demonstrated the expression of mCherry fluorescent protein, the tag of the retrograde AAV, in the superior cerebellar peduncle (SCP)/Red nucleus (RN), the pontine reticular nucleus (PRN), and the trigeminal motor nucleus (V) area (Supplemental Figure 5b, Supplemental Figure 5). Interestingly, we did not find evident mCherry expression in the basal forebrain area in these animals (see Discussion). Silencing the cholinergic projections to the LC failed to disrupt the inhibitory control performance (Supplemental Figure 5c, 104.3±35.1% vs. 94.7±24.9%, p=0.47, paired t-test). However, the reaction time for the animals to collect water rewards at the offset of the inhibition tone in successful trials was significantly slower than in saline control sessions (Supplemental Figure 5d, p<0.004, paired t-test), indicating the effects of the chemogenetic inhibition of cholinergic neurons on motor-related functions, but not on cognitive functions.
Similar to the results from manipulating the LC-NE system in the DBh-Cre mice, manipulating the cholinergic projections to the LC failed to diminish the differences in prefrontal NE and ACh signals between successful and failed trials (Supplemental Figure 5e). Consistent with their effect on behavioral performance, silencing the cholinergic projections to the LC failed to modulate the phase synchrony between the NE and ACh signals (Supplemental Figure 5f). Neither did it significantly change the switching rate as there was a higher switching rate in failed trials than in successful trials for both CNO treatment and the saline controls (Supplemental Figure 5g, Saline: p<3.1e-6, paired t-test; CNO: p<4.7e-6, paired t-test). Taken together, these results strengthened the notion that prefrontal NE-ACh phase synchrony is linked to inhibitory control.
Prefrontal population activity during inhibitory control
Previous work has demonstrated the critical role of the prefrontal cortex in inhibitory control. After discovering that prefrontal NE-ACh phase synchrony is a behaviorally relevant neuromodulatory feature, we further investigated its potential effect on the prefrontal neural activity that mediates inhibitory control. We implanted a Neuropixels probe into the prefrontal cortex to record population activity while chemogenetically inhibiting LC neurons that project to the basal forebrain during inhibitory control (Figure 5a). Active neurons (firing rate > 1 Hz; see Methods) during inhibitory control were located in various regions of the prefrontal cortex, including the orbitofrontal and prelimbic regions. This suggested that these sub-regions of the prefrontal cortex contribute to inhibitory control. 17% of the neurons exhibited a narrow waveform and were therefore termed fast-spiking units (FSUs), while the remainder were termed regular-spiking units (RSUs) due to their broader waveforms (Figure 5b). Both RSUs and FSUs were evenly distributed along the probes over a distance of approximately 1.1 mm from the electrode tip. Consistent with results from the biosensor group, the inhibition of BF-projecting LC neurons significantly impaired animal’s inhibitory control performance (Figure 5c, p<0.015, paired t test). Moreover, the firing rate of prefrontal neurons was decreased during DCZ sessions, confirming LC modulation on prefrontal activity (Figure 5d, p<0.035, t- test).
During saline control sessions, consistent with previous studies, we found that a portion of neurons encode inhibitory control, as evidenced by a significant firing rate difference between successful and failed trials (Figure 5e–g; Supplemental figure 6)4; we therefore termed these neurons encoding neurons as their firing rates encode inhibitory control. The encoding neurons were evenly distributed across all layers of the orbitofrontal cortex (Figure 5g, inset). However, LC inhibition reduced the number of encoding neurons (Figure 5e; p <0.05, paired t-test). This decrease was not due to a potential reduction in the total number of neurons during DCZ sessions, as there was no significant change in the number of neurons recorded between saline and DCZ treatment sessions (Figure 5f; p = 0.60, paired t-test). While LC inhibition reduced the firing rate of these encoding neurons, it did not alter the ratio of encoding neurons with a higher firing rate in successful trials to those with a higher firing rate in failed trials (Figure 5g).
We also found that a small portion of neurons rapidly increased their firing rate just before action in failed trials; we therefore termed these neurons action-predicting neurons (Figure 5h, i). The action-predicting neurons were predominantly located in the superficial layers of the orbitofrontal cortex (Figure 5h, inset). In contrast to the encoding neurons, LC inhibition did not change the firing rate of the action-predicting neurons (p=0.40, t-test), nor did it affect the percentage of action-predicting neurons (p=0.41, paired t-test). Moreover, a very small number of neurons were both action-predicting and encoding neurons; however, this overlap was not affected by LC inhibition (Figure 5j; p=0.43, paired t-test). Together, these results suggest that action-predicting neurons are unlikely to contribute to cognitive control of impulsivity.
We applied a stringent threshold to identify encoding neurons (p < 0.05/number of all neurons, per Bonferroni multiple comparison correction; see Methods), resulting in approximately 26% of neurons being classified as encoding neurons. However, it is possible that other neurons also collectively, though weakly, contributed to inhibitory control. To investigate how prefrontal population activity represents inhibitory control, we first calculated and compared pairwise cross-correlation among encoding neurons between successful and failed trials, both with and without LC inhibition. LC inhibition more significantly disrupted the correlation structure across the encoding neurons than among the non-encoding neurons, suggesting that NE-ACh phase synchrony exerts a stronger influence on encoding neurons compared to non-encoding neurons (Figure 6a, b).
To further confirm this finding, we employed demixed PCA (dPCA) analysis to decompose population dynamics associated with inhibitory control and the independent component41. There is a marked difference in their projections to dPC1, dPC2, and dPC3 between successful and failed trials for population firing patterns associated with inhibitory control, but not for those associated with the independent component (Figure 6c). We then calculated the distance in the low-dimensional dPCA space between population firing dynamics in successful and failed trials, and found that this distance is proportional to behavioral performance (Figure 6d–f). As expected, inhibiting LC neurons that project to the BF significantly decreased the distance between population firing patterns in successful and failed trials (Figure 6e, p < 0.02, paired t-test), and further disrupted their correlation with behavioral performance (Figure 6f). Together, these results suggested that NE-ACh interplay in the prefrontal cortex influences the population neuronal activity that mediates inhibitory control.
Behavior relevant interplay between NE and ACh signals is different between the cortex and the thalamus
As we just demonstrated that both NE/ACh phase synchrony in the prefrontal cortex, as well as the number of switching from in-phase to out-of-phase between prefrontal NE and ACh signals, were significantly different between successful and failed trials, we wondered if these behavior-relevant measures of NE-ACh interplay were generalizable to other brain structures. We repeated the same experiments in three new cohorts of WT mice measuring NE and ACh dynamics in the posterior parietal cortex, the primary somatosensory cortex, and the thalamus instead of the prefrontal cortex (Figure 7). We found that the thalamus exhibited higher phase synchrony than those cortical regions (Supplemental Figure 7a, p<1.6e-9, ANOVA test). Interestingly, NE signals associated with successful and failed trials differed across the brain regions. More specifically, the NE level in failed trials was significantly higher in the thalamus but not in the cortex (Figure 7b,f,j). Moreover, the NE signals increased before behavioral outcome in the posterior parietal cortex, primary somatosensory cortex, and the thalamus but not in the prefrontal cortex. On the contrary, ACh signals were generally higher in successful trials than in failed trials (Figure 3g, Figure 7b,f,j). However, the thalamic ACh signal increased during inhibitory control in successful trials while the cortical ACh signal generally decreased (Figure 3g, Figure 7b,f,j). Consistent with this notion, for all cortical regions, the switching rate in successful trials was lower than that in failed trials (PPC: p<5.9e-6, paired t-test, Figure 7c; S1: p<0.007, paired t-test, Figure 7g). However, this trend did not hold in the thalamus (p=0.66, paired t-test, Figure 7k). Furthermore, unlike in PFC, there were no conspicuous differences in NE-ACh phase synchrony between successful and failed trials in the thalamus, PPC and S1 (Figure 7 d,h,l; Supplemental Figure 7b). Taken together, the different NE/ACh dynamics in the four brain structures shown in our data indicated that the noradrenergic and cholinergic sources to the prefrontal cortex, posterior parietal cortex, primary somatosensory, and the thalamus might be distinct42–44.
Pupil dynamics index NE-ACh phase synchrony in failed, but not successful trials
To validate our findings regarding the distinct NE and ACh signals across the cortical and thalamic regions, we further examined if their phase relationship with pupil fluctuations differed across these structures. As we expected, there were noticeable differences in the phase relationship between pupil fluctuation and NE/ACh signals across these brain structures. For NE signals, the phase relationship changed from NE-leading-pupil in higher order brain regions (i.e. PFC and PPC) to anti-phase in the sensory cortex and thalamus (Figure 8a). However, the fluctuation of ACh signals in the cortical structures was in-phase with pupil fluctuations but this relationship changed to out-of-phase in the thalamus, supporting the notion that NE/ACh projections in the four brain structures may originate from different subgroups of LC neurons or different cholinergic nuclei.
Since previous work has demonstrated the causal relationship between LC activity and pupil dilation, as well as the correlation between pupil size and cortical NE/ACh activity32,33,35, we explored the quantitative relationship between pupil size and NE/ACh as well as their phase synchrony in inhibitory control. When looking at the pupil dynamics during the inhibition tone period right before behavioral outcomes, we found an inconspicuous difference between successful and failed trials, except for the fact that the pupil started to dilate ~0.5s before the licking in failed trials (Figure 8b, p=0.8, paired t-test). Given the significant difference in phase synchrony between successful and failed trials, we hypothesized that the relationship between pupil size and phase synchrony may depend on behavioral outcomes. To test this, we employed system identification approaches to assess the temporal response function (TRF, i.e. kernel) that translates NE, ACh, or phase synchrony to pupil size45 (Figure 8c). As expected, when examining the relationship between pupil size and NE/ACh signals during the inhibition control period, we failed to find significant differences in the TRFs between successful and failed trials (Figure 8d). Interestingly, while the TRF mapping phase synchrony to pupil size during the inhibition control period in failed trials was similar to that of NE and ACh, the TRF in successful trials was around 0, indicating that the phase synchrony had much stronger effects on pupil size in failed trials than successful trials (Figure 8e). To further confirm that the difference was related to inhibitory control, we estimated the TRFs during the free period. As expected, the difference in TRFs mapping phase synchrony to pupil size between successful and failed trials was not significant (Supplemental Figure 8a, p=0.35, paired t-test). Similarly, the TRFs that map NE and ACh signals to pupil signals in successful and failed trials were also not significantly different from each other (Supplemental Figure 8b, NE: p=0.9, paired t-test; ACh: p=0.67, paired t-test). Additionally, their amplitude was much less than during the inhibitory control period (Supplemental Figure 8b).
Discussion
In the present study, we investigated the effect of synergistic activity of the noradrenergic and cholinergic systems on impulsivity control. While it has long been stipulated that the NE and ACh systems synergistically modulate brain functions, how the two systems interact to influence neural functions and behavior remains elusive. Through fiber photometry recording of NE and ACh dynamics and Neuropixels recording of population neuronal activity in the prefrontal cortex, our study, for the first time, provided direct experimental evidence suggesting that the phase synchrony between the NE and ACh signals is an important neuromodulatory feature and indexes the collective effect of the noradrenergic and cholinergic systems on prefrontal neural activity mediating inhibitory control of impulsive actions.
Our findings suggested that the impulsive licking behavior observed in our mice was habitual, possibly incentivized by sweet water rewards. Moreover, the suppression of impulsive licking is a learned behavior that involves cognitive control, as evidenced by the increased success rate across training sessions (Supplemental Figure 2a). This notion falls within the concept of inhibitory learning, which involves learning the conditions under which a response does not lead to a desired outcome and should therefore be withheld, such as not walking at a crosswalk when the light is red46. The phenomenon of impulsive licking of water spout in water-deprived rodents has been well documented47, and it has been commonly used to study the neural basis of impulsivity47,48. The trait of impulsivity has a multidimensional nature. It is manifested in several behavioral forms involving actions inappropriate to the situation and/or prematurely executed that often result in undesired consequences. One form of impulsivity is reflected in deficit in motor inhibition (impulsive action). In contrast, the other forms are related to impaired decision making, either resulting from inadequate evidence accumulation or due to tendency to accept immediately available but small rewards over larger but delayed rewards (impulsive choice)2,49. Different behavioral tasks have been implemented to assess these distinct behavioral forms of impulsivity. For instance, the probability discounting task and the temporal discounting task are mainly used to examine impulsive choice. In contrast, the stop signal reaction time (SSRT) task and the 5-choice serial reaction time (5CSRTT) task are used to examine impulsive actions50. Our behavioral task was designed to explicitly assess inhibitory control of impulsive actions, whereas the SSRT task and the 5CSRTT task measure other behavioral constructs, in addition to impulsive action. The SSRT tasks, for example, assess not only the subjects’ ability to initiate an action to a go-signal, but also their ability to cancel the action that has been initiated51. Similarly, the 5CSRTT task measures both impulsivity and general attentional abilities of the subjects50. Our task focused on testing the ability of proactive inhibitory control (i.e. the ability to inhibit behavior until conditions are appropriate) and shares similarities with the delayed-response task that was used by Narayanan and Laubach52, in which animals were required to hold a lever and wait until the presence of a sensory signal to release the lever. Their findings suggested that the inactivation of the rat prefrontal cortex with muscimol significantly increased impulsivity in the task, and inhibitory control in the task was mediated by prefrontal control of the motor cortex.
We found that a portion of prefrontal neurons encode behavioral outcomes of inhibitory control as their firing rate differed significantly between successful and failed trials. This is consistent with previous findings demonstrating distinct activation patterns among projection-specific mPFC neurons during inhibitory control4,47. However, we found that these encoding neurons were evenly distributed in the mPFC and OFC, suggesting that both regions contribute to behavioral inhibition. This is consistent with previous work showing that the same behavior-relevant variable was encoded by neural activity in both mPFC and OFC53. It was initially puzzling that the inhibition of LC neurons projecting to BF altered the number of encoding neurons but not the difference in their firing rate between successful and failed trials (Supplemental Figure 6). However, our further analysis incorporating the firing patterns of all neurons into dPCA analysis revealed that the difference in inhibitory control-related population dynamics between successful and failed trials was indeed correlated with behavioral performance. Further, LC inhibition diminished the difference in population firing patterns associated with two behavioral outcomes in the low-dimensional space (Figure 6e), suggesting a population code for inhibitory control in the prefrontal cortex. Our findings invite future investigations on how population neurons in the different regions of the prefrontal cortex mediate inhibitory control.
Previous studies utilizing pharmacological manipulations have underscored the behavioral significance of the synergy between the noradrenergic and cholinergic systems54,55. During the postnatal critical period, ocular dominance development in the cortex remained unaffected by the pharmacological depletion of either NE or ACh; however, combined depletion of both NE and ACh impeded this process54. The antidepressant effects of guanfacine, an α2 adrenergic receptor agonist, were blocked by the knockdown of nicotinic cholinergic receptor β2 subunits in the amygdala55. The NE and ACh interaction in the amygdala appeared to be reciprocal because ablation of NE terminals in the amygdala also blocked the antidepressant effects of cytisine, a nicotinic partial agonist. By simultaneously measuring NE and ACh dynamics in the brain, our results offered new supporting evidence for the importance of NE-ACh interactions. Moreover, the newly developed biosensors allowed us to characterize the interaction at a behavior-relevant time scale. Our data suggested that the effect of the NE-ACh interaction on behavior is rapid because the NE-ACh phase synchrony began to decrease approximately 3 seconds before behavioral outcomes in the failed trials.
Our results indicated that the NE-ACh phase synchrony, rather than individual NE or ACh signals, serves as an important biomarker for inhibitory control, highlighting the synergistic effect of NE and ACh on brain functions. Why does the NE-ACh phase synchrony matter? This may be because the interaction between the noradrenergic and cholinergic systems also happens at the receptor level. Previous work has reported that NE suppressed the release of ACh from cholinergic axonal terminals56 and ACh modulation of cortical and hippocampal neurons was dependent upon NE levels57,58. Reciprocally, ACh inhibits NE release through M2 muscarinic cholinergic receptors59. It has then been argued that the balance between the noradrenergic and cholinergic systems is essential for cognitive functions60. In support of this notion, it has been shown that behavioral impairments in a memory task resulting from blockade of ACh inputs to the hippocampus were alleviated by a reduction in NE in the hippocampus60. Therefore, it is likely that the brain operates in the optimal state when NE and ACh systems are in a certain phase relationship. It is intriguing for future work to delineate the effects of NE-ACh phase synchrony on population neuronal activity and behavior at the network, cellular, and molecular levels in awake, behaving animals.
We observed robust labeling in the LC neurons upon retrograde AAV injection into the basal forebrain region. Functionally, silencing the basal forebrain-projecting LC neurons impaired inhibitory control and disrupted behaviorally relevant phase synchrony between the NE and ACh systems. These results provided new experimental evidence supporting previous work showing LC projections to the basal forebrain region61,62. Moreover, we improved the specificity of the AAV-mediated retrograde labeling in the present study by taking advantage of the Cre/Lox system to limit the expression of mCherry to noradrenergic neurons, further supporting the notion of interaction between the noradrenergic and cholinergic systems in cognitive tasks13,31,55,63. However, we failed to observe evident expression of mCherry in cholinergic neurons in the basal forebrain region following retrograde AAV injection in the LC64. This is somewhat unexpected considering the presence of cholinergic axons in the LC area65 and many previous retrograde/anterograde tracing studies reporting axonal projections from the basal forebrain to the LC region39,40. One possibility is that the overserved cholinergic axons in the LC do not originate from cholinergic neurons in the basal forebrain. In support of this concept, we observed co-localization of mCherry expression and anti-ChAT signals in the trigeminal motor nucleus (V), the pontine reticular nucleus (PRN), and the superior cerebellar peduncle (SCP)/Red nucleus (RN) area66. Previous work has shown projections from PRN to the LC44. Although the functional consequence of this cholinergic modulation of LC activity remains unclear, it could account for the slowdown of reaction time when DREADD-mediated inhibitions silenced neurons in these motor function related nuclei. Although the inhibition of these cholinergic neurons did not appear to disrupt inhibitory control functions, future work is warranted to explore the anatomy and function of these microcircuits.
Although we did not find direct projections from cholinergic neurons in the BF to the LC, it does not necessarily mean an absence of BF influence on LC activity. Cholinergic neurons in the basal forebrain could indirectly influence LC. In addition to cholinergic neurons, the basal forebrain contains two other distinct types of neurons, i.e. glutamatergic, and GABAergic67. It has been reported that basal forebrain cholinergic neurons that project to the prefrontal cortex have extensive local collaterals arborizing on other non-cholinergic neurons within the basal forebrain, suggesting that these neurons make local synaptic connections67,68. Agostinelli et al.69 performed Cre-dependent anterograde tracing to investigate the targets of axonal projection of cholinergic, glutamatergic, and GABAergic neurons of the basal forebrain. Interestingly, in agreement with our data, they also failed to observe projections to the LC from cholinergic neurons in the BF area. However, they identified light projections from BF glutamatergic neurons to the LC while BF GABAergic neurons sent out moderate projection to the LC. Therefore, BF cholinergic neurons projecting to the prefrontal cortex may influence the LC through disynaptic connections to the LC. It would be intriguing to use anterograde polysynaptic viral tracers to reveal the possible neural circuitry through which BF cholinergic neurons affect the noradrenergic neurons in the LC.
Consistent with previous findings showing the causal relationship between LC activation and pupil dilation33,35, we found a positive correlation between pupil size fluctuations and NE dynamics during inhibitory control. We also observed a positive correlation between pupil size and ACh signals32. This could be because LC activity not only activates the BF but also dilates pupil, or due to a possible causal relationship between BF activation and pupil size. Our results showed that their relationship with pupil size was about the same between the successful and failed trials for NE and ACh signals. Interestingly, the NE-ACh synchrony has a positive relationship with pupil size in the failed trials but has no relationship with pupil size in the successful trials. This suggested that the relationship between the NE-ACh phase synchrony is behavioral context dependent and may be gated by other cognitive-related signals. Previous work has established the causal relationship between phasic DRN activation and pupil dilation70. The serotonergic system has also been implicated in impulsivity control6,71. Future investigations are needed to explore the dynamic relationship between pupil dilation and the collective activity of different neuromodulatory systems72–75.
Methods
All experimental procedures were approved by the Columbia University Institutional Animal Care and Use Committee (IACUC) and were conducted in compliance with NIH guidelines. Adult mice of both sexes (17 males and 13 females), aged 3 ~ 7 months, were used in the experiments. All mice were kept under a 12-hour light-dark cycle.
Surgical procedures
Animals were anesthetized with isoflurane in oxygen (5% induction, 2% maintenance) and fixed in a stereotaxic frame. Body temperature was maintained at 36.6 ℃ using a feedback-controlled heating pad (FHC, Bowdoinham, ME). Once the animal’s condition stabilized and before an incision was made on the scalp, lidocaine hydrochloride and buprenorphine (0.05 mg/kg) were administered subcutaneously to ensure analgesics were on board during the whole surgery. At the conclusion of the surgery, Baytril (5 mg/kg) and Ketoprofen (5 mg/kg) were administered. Four additional doses of Baytril and two additional doses of Ketoprofen were provided every 24 hours after the surgery day. Animals’ weight was measured at least once per day for 5 days.
For all adeno-associated viral vector (AAV) injections, we first leveled the animal’s head by ensuring that the left and right z coordinates for the lateral scalp were within +/− 0.04 mm and the z coordinate of lambda was within +/− 0.06 mm of bregma. Burr holes were then made to target multiple brain regions, and saline was applied to each craniotomy to prevent exposed brain surface from drying out. Pulled capillary glass micropipettes (Drummond Scientific, Broomall, PA) were back-filled with AAV solution and injected into the target brain regions at 0.8nL/s using a precision injection system (Nanoliter 2020, World Precision Instruments, Sarasota, FL). The micropipette was left in place for at least 10 minutes following each injection and then slowly withdrawn. To measure NE and ACh dynamics during inhibitory control, GRABNE (AAV9-hSyn-NE2h) and GRABACh (AAV9-hsyn-Ach4.3) AAVs were injected into one of the four regions (prefrontal cortex, PFC, AP: +2.3 mm, ML: 1.2 mm, DV: −2 mm; parietal cortex, PPC, AP: −2.1 mm, ML: 1.85 mm, DV: −0.5 mm; primary somatosensory cortex, S1, AP: −0.5 mm, ML: 3.4 mm, DV: −0.65 mm; thalamus, Thm, AP: −1.9 mm, ML: 1.7 mm, DV: −3.4 mm) of both hemispheres (240 nL each AAV, one AAV per hemisphere, randomly assigned, GRABNE was in the right hemisphere in 15 of 27 mice). For chemogenetic manipulation of noradrenergic and/or dopaminergic neurons that project to the basal forebrain region, retrograde AAV encoding inhibitory DREADD receptors (AAVrg-hSyn-DIO-hM4D(Gi)-mCherry, 300 nL each hemisphere), was injected bilaterally into the basal forebrain region (AP: −0.5 mm, ML: 1.8 mm, DV: −4.2 mm) in Dbh-Cre mice (RRID: IMSR_JAX:033951)76. For chemogenetic manipulation of cholinergic neurons that project to the LC region, the same retrograde AAV (300 nL each hemisphere)) was injected bilaterally into the LC region (AP: −5.5 mm, ML: 0.85 mm, DV: −3 mm) in ChAT-Cre mice (RRID: IMSR_JAX:031661).
Following each of GRABNE and GRABAch biosensor injections, an optical fiber (200 μm diameter & NA = 0.39 in 23 mice or 100 μm diameter & NA = 0.22 in 4 mice; RWD Life Science, San Diego, CA) was implanted with the tip of the fiber placed approximately 0.15 mm above the injection site. Bilateral optical fibers were inserted either vertically into S1 or at an 8° angle ML into PFC, PPC and thalamus in order to create the space necessary for mounting the sleeve onto the fiber ferrules during the recordings. C&B Metabond (Parkell Inc., Edgewood, NY) was used to build a headcap to bond the fibers and a headbar. The ferrules as well as the headplate were cemented in place with dental acrylic (Prime Dental Manufacturing, Chicago, IL). Fiber photometry recording was performed 3 weeks following surgery to allow enough time for viral expression.
For Neuropixels implantation, prior to implantation, the Neuropixels 1.0 probes were mounted on a 3D-printed headcap77 and the shank of the probe was stained with a solution of DiI to allow for post-mortem track localization. Mice were injected with dexamethasone (2 mg/kg, subcutaneously 2 hours before surgery to reduce swelling during surgery. After mice were anesthetized and head was leveled, a small craniotomy (1 mm diameter) was drilled over the PFC (AP: +2.3 mm, ML: 0.65 mm, DV: −2.0 mm, left PFC for 2 mice and right PFC for 1 mice). A burr hole for ground pin was also made over the occipital lobe and skull surface was roughed by scraping grids using the drill bits. Following the removal of dura at the craniotomy, probes were lowered to the targeting depth at 20 μm/min. After the implantation, the craniotomy was covered with bone wax, with a headcap and head bar cemented to the skull. The ground wire of the headcap was subsequently connected to the ground pin. Behavioral training was performed at least a week following surgery to allow for enough time for the animal to recover.
Chemogenetic inactivation
Clozapine N-oxide (CNO, 1mg/kg) (Hello Bio, Cat #: HB6149) or Deschloroclozapine (DCZ, 0.02 mg/kg) (Hello Bio, Cat #: HB9126) dissolved in saline was injected intraperitoneally (i.p.) into the corresponding Cre mice to inactivate hM4D(Gi)-expressing neurons in the target region. Saline of equivalent volume was administered as a control. Each behavioral session started 15 minutes after injection. For each animal, days of saline or CNO administration were randomly interleaved.
Histology
At the end of the study, mice were transcardially perfused with PBS followed immediately by ice-cold 4% paraformaldehyde. The brain was removed carefully and post-fixed overnight at 4 °C in 4% paraformaldehyde, and then cryopreserved in a 30% sucrose (wt/vol) in PBS solution for 3 days at 4 ℃. Brains were embedded in Optimum Cutting Temperature Compound, and 30-μm coronal slices were sectioned using a cryostat. Brain slices were washed 4x in PBS and then incubated in 10% normal goat serum contained with 0.5% Triton X-100 in PBS for 2 hours. This was followed by primary antibody incubation overnight at room temperature using either a chicken anti-GFP primary antibody (1:500), or a mixture of chicken anti-TH (1:500) and rabbit anti-ChAT (1:300) primary antibodies. On the next day, slices were washed 3x in PBS + Tween (0.0005%) solution followed by secondary antibody incubation for 2 hours at room temperature using an Alexa Fluor 488-conjugated goat anti-chicken (1:800), or a mixture of Alexa Fluor 647-conjugated goat anti-rabbit (1:500) and Alexa Fluor 488-conjugated goat anti-chicken (1:800). The slices were then washed 3x in PBS + Tween solution and 1x with PBS only followed by coverslipping using Fluoromount-G medium with DAPI. Slices were imaged using 8X objective in a high-throughput slide scanner (Nikon AZ100) for further processing. Selected example slices were imaged using 20X under a confocal microscope (Nikon Ti2) with a spinning disk (Yokogawa CSU-W1).
Behavioral task
During the behavioral training, mice were water-deprived. During the inhibitory control task, sweetened water (10% sucrose in deionized water) was used as rewards. The weight of each animal was tracked daily, and water supplements were provided after the daily training session to maintain their weight. During non-training days, animals were given ad libitum access to plain water.
During the behavioral task, the mouse was head-fixed and sat in an acrylic tube in a custom-made apparatus78. Water rewards were delivered through a stainless steel feeding needle (FNS-22–1.5–2, Kent Scientific) placed ~3mm posterior to the tip of the nose and ~1mm below the lower lip. A capacitance touch sensor (AT42QT, SparkFun) was connected to the water spout to detect licks. Inhibition tone (4 kHz, 65 dB) was generated with an Arduino Mega 2560 microcontroller, sent to an audio amplifier, and played via a speaker placed 25 cm from the animal. Punishment air puffs were delivered through a 16-gauge stainless-steel tube placed approximately 8 cm from the animal’s cheek and was contralateral to the pupil camera. Control of the behavioral experiment and sampling of animals’ behavioral responses were performed by custom-programmed software running on a MATLAB xPC target real-time system (Mathworks, Natick, MA). All behavioral data was sampled at 1 kHz and logged for offline analyses.
During the shaping period, mice first went through a water-association phase during which the animals learned to lick from the water spout to collect sweetened water delivered with a random interval (12 to 22 s uniform distribution). The animal advanced to the phase 2 once it licked for >75% of water deliveries.
During the phase 2, the animals had a free period (5 to 7 s uniform distribution) at the beginning of each trial, in which licking did not result in any punishment. After the free period, an inhibition tone (4 kHz, 65 dB) was played for a random period (2 to 5 s, exponential distribution, λ=1.5), during which any lick would immediately terminate the inhibition tone and trigger three low intensity air puffs (10 psi, 20 ms, 200 ms inter-puff-interval) to their cheek as a punishment. In the case where the animals withheld their licks throughout the inhibition tone, a drop of sweetened water (~6 μL) was immediately delivered after tone ended as a reward. Because rodents usually collect water rewards within 0.8 s79, the trial was considered as a successful trial if animal licked to collect the reward within 1 s (an exclusion threshold of 0.75 s or 1.25 s resulted in similar results). The trials where the animals collected water rewards outside the window of opportunity of 1 s (6% trials) were excluded from further analysis. An inter-trial period of 7 to 10 s (uniform distribution) was added to the end of each trial. Animals advanced to the full inhibitory control task once they reached a >50% success rate for at least 2 consecutive days in the Phase 2 task.
The full inhibitory control task was similar to the phase 2 task, except a longer inhibition tone (5 to 12 s exponential distribution, λ=4.5, Figure 2a) and more severe punishment (an air puff of 20 psi for 200 ms) for the failed trials. Animals were considered as proficient when their behavioral performance had been above the chance-level success rate (see details in Behavior analysis section) for at least 3 consecutive days. Animals whose behavioral performance was not significantly greater than the chance level were excluded from further analyses (N=1). Across all 30 animals, 404 sessions (a total of 47,075 trials) were recorded. Fiber photometry were recorded in 27 animals and Neuropixels recordings were made in 3 animals.
Neuropixels recording
Recordings from Neuropixels probes were acquired using an NI Neuropixels recording system controlled by SpikeGLX (Release v20230905-phase30). The NI recording system was synchronized with the behavioral apparatus via TTLs generated by the xPC real-time system.
Fiber photometry recordings and preprocessing
Fluorescence signals mediated by the GRABNE and GRABACh sensors were recorded using a 2-channel fiber photometry system (Doric Lenses). For the recording of each sensor, excitation lights with 465 nm and 405 nm wave lengths were generated by LEDs (CLED_465 and CLED_405, Doric Lenses) and passed through a MiniCube (iFMC4_AE (405)E(460–490)_F(500–550)_S, Doric Lenses). Emission fluorescence from the GRABNE and GRABACh sensors was measured by an integrated PMT detector in the MiniCube. The fiber photometry recordings were run in a ‘Lock-in’ mode controlled by Doric Neuroscience Studio (V5.4.1.12), where the intensity of the four excitation lights were modulated at frequencies of 208.62 Hz, 572.21 Hz, 333.79 Hz, and 470.88 Hz, respectively, to avoid contamination from other light sources in the room and crosstalk between the excitation lights. The demodulated signal processed by the Doric fiber photometry console was low-pass filtered at 25 Hz and sampled at 12 kHz. The fiber photometry system was synchronized with the behavioral apparatus through TTLs generated by the xPC target real-time system (MathWorks, Massachusetts). All photometry data were decimated to 120 Hz by Doric Neuroscience Studio software and saved for offline analysis. Since we are interested in NE and ACh dynamics during the inhibitory control periods (average duration of the inhibition tones = 7.6 s), fluorescence signals were first high-pass filtered (cutoff frequency, 0.1 Hz) to remove the low frequency oscillations and then used to calculate NE and ACh dynamics during the inhibitory control.
Pupillometry
Pupil recordings were obtained using a custom pupillometry system80. The camera was triggered by 10 Hz TTLs from the xPC target real-time system. Pupil images were streamed to a high-speed solid-state drive for offline analysis. For each video clip, a region of interest (ROI) was manually selected initially. The DeepLabCut toolbox was used to segment the pupil contour81. Training sets were created, consisting of 450 frames for video clips with a resolution of 800*600 pixels or 160 frames for video clips with the resolution of 1280*1080 pixels. Within each frame, 12 points around the pupil were manually labeled, and cropping parameters were adjusted to enhance training accuracy. The mobilenet_v2_0.75 deep network was trained on each frame and employed for the analysis of video clips from all sessions. Circular regression was then applied to fit the automatically labeled points, enabling the computation of pupil size based on the fitted contour. To ensure segmentation accuracy, approximately 5% of segmented images were randomly selected and inspected. Pupil size during periods of blinks was estimated through interpolation, using pupil sizes just before and after blinks. If DeepLabCut could not recognize pupil contour due to either poor video quality or animal’s eyelid covering a significant portion of pupil in >33% of the recorded video frames, the session was excluded from pupillometry analysis. Prior to further analysis, a fourth-order non-causal low-pass filter with a cutoff frequency of 3.5 Hz was applied to the pupil size data33,35.
Data analysis
All data analyses were first conducted on individual sessions. Grand averages and standard errors of means were then calculated across sessions or animal subjects for analysis and visualization. For each session, the first trial was excluded due to the time required for experimenter to leave the behavioral training room.
Behavior.
To measure the effect of inhibitory control on suppressing impulsive licking, we normalized experimentally-measured success rate with chance-level success rate. The chance-level success rate for each animal was determined via Monte-Carlo simulations based on the animal’s baseline behavior (all sessions for WT mice (C57BL6/J, RRID: IMSR_JAX:000664) and the saline sessions for transgenic mice). In these sessions, the time stamp of licks from 7 s after the behavioral outcome of the current trial to inhibition tone onset of the next trial was used to calculate the distribution of the baseline inter-lick-intervals. As such, licks in response to water rewards/punishment were excluded from the assessment of baseline inter-lick-interval distribution. For each simulated trial, the duration of the inhibition tone was drawn from an exponential distribution from 5 to 12 s with λ=4.5, the same distribution used in the full inhibitory control task. A baseline lick sequence was simulated using the estimated baseline inter-lick-interval distributions. If a lick was detected during the inhibition tone period, a failure trial was recorded. Otherwise, a successful trial was logged. Each simulated session comprised 100 trials and chance-level success rate was calculated by averaging across 10 simulated sessions for each animal.
For each animal, normalized performance for each experimental session was calculated as below:
Reaction times were computed as the time from water reward onset, which marked the beginning of the window of opportunity, until the first lick response for collecting the water reward. Reaction times were only computed for successful trials.
Frequency analysis.
For each session, NE and ACh signals were z-scored and the one-sided Power Spectral Density (PSD) was computed using a Hamming window with a segment overlap of 50%, employing the MATLAB built-in function pspectrum was computed. For Figure 1f, spectrum was first normalized to the power at 0.1 Hz for each session and then averaged across sessions82.
Cross-correlation analysis.
To calculate the cross-correlogram between pupil size and NE/ACh signals, NE and ACh signals were first low-pass filtered (cutoff frequency 5 Hz) then down-sampled at 10 Hz (i.e. pupillometry frequency). Pupil size, NE and ACh signals were z-scored, and MATLAB built-in function xcorr was then used to calculate the cross-correlation between them. Confidence intervals were estimated by repeatedly (100 times) calculating cross-correlation between one original signal and a shuffled version of another signal and then calculating the 0.15th and 99.85th percentiles across all the repetitions to generate a 99.7% confidence interval.
Coherence analysis.
To examine how closely NE and ACh interact with each other over different frequency bands, we computed coherence using a custom MATLAB script adapted from a library from the Buzsaki laboratory (chronux, https://github.com/buzsakilab/buzcode)83. The NE-ACh coherence was calculated using the function cohgramc in a multi-taper manner (window, 11s; overlap, 5s; step, 6s; number of tapers, 8; padding, 0) for each session, and then averaged across sessions. Because the toolbox requires an alignment of recorded data, we used first 1500 s of each recording to calculate coherence. The confidence intervals were estimated by repeatedly calculating coherence between shuffled signals for each session.
Phase relationship with pupil.
To evaluate the phase relationship between NE/ACh signals and pupil fluctuations, we aligned the amplitude of NE or ACh signals to different binned phases (36 bins from −180° to 180°, 10° per bin) of a canonical cycle of pupil fluctuation32. To achieve this, we first band-pass filtered (cutoff frequencies 0.1 and 1Hz) the pupil signal and calculated its instantaneous phase angles using Hilbert transform for each session. Subsequently, we identified the phase of pupil signals at each time point and then averaged NE/ACh signals aligned with each bin of the pupil phase.
Phase synchrony between NE and ACh.
To examine the phase interplay between NE and ACh over time, instantaneous phase synchrony38 between the two signals was calculated. For each session, each photometry signal was first band-pass filtered (cutoff frequencies, 0.4 and 0.8 Hz; Butterworth; order 2) and z-scored. Hilbert phase angles were then extracted and wrapped into [−180, 180] degrees. The instantaneous phase synchrony was calculated as follows38:
where φNE(t) and φACH(t) are instantaneous phases of NE and ACh respectively. A second-order non-causal low-pass filter with a cutoff frequency of 4 Hz was used to de-noise the calculated phase synchrony of each session prior to further analyses. Phase synchrony of 1 indicates |φNE(t) − φACH(t)| = 0 and thus indicates the NE and ACh oscillations are in-phase. On the contrary, phase synchrony of 0 indicates |φNE(t) − φACH(t)| 180° and thus indicates the NE and ACh oscillations are out-of-phase (Figure 4a).
To quantify the number of switching of NE-ACh relationship from in-phase to out-of-phase, we applied Hilbert transform to phase synchrony for each session and counted the number of phase wrapping points as the number of the switching (Figure 4a). Phase synchrony prior to behavioral outcomes were averaged using a 2-s moving window with a 0.5 s step. Switching rate prior to the behavioral outcomes were estimated by first counting the number of switching event within a 2-s window then the switching rate was smoothed using a Gaussian window with a SD of 0.25.
Temporal response function (TRF) analysis.
We applied TRFs estimation (mTRF-Toolbox v2.3, MATLAB R2018a)45 to characterize the transform relationship from NE/ACh/NE-ACh phase synchrony to pupil size. Here, pupil size was modeled in a forward direction by convolving the TRF kernel with other signals. The model equation reads as follows:
where {p}t represents the pupil size, {s}t represents NE, ACh or NE-ACh phase synchrony, and {β}τ represents the TRF; {Ɛ}t is the residual response accounting for the noise not explained by the model. Therefore, the weights in β(τ) characterize the transformation of NE, ACh, or NE-ACh phase synchrony to pupil size for a range of time lags τ.
The weights of TRF were estimated by minimizing the mean-squared error (MSE) between the measured pupil traces and those reconstructed by the convolution for each trial. Tikhonov regularization was applied to avoid overfitting84
where β and P are vectors of TRF weights and pupil size traces, S is the design matrix containing the time lagged signals related to neurotransmitters, I is the identity matrix and λ is the regularization parameter. Leave-one-out-cross-validation (LOOCV) was conducted on the traces for each trial to identify the optimal λ. MSEs resulted from different λ values were averaged across left-out folds and the finalized β of the current trial was obtained from parameters corresponding to the minimum MSE.
For estimating TRFs during inhibitory control, periods from inhibition tone onset to outcome of each trial were chosen. For estimating TRFs during lick-free period, periods from 5s prior to trial onset to inhibition tone onset of each trial were used. TRF of each session was obtained by averaging weights across trials from each of the two behavioral outcome types.
Receiver Operating Characteristics (ROC) analysis.
We applied the signal detection theory to examine the discriminability between physiological signals associated with the failed and successful trials37,85. For each session, NE or ACh signals within a 2-s period from 3s to 1s prior to the behavioral outcome across trials were used for the ROC analysis. At each time point, the signal distributions associated with the failed or successful trials was constructed and an ROC curve was created based on the distributions. In our case, the ROC curve expresses the two probabilities as follows:
To evaluate the overall discriminability, the area under the ROC curve (AUROC) was calculated for each time point and averaged across sessions (240 time points in total).
Neuropixels data analysis.
Spikes from electrophysiological data of each recording session were automatically detected using KiloSort 3. Units labeled as ‘noise’ by the automatic spike-sorting were discarded. The spike data were then manually curated using the open-source package Phy (https://github.com/kwikteam/phy). Only units labeled as ‘good’ by the automatic spike-sorting and manual curation were included in further analysis. For the identification of regular spiking units (RSUs) and fast spiking units (FSUs), we chose the width (full-width half maximum of the post-hyperpolarization peak) and the trough to peak duration86 of action potentials (AP) as our waveform features, and performed a Gaussian mixture model (GMM) hard clustering in the two-dimensional feature plane.
Because we were interested in neurons that may contribute to the cognitive control of impulsivity, we analyzed only those neurons that were active (with a firing rate > 1 Hz) during the inhibitory control task. Encoding cells were defined as neurons that exhibited a significant difference in firing rate between successful and failed trials. The significance of this difference was evaluated using a paired statistical test, with a p-value set to 0.05 divided by the number of total cells in the session (i.e., Bonferroni multiple comparison correction). Action-predicting cells were defined as neurons whose firing rate was greater than 2 standard deviations above the mean firing rate within 0.3 seconds before the behavioral outcome (i.e., licking) in failed trials.
As we are interested in the correlation structure across prefrontal neurons during inhibitory control, we used the spikes recorded within 5 seconds before behavioral outcomes to calculate the cross-correlogram. The pairwise cross-correlogram was calculated by averaging the cross-correlogram across all cell pairs. We then subtracted a shuffled cross-correlogram, computed using spikes from cell pairs in randomly shuffled trials87 from this raw cross-correlogram. This shuffling process was repeated 100 times to estimate the final shuffle-corrected cross-correlogram.
Demixed PCA analysis.
To further characterize prefrontal neuronal population activity structure over the period prior to behavioral outcomes, we employed demixed PCA analysis. We chose dPCA over traditional PCA analysis as it allows the decomposed components to capture the maximum variance in neural population activity explained by task-related variables41. In our study, dPCA decomposes the raw population neural activities into the following marginalization:
where X is an N×D×T×K matrix containing firing rates of individual neurons within 1 to 5 seconds before the behavioral outcome in individual trials calculated using 50-ms windows. N is the number of active neurons, D is the number of inhibitory control outcomes, T is the number of time points, and K is the number of trials (for an outcome with a fewer number of trials, NaNs were assigned to the empty entries). Xt corresponds to the time effect (the Independent component in Figure 6c) with N×T entries replicated D×K times. Xtd corresponds to the cognitive control effect (the Inhibitory control component in Figure 6c) with N×T×D entries replicated K times. Xnoise represents the noise. The loss function is given by:
where Xϕ is a specific decomposition, and Fϕ and Dϕ are the encoder and decoder matrix of that decomposition, respectively.
dPCA analysis was performed using a custom script employing functions in the dPCA package (https://github.com/machenslab/dPCA) with default parameters. We computed in total 20 dPCs for each session and retained the top 3 dPCs of both ‘Independent’ and ‘Inhibitory control’ decomposition. The population firing activities were then projected onto the respective dPC decoder axis with the resulting projections being averaged across sessions. To quantify the difference in neural population dynamics between trials of different outcomes, we calculated the Mahalanobis distance in the dPCA space between population dynamics prior to success and failure88. For visualizing session trajectory of population dynamics in the dPCA space, the projected trace along each dPC axis was smoothed using a 500-ms moving window. This smoothing was for visualization only and not for quantitative analysis.
Statistics
All statistical tests were two-sided. A one-sample Kolmogorov–Smirnov test was used to assess the normality of data before performing statistical tests. If the samples were normally distributed, a paired or unpaired t-test was used. Otherwise, the two-sided Mann–Whitney U-test was used for unpaired samples or the two-sided Wilcoxon signed-rank test for paired samples. Bonferroni correction was used for multiple comparisons. No statistical methods were used to predetermine sample sizes, but our sample sizes are similar to those in previous reports and are typical for the field. Randomization of inhibition tone duration and simulation was generated by using MATLAB random number generators. Data collection and analysis were not performed blind to the conditions of the experiments.
Supplementary Material
Funding
This work was supported by NIH R01NS119813, R01MH112267, R01AG075114, and the Air Force Office of Scientific Research under award number FA9550-22-1-0337.
Funding Statement
This work was supported by NIH R01NS119813, R01MH112267, R01AG075114, and the Air Force Office of Scientific Research under award number FA9550-22-1-0337.
Footnotes
Disclaimer
Q.W. is the co-founder of Sharper Sense.
References
- 1.Dalley J.W., and Ersche K.D. (2019). Neural circuitry and mechanisms of waiting impulsivity: relevance to addiction. Philos Trans R Soc Lond B Biol Sci 374, 20180145. 10.1098/rstb.2018.0145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Dalley J.W., and Robbins T.W. (2017). Fractionating impulsivity: neuropsychiatric implications. Nature Reviews Neuroscience 18, 158–171. 10.1038/nrn.2017.8. [DOI] [PubMed] [Google Scholar]
- 3.Tomassini A., Hezemans F.H., Ye R., Tsvetanov K.A., Wolpe N., and Rowe J.B. (2022). Prefrontal Cortical Connectivity Mediates Locus Coeruleus Noradrenergic Regulation of Inhibitory Control in Older Adults. The Journal of Neuroscience 42, 3484. 10.1523/JNEUROSCI.1361-21.2022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Terra H., Bruinsma B., de Kloet S.F., van der Roest M., Pattij T., and Mansvelder H.D. (2020). Prefrontal Cortical Projection Neurons Targeting Dorsomedial Striatum Control Behavioral Inhibition. Current Biology 30, 4188–4200.e4185. 10.1016/j.cub.2020.08.031. [DOI] [PubMed] [Google Scholar]
- 5.Miller E.K., and Cohen J.D. (2001). An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24, 167–202. 10.1146/annurev.neuro.24.1.167. [DOI] [PubMed] [Google Scholar]
- 6.Fonseca Madalena S., Murakami M., and Mainen Zachary F. (2015). Activation of Dorsal Raphe Serotonergic Neurons Promotes Waiting but Is Not Reinforcing. Current Biology 25, 306–315. 10.1016/j.cub.2014.12.002. [DOI] [PubMed] [Google Scholar]
- 7.Chamberlain S.R., del Campo N., Dowson J., Müller U., Clark L., Robbins T.W., and Sahakian B.J. (2007). Atomoxetine Improved Response Inhibition in Adults with Attention Deficit/Hyperactivity Disorder. Biological Psychiatry 62, 977–984. 10.1016/j.biopsych.2007.03.003. [DOI] [PubMed] [Google Scholar]
- 8.Robinson E.S.J., Eagle D.M., Mar A.C., Bari A., Banerjee G., Jiang X., Dalley J.W., and Robbins T.W. (2008). Similar Effects of the Selective Noradrenaline Reuptake Inhibitor Atomoxetine on Three Distinct Forms of Impulsivity in the Rat. Neuropsychopharmacology 33, 1028–1037. 10.1038/sj.npp.1301487. [DOI] [PubMed] [Google Scholar]
- 9.Sabandal P.R., Saldes E.B., and Han K.A. (2022). Acetylcholine deficit causes dysfunctional inhibitory control in an aging-dependent manner. Sci Rep 12, 20903. 10.1038/s41598-022-25402-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ohmura Y., Tsutsui-Kimura I., and Yoshioka M. (2012). Impulsive behavior and nicotinic acetylcholine receptors. J Pharmacol Sci 118, 413–422. 10.1254/jphs.11r06cr. [DOI] [PubMed] [Google Scholar]
- 11.O’Callaghan C., Hezemans F.H., Ye R., Rua C., Jones P.S., Murley A.G., Holland N., Regenthal R., Tsvetanov K.A., Wolpe N., et al. (2021). Locus coeruleus integrity and the effect of atomoxetine on response inhibition in Parkinson’s disease. Brain 144, 2513–2526. 10.1093/brain/awab142. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Betts G.D., Hynes T.J., and Winstanley C.A. (2021). Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task. Journal of Psychopharmacology 35, 701–712. 10.1177/0269881120972421. [DOI] [PubMed] [Google Scholar]
- 13.Slater C., Liu Y., Weiss E., Yu K., and Wang Q. (2022). The Neuromodulatory Role of the Noradrenergic and Cholinergic Systems and Their Interplay in Cognitive Functions: A Focused Review. Brain Sciences 12. 10.3390/brainsci12070890. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Maness E.B., Burk J.A., McKenna J.T., Schiffino F.L., Strecker R.E., and McCoy J.G. (2022). Role of the locus coeruleus and basal forebrain in arousal and attention. Brain Res Bull 188, 47–58. 10.1016/j.brainresbull.2022.07.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Gritton H.J., Howe W.M., Romano M.F., DiFeliceantonio A.G., Kramer M.A., Saligrama V., Bucklin M.E., Zemel D., and Han X. (2019). Unique contributions of parvalbumin and cholinergic interneurons in organizing striatal networks during movement. Nature Neuroscience 22, 586–597. 10.1038/s41593-019-0341-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Sara Susan J., and Bouret S. (2012). Orienting and reorienting: the locus coeruleus mediates cognition through arousal. Neuron 76, 130–141. 10.1016/j.neuron.2012.09.011. [DOI] [PubMed] [Google Scholar]
- 17.Poe G.R., Foote S., Eschenko O., Johansen J.P., Bouret S., Aston-Jones G., Harley C.W., Manahan-Vaughan D., Weinshenker D., Valentino R., et al. (2020). Locus coeruleus: a new look at the blue spot. Nat Rev Neurosci 21, 644–659. 10.1038/s41583-020-0360-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Jordan R., and Keller G.B. (2023). The locus coeruleus broadcasts prediction errors across the cortex to promote sensorimotor plasticity. eLife 12, RP85111. 10.7554/eLife.85111.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Liu K.Y., Kievit R.A., Tsvetanov K.A., Betts M.J., Düzel E., Rowe J.B., Tyler L.K., Brayne C., Bullmore E.T., Calder A.C., et al. (2020). Noradrenergic-dependent functions are associated with age-related locus coeruleus signal intensity differences. Nature Communications 11, 1712. 10.1038/s41467-020-15410-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rodenkirch C., Liu Y., Schriver B.J., and Wang Q. (2019). Locus coeruleus activation enhances thalamic feature selectivity via norepinephrine regulation of intrathalamic circuit dynamics. Nature Neuroscience 22, 120–133. 10.1038/s41593-018-0283-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Grella S.L., Neil J.M., Edison H.T., Strong V.D., Odintsova I.V., Walling S.G., Martin G.M., Marrone D.F., and Harley C.W. (2019). Locus Coeruleus Phasic, But Not Tonic, Activation Initiates Global Remapping in a Familiar Environment. The Journal of Neuroscience 39, 445. 10.1523/JNEUROSCI.1956-18.2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Glennon E., Carcea I., Martins A.R.O., Multani J., Shehu I., Svirsky M.A., and Froemke R.C. (2019). Locus coeruleus activation accelerates perceptual learning. Brain Research 1709, 39–49. 10.1016/j.brainres.2018.05.048. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Breton-Provencher V., and Sur M. (2019). Active control of arousal by a locus coeruleus GABAergic circuit. Nature Neuroscience 22, 218–228. 10.1038/s41593-018-0305-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Wagatsuma A., Okuyama T., Sun C., Smith L.M., Abe K., and Tonegawa S. (2018). Locus coeruleus input to hippocampal CA3 drives single-trial learning of a novel context. Proceedings of the National Academy of Sciences 115, E310. 10.1073/pnas.1714082115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Vazey E.M., Moorman D.E., and Aston-Jones G. (2018). Phasic locus coeruleus activity regulates cortical encoding of salience information. Proceedings of the National Academy of Sciences 115, E9439. 10.1073/pnas.1803716115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Pinto L., Goard M.J., Estandian D., Xu M., Kwan A.C., Lee S.H., Harrison T.C., Feng G., and Dan Y. (2013). Fast modulation of visual perception by basal forebrain cholinergic neurons. Nat Neurosci 16, 1857–1863. 10.1038/nn.3552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Cools R., and Arnsten A.F.T. (2022). Neuromodulation of prefrontal cortex cognitive function in primates: the powerful roles of monoamines and acetylcholine. Neuropsychopharmacology 47, 309–328. 10.1038/s41386-021-01100-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Picciotto M.R., Higley M.J., and Mineur Y.S. (2012). Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior. Neuron 76, 116–129. 10.1016/j.neuron.2012.08.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Rho H.J., Kim J.H., and Lee S.H. (2018). Function of Selective Neuromodulatory Projections in the Mammalian Cerebral Cortex: Comparison Between Cholinergic and Noradrenergic Systems. Front Neural Circuits 12, 47. 10.3389/fncir.2018.00047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Yu A.J., and Dayan P. (2005). Uncertainty, neuromodulation, and attention. Neuron 46, 681–692. 10.1016/j.neuron.2005.04.026. [DOI] [PubMed] [Google Scholar]
- 31.Decker M.W., and McGaugh J.L. (1991). The role of interactions between the cholinergic system and other neuromodulatory systems in learing and memory. Synapse 7, 151–168. 10.1002/syn.890070209. [DOI] [PubMed] [Google Scholar]
- 32.Reimer J., McGinley M.J., Liu Y., Rodenkirch C., Wang Q., McCormick D.A., and Tolias A.S. (2016). Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex. Nature Communications 7, 13289. 10.1038/ncomms13289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Liu Y., Rodenkirch C., Moskowitz N., Schriver B., and Wang Q. (2017). Dynamic Lateralization of Pupil Dilation Evoked by Locus Coeruleus Activation Results from Sympathetic, Not Parasympathetic, Contributions. Cell reports 20, 3099–3112. 10.1016/j.celrep.2017.08.094. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Chamberlain S.R., and Robbins T.W. (2013). Noradrenergic modulation of cognition: Therapeutic implications. Journal of Psychopharmacology 27, 694–718. 10.1177/0269881113480988. [DOI] [PubMed] [Google Scholar]
- 35.Joshi S., Li Y., Kalwani Rishi M., and Gold Joshua I. (2016). Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex. Neuron 89, 221–234. 10.1016/j.neuron.2015.11.028. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Neves R.M., van Keulen S., Yang M., Logothetis N.K., and Eschenko O. (2018). Locus coeruleus phasic discharge is essential for stimulus-induced gamma oscillations in the prefrontal cortex. J Neurophysiol 119, 904–920. 10.1152/jn.00552.2017. [DOI] [PubMed] [Google Scholar]
- 37.Wang Q., Webber R., and Stanley G.B. (2010). Thalamic Synchrony and the Adaptive Gating of Information Flow to Cortex. Nature Neuroscience 13, 1534–1541. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Pedersen M., Omidvarnia A., Zalesky A., and Jackson G.D. (2018). On the relationship between instantaneous phase synchrony and correlation-based sliding windows for time-resolved fMRI connectivity analysis. NeuroImage 181, 85–94. 10.1016/j.neuroimage.2018.06.020. [DOI] [PubMed] [Google Scholar]
- 39.Jones B.E., Halaris A.E., McIlhany M., and Moore R.Y. (1977). Ascending projections of the locus coeruleus in the rat. I. axonal transport in central noradrenaline neurons. Brain Research 127, 1–21. 10.1016/0006-8993(77)90377-8. [DOI] [PubMed] [Google Scholar]
- 40.Cedarbaum J.M., and Aghajanian G.K. (1978). Afferent projections to the rat locus coeruleus as determined by a retrograde tracing technique. J Comp Neurol 178, 1–16. 10.1002/cne.901780102. [DOI] [PubMed] [Google Scholar]
- 41.Kobak D., Brendel W., Constantinidis C., Feierstein C.E., Kepecs A., Mainen Z.F., Qi X.L., Romo R., Uchida N., and Machens C.K. (2016). Demixed principal component analysis of neural population data. Elife 5. 10.7554/eLife.10989. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Noei S., Zouridis I.S., Logothetis N.K., Panzeri S., and Totah N.K. (2022). Distinct ensembles in the noradrenergic locus coeruleus are associated with diverse cortical states. Proc Natl Acad Sci U S A 119, e2116507119. 10.1073/pnas.2116507119. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Uematsu A., Tan B.Z., Ycu E.A., Cuevas J.S., Koivumaa J., Junyent F., Kremer E.J., Witten I.B., Deisseroth K., and Johansen J.P. (2017). Modular organization of the brainstem noradrenaline system coordinates opposing learning states. Nature Neuroscience 20, 1602–1611. 10.1038/nn.4642. [DOI] [PubMed] [Google Scholar]
- 44.Schwarz L.A., Miyamichi K., Gao X.J., Beier K.T., Weissbourd B., DeLoach K.E., Ren J., Ibanes S., Malenka R.C., Kremer E.J., and Luo L. (2015). Viral-genetic tracing of the input-output organization of a central noradrenaline circuit. Nature 524, 88–92. 10.1038/nature14600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Crosse M.J., Di Liberto G.M., Bednar A., and Lalor E.C. (2016). The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli. Frontiers in Human Neuroscience 10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Meyer H.C., and Bucci D.J. (2016). Imbalanced Activity in the Orbitofrontal Cortex and Nucleus Accumbens Impairs Behavioral Inhibition. Curr Biol 26, 2834–2839. 10.1016/j.cub.2016.08.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Li B., Nguyen T.P., Ma C., and Dan Y. (2020). Inhibition of impulsive action by projection-defined prefrontal pyramidal neurons. Proc Natl Acad Sci U S A 117, 17278–17287. 10.1073/pnas.2000523117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Guzulaitis R., Godenzini L., and Palmer L.M. (2022). Neural basis of anticipation and premature impulsive action in the frontal cortex. Nat Neurosci 25, 1683–1692. 10.1038/s41593-022-01198-z. [DOI] [PubMed] [Google Scholar]
- 49.Kim S., and Lee D. (2011). Prefrontal cortex and impulsive decision making. Biol Psychiatry 69, 1140–1146. 10.1016/j.biopsych.2010.07.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Robbins T.W. (2002). The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology (Berl) 163, 362–380. 10.1007/s00213-002-1154-7. [DOI] [PubMed] [Google Scholar]
- 51.Kalwani R.M., Joshi S., and Gold J.I. (2014). Phasic Activation of Individual Neurons in the Locus Ceruleus/Subceruleus Complex of Monkeys Reflects Rewarded Decisions to Go But Not Stop. The Journal of Neuroscience 34, 13656–13669. 10.1523/jneurosci.2566-14.2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Narayanan N.S., and Laubach M. (2006). Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex. Neuron 52, 921–931. 10.1016/j.neuron.2006.10.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Amarante L.M., and Laubach M. (2021). Coherent theta activity in the medial and orbital frontal cortices encodes reward value. eLife 10, e63372. 10.7554/eLife.63372. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Bear M.F., and Singer W. (1986). Modulation of visual cortical plasticity by acetylcholine and noradrenaline. Nature 320, 172–176. 10.1038/320172a0. [DOI] [PubMed] [Google Scholar]
- 55.Mineur Y.S., Cahuzac E.L., Mose T.N., Bentham M.P., Plantenga M.E., Thompson D.C., and Picciotto M.R. (2018). Interaction between noradrenergic and cholinergic signaling in amygdala regulates anxiety- and depression-related behaviors in mice. Neuropsychopharmacology 43, 2118–2125. 10.1038/s41386-018-0024-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Moroni F., Tanganelli S., Antonelli T., Carla V., Bianchi C., and Beani L. (1983). Modulation of cortical acetylcholine and gamma-aminobutyric acid release in freely moving guinea pigs: effects of clonidine and other adrenergic drugs. Journal of Pharmacology and Experimental Therapeutics 227, 435. [PubMed] [Google Scholar]
- 57.Kruglikov R. (1982). On the interaction of neurotransmitter systems in processes of learning and memory. Neuronal plasticity and memory formation, 339–351. [Google Scholar]
- 58.Waterhouse B.D., Moises H.C., and Woodward D.J. (1981). Alpha-receptor-mediated facilitation of somatosensory cortical neuronal responses to excitatory synaptic inputs and iontophoretically applied acetylcholine. Neuropharmacology 20, 907–920. 10.1016/0028-3908(81)90020-4. [DOI] [PubMed] [Google Scholar]
- 59.Birch P.J., and Fillenz M. (1986). Muscarinic receptor activation inhibits both release and synthesis of noradrenaline in rat hippocampal synaptosomes. Neurochem Int 8, 171–177. 10.1016/0197-0186(86)90161-0. [DOI] [PubMed] [Google Scholar]
- 60.Sara S.J. (1989). Noradrenergic-cholinergic interaction: its possible role in memory dysfunction associated with senile dementia. Arch Gerontol Geriatr Suppl 1, 99–108. [PubMed] [Google Scholar]
- 61.Haring J.H., and Wang R.Y. (1986). The identification of some sources of afferent input to the rat nucleus basalis magnocellularis by retrograde transport of horseradish peroxidase. Brain Res 366, 152–158. 10.1016/0006-8993(86)91290-4. [DOI] [PubMed] [Google Scholar]
- 62.Martinez-Murillo R., Semenenko F., and Cuello A.C. (1988). The origin of tyrosine hydroxylase-immunoreactive fibers in the regions of the nucleus basalis magnocellularis of the rat. Brain Res 451, 227–236. 10.1016/0006-8993(88)90767-6. [DOI] [PubMed] [Google Scholar]
- 63.Orlando I.F., Shine J.M., Robbins T.W., Rowe J.B., and O’Callaghan C. (2023). Noradrenergic and cholinergic systems take centre stage in neuropsychiatric diseases of ageing. Neuroscience & Biobehavioral Reviews 149, 105167. 10.1016/j.neubiorev.2023.105167. [DOI] [PubMed] [Google Scholar]
- 64.Semba K., Reiner P.B., McGeer E.G., and Fibiger H.C. (1989). Brainstem projecting neurons in the rat basal forebrain: neurochemical, topographical, and physiological distinctions from cortically projecting cholinergic neurons. Brain Res Bull 22, 501–509. 10.1016/0361-9230(89)90102-0. [DOI] [PubMed] [Google Scholar]
- 65.Jones B.E. (1990). Immunohistochemical study of choline acetyltransferaseimmunoreactive processes and cells innervating the pontomedullary reticular formation in the rat. Journal of Comparative Neurology 295, 485–514. 10.1002/cne.902950311. [DOI] [PubMed] [Google Scholar]
- 66.Nieoullon A., Vuillon-Cacciuttolo G., Dusticier N., Kerkérian L., André D., and Bosler O. (1988). Putative neurotransmitters in the red nucleus and their involvement in postlesion adaptive mechanisms. Behav Brain Res 28, 163–174. 10.1016/0166-4328(88)90093-9. [DOI] [PubMed] [Google Scholar]
- 67.Do J.P., Xu M., Lee S.-H., Chang W.-C., Zhang S., Chung S., Yung T.J., Fan J.L., Miyamichi K., Luo L., and Dan Y. (2016). Cell type-specific long-range connections of basal forebrain circuit. eLife 5, e13214. 10.7554/eLife.13214. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Zaborszky L., and Duque A. (2000). Local synaptic connections of basal forebrain neurons. Behavioural Brain Research 115, 143–158. 10.1016/S0166-4328(00)00255-2. [DOI] [PubMed] [Google Scholar]
- 69.Agostinelli L.J., Geerling J.C., and Scammell T.E. (2019). Basal forebrain subcortical projections. Brain Struct Funct 224, 1097–1117. 10.1007/s00429-018-01820-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Cazettes F., Reato D., Morais J.P., Renart A., and Mainen Z.F. (2021). Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size. Curr Biol 31, 192–197.e194. 10.1016/j.cub.2020.09.090. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Miyazaki K., Miyazaki K.W., and Doya K. (2012). The role of serotonin in the regulation of patience and impulsivity. Mol Neurobiol 45, 213–224. 10.1007/s12035-012-8232-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Joshi S., and Gold J.I. (2020). Pupil Size as a Window on Neural Substrates of Cognition. Trends Cogn Sci 24, 466–480. 10.1016/j.tics.2020.03.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Strauch C., Wang C.-A., Einhäuser W., Van der Stigchel S., and Naber M. (2022). Pupillometry as an integrated readout of distinct attentional networks. Trends in Neurosciences 45, 635–647. 10.1016/j.tins.2022.05.003. [DOI] [PubMed] [Google Scholar]
- 74.Megemont M., McBurney-Lin J., and Yang H. (2022). Pupil diameter is not an accurate real-time readout of locus coeruleus activity. Elife 11. 10.7554/eLife.70510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Larsen R.S., and Waters J. (2018). Neuromodulatory Correlates of Pupil Dilation. Frontiers in Neural Circuits 12. 10.3389/fncir.2018.00021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Eggermann E., Kremer Y., Crochet S., and Petersen Carl C.H. (2014). Cholinergic Signals in Mouse Barrel Cortex during Active Whisker Sensing. Cell reports 9, 1654–1660. 10.1016/j.celrep.2014.11.005. [DOI] [PubMed] [Google Scholar]
- 77.van Daal R.J.J., Aydin Ç., Michon F., Aarts A.A.A., Kraft M., Kloosterman F., and Haesler S. (2021). Implantation of Neuropixels probes for chronic recording of neuronal activity in freely behaving mice and rats. Nature protocols 16, 3322–3347. 10.1038/s41596-021-00539-9. [DOI] [PubMed] [Google Scholar]
- 78.Guo Z.V., Hires S.A., Li N., O’Connor D.H., Komiyama T., Ophir E., Huber D., Bonardi C., Morandell K., Gutnisky D., et al. (2014). Procedures for behavioral experiments in head-fixed mice. PloS one 9, e88678–e88678. 10.1371/journal.pone.0088678. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Ollerenshaw D.R., Bari B.A., Millard D.C., Orr L.E., Wang Q., and Stanley G.B. (2012). Detection of tactile inputs in the rat vibrissa pathway. Journal of Neurophysiology 108, 479–490. 10.1152/jn.00004.2012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Schriver B.J., Perkins S.M., Sajda P., and Wang Q. (2020). Interplay between components of pupil-linked phasic arousal and its role in driving behavioral choice in Go/No-Go perceptual decision-making. Psychophysiology, e13565. 10.1111/psyp.13565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Mathis A., Mamidanna P., Cury K.M., Abe T., Murthy V.N., Mathis M.W., and Bethge M. (2018). DeepLabCut: markerless pose estimation of user-defined body parts with deep learning. Nat Neurosci 21, 1281–1289. 10.1038/s41593-018-0209-y. [DOI] [PubMed] [Google Scholar]
- 82.Krok A.C., Maltese M., Mistry P., Miao X., Li Y., and Tritsch N.X. (2023). Intrinsic dopamine and acetylcholine dynamics in the striatum of mice. Nature 621, 543–549. 10.1038/s41586-023-05995-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Zutshi I., Valero M., Fernández-Ruiz A., and Buzsáki G. (2022). Extrinsic control and intrinsic computation in the hippocampal CA1 circuit. Neuron 110, 658–673.e655. 10.1016/j.neuron.2021.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Tikhonov A.N., and Arsenin V.Y. (1977). Solutions of ill-posed problems (Vh Winston; ). [Google Scholar]
- 85.Green D.M., and Swets J.A. (1966). Signal Detection Theory and Psychophysics (Wiley; ). [Google Scholar]
- 86.Hocker D.L., Brody C.D., Savin C., and Constantinople C.M. (2021). Subpopulations of neurons in lOFC encode previous and current rewards at time of choice. eLife 10, e70129. 10.7554/eLife.70129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Gabbiani F., and Koch C. (1998). Principles of spike train analysis. Methods in neuronal modeling 12, 313–360. [Google Scholar]
- 88.Brown P.O., Chiang M.C., Guo S., Jin Y., Leung C.K., Murray E.L., Pazdor A.G.M., and Cuzzocrea A. (2022). Mahalanobis Distance Based K-Means Clustering. held in Cham, 2022//. Wrembel R., Gamper J., Kotsis G., Tjoa A.M., and Khalil I., eds. (Springer International Publishing; ), pp. 256–262. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.