Visual Abstract
Keywords: adolescence, automated behavioral testing, behavioral pharmacology, impulsivity, operant, serotonin
Abstract
Complex behavioral assessment is necessary to comprehensively assess in vivo manipulations in rodent models for neuropsychiatric disorders. Operant behavioral paradigms provide rich datasets and allow for the careful analysis of behavioral phenotypes. However, one major limitation in these studies is the expense and work-load that are required using traditional methods. The equipment for commercial operant boxes can be prohibitively expensive, and the daily experimenter effort and mouse costs required for these studies is extensive. Rodents are generally trained on task-specific paradigms for months, tested every day for 5–7 d/week. Additionally, appetitive paradigms usually require food restriction and are also commonly run in the non-active light phase of the rodent circadian rhythm. These limitations make operant behavioral testing especially difficult during adolescence, a time period of interest with regards to the development of adult-like phenotypes and a high-risk period for the development of neuropsychiatric disorders, including those which involve impulsive behavior. In order to address these issues, we developed an automated, inexpensive, open-source method which allows the implementation of most standard operant paradigms in the homecage of rodents in shorter time frames without food restriction, and with much less experimenter effort. All construction and code for the do-it-yourself Nautiyal Automated Modular Instrumental Conditioning (DIY-NAMIC) system are open source. We demonstrate their utility here by measuring impulsive behavior in a pharmacology experiment, as well as in adolescent mice.
Significance Statement
Rigorous behavioral assessment is critical to understand the neural basis of neuropsychiatric disorders using animal models. Operant behavioral paradigms provide the ability to measure complex phenotypes, however, traditional methods generally require time-consuming daily training for many weeks. We designed, built, and validated an open-source automated homecage system for appetitive instrumental conditioning that enables testing in shorter timeframes with reduced experimenter effort.
Introduction
Complex behavioral phenotyping is critical for understanding the effects of neural and genetic manipulations in animal models. In fact, even funding agencies are requesting the use of more multidimensional behavioral measures in neuroscience research, especially in animal models for neuropsychiatric disorders (Bale et al., 2019; NIMH, 2019). Operant behavioral paradigms provide an excellent framework to assess multiplexed behavioral effects of biological manipulations in rodent models. However, traditional methods generally take months to run, require daily training, prolonged food restriction, and involve costly equipment. An ideal testing system would eliminate daily experimenter intervention and minimize experiment time lines by allowing hundreds of trials per day, while also removing the need for food deprivation, and allowing testing and data logging automatically 24 h/d. An automated homecage operant system would also provide more reproducibility given reduced experimenter and protocol-introduced variability.
Impulsive behavior is found in many neuropsychiatric disorders such as substance use disorder, behavioral addictions, and attention deficit hyperactivity disorder (Jentsch, 2008; Winstanley, 2011; Bari and Robbins, 2013). Importantly, there is a long history of careful behavioral dissection of impulsivity using operant paradigms in rodent models (Dalley et al., 2011; Bari and Robbins, 2013). Many studies have focused on characterizing various aspects of impulsive behavior and assessing related phenotypes. One distinction that has been made is between different types of impulsivity including impulsive choice (e.g., delaying gratification) versus impulsive action (e.g., withholding responding; MacKillop et al., 2016; Nautiyal et al., 2017). While both are frequently elevated in psychiatric disorders presenting with disordered impulsivity, they can be statistically and biologically dissociated as separate (and uncorrelated) components in the pathogenesis of many disorders (Winstanley et al., 2006; Brevers et al., 2012; Grant and Chamberlain, 2014). Our focus on measuring impulsive action in mouse models to understand its neural basis has required extended daily task-specific training in operant paradigms, taking two months or more, for example in the standard procedure for the five-choice serial reaction time task (Humby et al., 2005; Bari et al., 2008; Fletcher et al., 2013). Furthermore, studying the development of impulsivity during adolescence has been difficult in standard operant paradigms for impulsive action, given that adolescence lasts less than one month in mice (spanning ∼30–60 d postnatal; Workman et al., 2013; Bell, 2018).
Studying the behavioral and neural development of impulse control during adolescence in mouse models is important for understanding the adolescent sensitive period as it relates to the etiology of a number of neuropsychiatric disorders (Paus et al., 2008; Casey, 2015; Schulz and Sisk, 2016). Specifically, animals show high impulsivity, novelty seeking, and risky behavior during adolescence, a potentially evolutionarily adaptive behavioral change which is important to promote independence at sexual maturity. Additionally, understanding the neural changes that lead to the decrease in these behaviors at the end of the adolescent period is also important for delineating the neural circuits that may be disordered when these phenotypes persist into adulthood and may emerge as important factors in psychiatric disorders.
A large literature implicates serotonin in the regulation of impulsive behavior in humans and animal models (Brunner and Hen, 1997; New et al., 2001; Bevilacqua et al., 2010; Miyazaki et al., 2012; Stoltenberg et al., 2012; Nautiyal et al., 2015). Pharmacological and genetic manipulations in rodents have been a large source of our knowledge on the neural mechanisms that drive impulsivity. Most of this preclinical testing has occurred in MedAssociates operant chambers using complex and well-validated operant paradigms (Robinson et al., 2008; Zeeb et al., 2009; Bari and Robbins, 2013). These studies have delineated the complex role of serotonin signaling in the differential modulation of a number of facets of impulsive behavior (Harrison et al., 1997; Winstanley et al., 2004a,b; Dalley and Robbins, 2017). Global depletion of serotonin seems to increase impulsive action, with limited effects on impulsive choice (Harrison et al., 1997; Winstanley et al., 2004a). Additionally a number of the 14 different serotonin receptors have been implicated in the modulation of impulsive action including 5-HT2A and 5-HT2C receptors using pharmacology (Winstanley et al., 2004b; Fletcher et al., 2011), and 5-HT1B and 5-HT2C using genetic loss-of-function models (Brunner and Hen, 1997; Fletcher et al., 2013; Nautiyal et al., 2015).
In order to measure impulsivity and a range of related behavioral parameters, we sought a more time-effective and cost-effective method for fine-grain measurement of behavior in rodents. In recent years, there have been a number of automated and open-source developments for complex behavioral testing which can increase throughput as well as data reproducibility (Nguyen et al., 2016; Ali and Kravitz, 2018; Godynyuk et al., 2019; Venniro et al., 2019; Luciani et al., 2020). Do-it-yourself (DIY) operant behavioral testing apparatus have been developed for use with standard session-based testing methods which provide relatively inexpensive and customizable apparatus making behavioral testing more accessible (Devarakonda et al., 2016). Additionally, there have been modifications to traditional commercial equipment, and also to standard lengthy paradigms making shorter training times possible (Remmelink et al., 2017; Sasamori et al., 2018). What was still lacking, however, was a method that combined these advantages to allow for both homecage and continuous assessment of operant behavior, with liquid reward in an affordable open-source system.
Our goal was to design, build, validate, and disseminate a novel method which allows for continuous quantitative and robust operant behavioral testing. We developed the DIY Nautiyal Automated Modular Instrumental Conditioning (DIY-NAMIC) system as an inexpensive, open-source method which allows mice to perform operant trials in their homecage to receive their daily consumption of water, in self-initiated trials. This promotes rapid acquisition of task-specific contingencies given the high number of daily trials that mice perform each day. With continuous testing and automatic data-logging the DIY-NAMIC system enables high throughput data collection 24 h/d, 7 d/week. Using the DIY-NAMIC system, we were able to measure impulsive action as well as a number of other behavioral parameters in under three weeks, with only twice weekly (<1 h long) experimenter effort. We show that mice rapidly acquire Pavlovian and stimulus-response associations, and basic cue-based discrimination learning within a week. Furthermore, we show that effects of pharmacological manipulations can be measured with the DIY-NAMIC system, and demonstrate that activating the serotonin 1B receptor (5-HT1B R) reduces impulsive action. Finally, our studies illustrate the ability to test impulsivity in adolescent mice, a period of development which is difficult to test in mice using standard paradigms. Overall, the studies presented here validate the use of the DIY-NAMIC system for assessing multidimensional behavior including impulsivity. Furthermore, we present novel data showing serotonergic modulation of the neural basis of impulsive behavior, and by characterizing adolescent impulsivity in mice.
Materials and Methods
DIY-NAMIC system overview
The DIY-NAMIC system was built for compatibility with most facilities’ standard rodent homecages in high-density ventilated racks by replacing one cage wall with a modular system that delivers stimuli and rewards and detects and records behavioral responses (Fig. 1A). It allows for the implementation of standard Pavlovian and operant-based tasks although with less effort, time, and cost. The DIY-NAMIC system is controlled by an Arduino microprocessor board and easily sourced electronics allowing for an inexpensive and customizable apparatus. The initial design used in these studies includes three solenoid-delivered liquid dispensing noseports, each with an infrared head-entry detector and LED cue light (Fig. 1B). Mice do not undergo food restriction and the DIY-NAMIC system permits behavioral testing during the active phase of their circadian rhythm and eliminates daily, potentially stressful, handling. The system is designed for liquid delivery enabling fine control of volume (vs pellet delivery). The receptacles are shallow, allowing reward receipt with large head stages, such as those for miniature head-mounted microscopic imaging. Analysis scripts, written in Python, are available for use and modification as needed. Given their modular construction and open-source development, the hardware for the DIY-NAMIC system is customizable and inexpensive to build.
DIY-NAMIC build instructions
All materials required to build DIY-NAMIC boxes are sourced from common websites with the total cost of all parts required for each box at less than $300 (Table 1). All build instructions, detailed diagrams, and design files are located online at www.GitHub.com/DIY-NAMICsystem. We estimate that a user familiar with soldering and the basics of electronics and Arduino functions could build eight cages within a week, in an assembly-line approach (Fig. 1C). Standard mouse ventilated home cages (5.5” × 14” × 5”, Techniplast) were modified by cutting one short wall off with a rotary tool, and U channels were affixed with Loctite 401 inside the cut edge. A Plexiglass wall was laser cut (ordered from Ponoko; design file available online), to fit the dimensions of the cage, and slotted into the U channels. The wire and ventilated cage tops fit as usual. Three noseports per cage were 3D printed (Shapeways, design file available online) and attached to the Plexiglass wall with flat head screws. The leads of the LEDs (5-mm ultrabright diffused round blue light) used for cue lights were threaded through the top holes in the back of the noseport, and a current-limiting resistor (1 kΩ) was soldered to the anode. A female DuPont connector on a female to male 12-inch jumper wire was attached to each of the cathode and resistor ends and soldered in place. Photo-interrupters (IRs) were cut in half to separate the infrared LED and phototransistor, and each part was inserted into casing on either side of the designed noseport, and a hex nut was threaded onto the screws affixing the noseports to the Plexiglas which secured the IRs in place. A resistor was wired to the LED of the IR, and female DuPont connectors of jumper wires were attached to each of five IR leads, as described for the cue LEDs. Large gauge hypodermic needles (21 G) were blunted by removing the beveled sharp tip with a rotary tool and then sanded smooth with a belt sander. The needles were inserted into the lower hole on the back of each noseport, and secured with hot glue. Luer locks connected the needle to tubing (1/16” inner diameter (ID)), which connected to the middle port of the solenoid valve (three-ported, 5V-30PSI, Lee Company). The two solenoid leads were attached to female DuPont connectors of jumper wires. The three solenoids (one per noseport) were connected to a three-way manifold from the solenoid port distal to the leads, with the same tubing (1/16” ID). A small closed piece of tubing was attached to the proximal solenoid port as a cap. The manifold was fed water from a 60-ml syringe via tubing (1/4” ID).
Table 1.
Component | Specification | Supplier/Part ID | Cost | URL |
---|---|---|---|---|
Noseports | 3D printed with black natural versatile plastic (three needed/cage) | Shapeways | $14.10 | File: https://github.com/DIY-NAMICsystem/Hardware_Documentation/tree/master/Shapeways_Final
printing: https://www.shapeways.com/ |
Plexiglass wall * | Black acrylic, 1.5 mm thick | Custom laser cut at Ponoko | $6.30 | File: https://github.com/DIY-NAMICsystem/Hardware_Documentation/tree/master/Ponoko_Final
laser cutting: https://www.ponoko.com/laser-cutting |
U channel | Clear impact-resistant polycarbonate U channels (0.235” wide, 0.3” high) | McMaster-Carr 1753K61 | $4.06/4ft | https://www.mcmaster.com/catalog/126/3817 |
Screws | Philips flat head: 4–40 thread size, 5/16” long (six needed/cage) | McMaster-Carr 91771A107 | $4.53/100 | https://www.mcmaster.com/catalog/126/3227 |
Photo IR | GP1A57HRJ00F (three needed/cage) | Sparkfun 09299 |
$2.50 | https://www.sparkfun.com/products/9299 |
LEDs | 5-mm LED ultrabright diode, DC 3 V 20 mA 0.06 W diffused round blue light (three needed/cage) | Amazon | $6.00/100 | https://www.amazon.com/gp/product/B06XFVBQDY/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 |
Resistors | 1 kΩ (six needed/cage) | Sparkfun | $0.95/20 | https://www.sparkfun.com/products/14492 |
Needles | BD precision glide needles (21 G, 0.8 × 50 mm; three needed/cage) | Fisher Scientific 14-821-13N |
$29.22/100 | https://www.fishersci.com/shop/products/bd-precisionglide-single-use-needles-regular-bevel-regular-wall-10/1482113n |
Luer lock | Masterflex fitting, male luer lock to hose barb adapter (three needed/cage) | Cole-Parmer UX-45504-19 |
16.20/pkg 20 | https://www.coleparmer.com/i/masterflex-fitting-polycarbonate-straight-male- luer-lock-to-hose-barb-adapter-1-4-id-25-pk/4550419?searchterm=UX-45504-19 |
Tubing 1 | Tygon EMMMDCIII laboratory tubing ID 1/16”, OD 1/8”, wall 1/32” | Component Supply TET-062A | $0.32/ft | https://componentsupplycompany.com/product-pages/tygon-e-3603-lab-tubing.php |
Solenoid | LHDA0533115H HDI PORTED 3P-5V-30PSI | Lee Company | $63.10 | https://www.theleeco.com/products/electro-fluidic-systems/solenoid-valves/control-valves/lhd-series/3-port/ported/ |
Tubing 2 | Tygon EMMMDCIII laboratory tubing ID ¼”, OD 5/16”, wall 1/32” |
Component Supply TET-250A |
$0.77/ft | https://componentsupplycompany.com/product-pages/tygon-e-3603-lab-tubing.php |
Three-way manifold | Push-to-connect tube fitting for air and water, three outlet manifold, 1/8 NPT male × 1/8” tube OD | McMaster Carr 5203K929 | $12.66 | https://www.mcmaster.com/catalog/126/239 |
Syringe | 60-ml syringe, Luer-lock | Fisher Scientific 14-955-461 |
$32.54/50 | https://www.fishersci.com/shop/products/sterile-syringes-single-use-12/14955461?keyword=true |
Arduino | Arduino Uno Rev3 | Arduino 8058333490090 | $22.00 | https://store.arduino.cc/usa/arduino-uno-rev3 |
Shield | OM1 shield OpenMaze.org |
Oshpark OM1 board v082916 |
$28.05 /3 | https://oshpark.com/shared_projects/ea7NpG7p |
IC socket | 16-pin 0.3” chip | Adafruit 2203 | $0.95 | https://www.adafruit.com/product/2203 |
H-bridge | Dual H-bridge Motor Driver, 600-mA L293D | Adafruit 807 | $2.95 | https://www.adafruit.com/product/807 |
DC barrel jack | Breadboard-friendly 2.1-mm DC barrel jack | Adafruit 373 |
$0.95 | https://www.adafruit.com/product/373 |
Jumper wires | 12” female to male jumper wires | Sparkfun 09386 |
$34.95/100 | https://www.sparkfun.com/products/9386 |
Headers | Stacking headers with standard 2.54-mm spacing | Amazon | $8.09 / 40 | https://www.amazon.com/gp/product/B07JN1KP7W/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1 |
Heat shrink kit | 1/8” diameter | Sparkfun 09353 | $7.95/95 pieces | https://www.sparkfun.com/products/9353 |
Power supply | 9-V DC 1000 mA, AC 100–240 V |
Adafruit 63 | $6.95 | https://www.adafruit.com/product/63 |
This design is based on dimensions of the cages used in our facility’s high-density ventilated rack system and would need to be modified to fit cages used in other facilities.
Other general tools and supplies used: rotary tool (Dremel), Loctite 401, soldering iron (Weller WES51Analog Soldering Station, Sparks, MA); surge protector; multiport USB hub.
An Arduino UNO R3 board was connected via double stacking header pins to an Arduino “shield” from OpenMaze.org (OM1 board). Wiring is documented in detail on the circuit diagram and the build instructions online. Specifically, 32 female stacking headers were inserted and soldered into the printed circuit board (OM1 board; see Fig. 1D) to connect it to the 32 Arduino Pinouts. An integrated circuit socket for an H-bridge and DC Barrel Jack were also soldered to the OM1 board to provide additional power required for the solenoids. A push button, used for a system water flush, was also soldered to the OM1 board. Female headers were soldered to the OM1board to allow for the simple “snap-in” connection of all of the components via the male ends of the jumper cables wired to the LEDs, solenoids, and IR detectors (Fig. 1D). A wall power supply was connected to the board through the DC barrel jack connector. Arduinos were connected via 10-USB hubs to a PC to allow for continuous data logging of 16 cages directly to a PC using Processing software. A test program is provided online which allows for the verification of correct functioning and troubleshooting of all of the components. Additionally, when the data collection is started through Processing, the data file reports correct initiation of the IRs (not blocked) to validate their correct functioning.
Mice
Mice were bred in the vivarium at Dartmouth College. Mice were weaned at postnatal day (PN)21 into cages of two to four same-sex littermates and maintained on ad libitum chow and water in a 12/12 h light/dark cycle. Corncob bedding was used instead of shavings in the homecage to reduce the likelihood of occlusion of noseports or liquid ports. For the initial characterization of behavior shown, male and female mice (N = 9) were tested in DIY-NAMIC boxes beginning at 14 weeks of age. For the study of impulsivity in adolescents, male (N = 9) and female (N = 9) mice were placed individually in DIY-NAMIC boxes at 45–47 d postnatal (adolescents, N = 9) or 14–15 weeks postnatal (adults, N = 9). The pharmacology study was performed on mice aged 11–20 weeks old (N = 18). All mice were placed in DIY-NAMIC boxes individually, with environmental enrichment including a plastic igloo and nesting material with ad libitum chow, with the water bottle removed. All mice were on a mixed C57/Bl6J and 129 S1 background. All procedures were approved by the Dartmouth College Institutional Animal Care and Use Committee.
Behavioral training
Mice were singly housed and initially habituated to the DIY-NAMIC boxes and to retrieving 10 μl water reward from the center noseport delivered by a solenoid. Based on the specifications of our build, including the height of the syringe, we empirically determined the volume to time relationship for size of the water reward dispensed relative to how long the solenoid was open (volume = 0.156*time – 0.00134; r2 = 0.999). Opening the solenoid for 72 ms resulted in 10 μl of water dispensed, with a 3.4% coefficient of variation. During the first 3 d, a reward retrieval training paradigm (P1; Fig. 2A) was presented in which the cue light in the center port was illuminated and mice received 10 μl of water on poking into the center port. After water retrieval, a variable intertrial interval (ITI), with an average of 45 s preceded the next light illumination. The ITI remained at 45-s average, and the water reward volume remained at 10 μl, for all paradigms
Subsequently, mice were trained on a continuous reinforcement schedule (P2; Fig. 2D), for 3 d to nosepoke in one of the two side noseports when illuminated with a cue light. Pokes were rewarded in the center port. Both ports were illuminated with cue lights indefinitely on each trial, and a poke to either port was rewarded, and then the ITI followed. A trial initiation requirement was then added (P3; Fig. 2G), and each trial began following a nosepoke to the center port blinking (1 Hz). Next, a basic cue discrimination requirement was added (P4; Fig. 2I), in which only one of the two sides were illuminated, and only pokes to the illuminated port were reward. For 3 d, only correct nosepokes produced an outcome (reward) and incorrect pokes (pokes to the non-illuminated port) had no consequence. Subsequently, incorrect pokes resulted in trial termination and ITI onset, and trials were capped at 5 s (no response before 5 s resulted in ITI onset and the trial was considered an omission). After 2 d, the trial response duration was shorted to 1.5 s. Finally, a modified two-choice serial reaction time test paradigm (Fig. 2K) was tested as a measure of impulsive action, by introducing a delay period between trial initiation and the cue light onset. The time delay was increased over three lengths: 3, 6, and 9 s, with each presented for 3 d. Nosepokes during the delay were recorded but had no influence on the outcome of the trial (i.e., there was no timeout/punishment period or cue). Only a poke during the illuminated cue was necessary for a rewarded trial. All programs were switched during the light cycle, roughly 4–6 h after light onset. Arduino programs for all paradigms are provided online including schematics illustrating trial structure and detailed input/output descriptions www.GitHub.com/DIY-NAMICsystem. The welfare of the mice was monitored by weight at least twice weekly. Data were processed regularly to ensure all mice were receiving adequate hydration from the system. Any mouse that did not receive >100 rewards/d for >2 d in a row, or lost >10% of their baseline bodyweight, was removed from the DIY-NAMIC cage and returned to ad libitum water. Two out of 47 mice had to be removed from the experiments.
DIY-NAMIC data collection and processing
Behavioral responses, as well as stimuli and reward presentations are logged with event and timecode stamps which are written directly into text files through Processing scripts. Following data collection, initial analysis is performed off-line using Python scripts to concatenate data log files, and extract relevant metrics including total number of rewards, and total number of nosepokes to each port, and nosepokes to each port during the ITI, reward presentation, cue presentation, and delay period. Premature pokes were considered pokes to one of the two side ports during the delay period. Time bounds are input to allow data extraction in desired time bins (e.g., minutes, hours, dark cycle, or days). All data collection and processing scripts are available online at www.GitHub.com/DIY-NAMICsystem.
DIY-NAMIC maintenance
Water is flushed through the system at a minimum of every two weeks, by pushing the button on the OM1 shield using a Flush program (provided online). Cages are changed every two weeks by replacing the DIY-NAMIC apparatus into a clean modified homecage. Modified cages with U channels attached are compatible standard cage-washing procedures. Following each experiment in a box (when mice are removed), the Plexiglas and enclosure are wiped down with baby wipes and then with Clidox disinfectant spray; 70% ethanol is run through all water tubes and solenoids, and then allowed to dry. Every four to six months, or as needed, the noseports are removed from the Plexiglas and enclosure for cleaning with soap and water. The tubing is replaced, and electronics are sprayed with compressed air to remove dust and dander, and wiped down with 70% ethanol when possible. A detailed cleaning protocol is available online.
Drug administration
Following training as described above, and immediately following 3 d of exposure to the 9-s delay in the test of impulsive action, mice were injected with drug or saline control. A selective 5-HT1B agonist, CP 94253 hydrochloride (Tocris Bioscience catalog no. 1317) was given at a high dose, 10 mg/kg, dissolved in 0.9% sterile saline and injected at 10 ml/kg intraperitoneally (Knobelman et al., 2000). Injections were given within 30 min of initiation of the dark cycle. Mice were randomly assigned to drug or vehicle conditions, and then 2–3 d after receiving their first injection, mice received the alternate condition. Data from the 12 h (their dark phase) after receiving injections were analyzed.
Statistical analysis
Statistical testing was performed using analysis of variance (ANOVA), with post hoc Fisher’s least significant difference (LSD) in StatView (SAS Software) or SPSS (IBM) for three-way ANOVAs. For the initial behavioral characterization, a repeated measures ANOVA was used to assess the change in behavior over days in the measures of number of rewards, number of ITI responses, and number of trials initiated per day. Post hoc Fisher’s LSD was used to assess differences between days. There were no significant effects of sex on any of the measures reported for the initial behavioral characterization (F(1,7) < 3.0, p > 0.05), although the sample size was not powered enough to rule out sex differences.
For the adolescent study, measures were summed over each day and then averaged across 3 d for each delay, except for proportion of correct trials which was averaged across each hour of the day, and then averaged across 3 d for each delay. A three-way repeated measures ANOVA was used to test the effect of sex and age on premature responding. There were no significant effects of sex on pokes during the delay window (F(1,14) = 0.5, p = 0.50), number of trial initiated (F(1,14) = 3.3, p = 0.0899), number of omissions (F(1,14) = 0.3, p = 0.6159), or proportion of correct responses (F(1,14) = 0.2, p = 0.8947). There was an interaction of sex and delay length in the number of omissions (F(2,28) = 5.3, p = 0.0111) and proportions of correct responses (F(2,28) = 3.8, p = 0.0335), in that females had worse performance overall as the delay got longer; however, there was no interaction with age and the pattern occurred in both adults and adolescents. Two-way repeated measures ANOVAs, with post hoc Fisher’s LSD tests, were used to assess the effect of age on four behavioral measures over the three delay lengths [age (adolescent, adult) × delay length (3, 6, 9 s)]: premature responding (nosepokes during the delay window), number of trials initiated, number of omitted trials, and proportion of correct trials.
For the pharmacology study, premature responses per trial was calculated by dividing the number of nosepokes during the delay period by the number of self-initiated trials for each hour, and a repeated measures ANOVA [condition (drug, saline) × time (1–12 h)] was used to assess significance. All other measures were summed (number of delay responses, ITI responses) or averaged (proportion of correct responses and omissions), over 6-h bins following injection (1–6 and 7–12 h following injection) to analyze the effect of drug versus saline, based on drug half-life estimations from previous microdialysis studies following CP 94253 drug administration (Knobelman et al., 2000). In three-way ANOVAs (sex × drug × time), there were no significant main effects of sex on premature pokes during the delay (F(1,32) = 0.1, p = 0.8038), total trials initiated (F(1,32) = 1.6, p = 0.2129), ITI responding (F(1,32) = 0.001, p = 0.9913), or proportion of omissions (F(1,32) = 0.2, p = 0.6239). There were also no significant interactions of CP 94253 and sex on premature pokes during the delay (F(1,32) = 0.8, p = 0.3887), total trials initiated (F(1,32) = 0.1, p = 0.7704), ITI responding (F(1,32) = 0.7, p = 0.4099), or proportion of omissions (F(1,32) = 0.2, p = 0.7014). Although there was no main effect of sex on the proportion of correct trials (F(1,32) = 2.6, p = 0.1124), there was a significant interaction of sex and drug on proportion of correct trials, in that males that received drug had lower accuracy compared with females that received drug. Groups were then collapsed across sex, and repeated measures ANOVAs [condition (drug, saline) × time (1–6 h, 7–12 h)] were used to assess the effects of CP 94253 over the time, with post hoc Fisher’s LSD.
Results
We designed, implemented, and tested the DIY-NAMIC system and show that it is a low-effort, low-cost, and high-throughput method to measure complex behavior in mice (Fig. 1). Slotted into a standard rodent home cage compatible with high-density racked cages, the DIY-NAMIC system allowed mice to rapidly learn complex operant behavioral tasks. Mice learn to nosepoke at a cue-lit reward port to receive a liquid reward on a continuous reinforcement schedule (Fig. 2A), receiving an average 172 ± 13 rewards per day over the first 3 d of testing. Compared with the average 40–60 rewards/d in standard operant behavioral designs, this is a large increase in the number of trials per day that are run, therefore greatly speeding task acquisition. The majority of responses were during the dark phase of their diurnal cycle; mice received only 10.6% of their rewards during the light phase (Fig. 2B). This allows for more naturalistic testing of nocturnal rodents compared with many standard protocols which involve behavioral testing during the mouse dormant phase (daytime) for facilities that do not have reverse light cycles. Additionally, ITI responding decreased by the second day (F(2,16) = 10.6; p < 0.0012; D1 vs D2: p = 0.0008; D1 vs D3: p = 0.0016; D2 vs D3: p = 0.7359; Fig. 2C), showing that mice learned the stimulus-response association within a day.
Mice were subsequently trained to make an operant response (nosepoke) to an illuminated response-port (Fig. 2D), and increased their earned rewards by the second day (F(2,16) = 4.6, p = 0.0262; D1 vs D2: p = 0.0255; D1 vs D3: p = 0.0136; D2 vs D3: p = 0.7630; Fig. 2E), and further reduced ITI responding to the middle port by the third day of training (F(2,16) = 4.1, p = 0.0372; D1 vs D3: p = 0.0378; Fig. 2F). Mice then learned to initiate trials (Fig. 2G), and increased to stable performance by the second day (F(3,24) = 5.7, p < 0.0043; D1 vs D2: p = 0.0054; D1 vs D3: p = 0.0090; D1 vs D4: p = 0.0007) self-initiating an average of 191 ± 10 trials per day (Fig. 2H). Following trial self-initiation training, mice learned to respond correctly on a discriminative cue paradigm, during which a response only in the illuminated port resulted in a reward (Fig. 2I). A circadian rhythm of trials initiated was observed throughout 24 h of testing with 89.9% of trials initiated in the dark phase (F(8,11) = 12.6, p < 0.0001). Within the dark phase, there was an effect of time on the number of trials initiated (F(8,5) = 2.9, p = 0.0269), with more trials initiated during the period 2–8 h after lights off compared with other hours of the dark phase (Fig. 2K). Mice performed correctly by responding with a nosepoke to the illuminated port on 84.7% of the 211.3 ± 12.2 total trials, with incorrect responses on 13.8% of trials and omissions on only 1.4% of trials (Fig. 2J). The percentage of correct trials did not vary across the hours of the dark phase (F(8,5) = 0.9, p = 0.4734; Fig. 2K).
Next, we assessed the capability of the DIY-NAMIC system to measure impulsive behavior using a modified two-choice serial reaction time task (Fig. 2L). Delays of varying lengths were introduced between trial initiation and the response cue to measure premature responding. The number of premature responses varied as a function of delay length (F(2,16) = 5.6, p < 0.0155; Fig. 2M). Specifically, during the dark period (when mice initiated the majority of trials), there were more premature responses per trial during the 6- and 9-s delay, compared with the 3-s delay (3 vs 6: p = 0.0260; 3 vs 9: p < 0.0050; 6 vs 9: p = 0.4357). Over days within each delay, the accuracy did not change (F(2,16) < 1.53, p > 0.05), however, omissions decreased across days during the 3-s delay (F(2,16) = 14.3, p < 0.0002; Fig. 2N).
We next assessed impulsivity during adolescence, given that the adolescent period in mice is generally shorter than the time needed for training on many traditional operant paradigms. While our goal was to measure impulsivity, it was important to also obtain additional measures of attention, motivation, and performance. Compared with adults, adolescent mice showed increased impulsive behavior as measured by premature responding (F(1,16) = 8.54, p = 0.0099; Fig. 3A) with more premature responding in adolescents as the delay got longer (F(2,32) = 24.9, p < 0.0001). Specifically, adolescents had significantly higher levels of responding during the 9-s delay period (p = 0.0491 for 3 s; p = 0.0521 for 6 s; p = 0.0281 for 9 s). This suggests that premature responding is a readout of the adolescents’ reduced ability to inhibit responding since the number of responses increases as the difficulty/delay increases, rather than a reflection of their observed general hyperactivity or increased motivation. Importantly, adolescents did initiate more trials (F(1,16) = 5.8, p = 0.0280; Fig. 3B); however, this did not vary with the change in delay/difficulty of the paradigm (F(2,32) = 0.2, p = 0.8162). We also used the number of omitted trials as a readout of attention. Adolescent mice showed decreased attention as measured by increased number of omission trials (F(1,16) = 7.1, p = 0.0173; Fig. 3C). Again, there was no effect of delay length on omissions suggesting that the decreased attention was unlikely the cause of the increased impulsivity (F(2,32) = 1.2, p = 0.7256). Importantly, adolescents did not show differences in the proportion of correct trials (F(1,16) = 0.1, p = 0.7680; Fig. 3D), indicating that their performance on the task was normal and there was no effect of age on accuracy or overall performance on the paradigm. Overall, the results suggest that adolescent mice display increased impulsive action as measured by premature responding. Furthermore, these data demonstrate the ability to test complex self-initiated operant behaviors during limited time frames, such as adolescence, in the DIY-NAMIC system.
Finally, in a pharmacology experiment, we tested the effect of manipulating serotonin signaling on impulsive action using DIY-NAMIC boxes. We focused on the effect of activating the 5-HT1B receptor by administering the receptor-specific agonist, CP 94253, and measuring behavior in the DIY-NAMIC cages. Compared with traditional single time point measures of operant behavior, the DIY-NAMIC system allowed investigations into the time course of drug effects on behavior (main effect of time: F(11,374) = 3.3, p = 0.0002; Fig. 4A). Administration of the agonist resulted in decreased impulsivity, measured by reduced premature responding, which varied over time as the drug effects dissipated (interaction of drug × time: F(1,34) = 4.8, p = 0.0352; Fig. 4B). Specifically, there was decreased responding during the delay period in the 6 h following injection of the 5-HT1B receptor agonist (p = 0.0147), and not during the subsequent 6 h of the dark phase (p = 0.4595). Importantly, the agonist also decreased the total number of trials initiated in the first 6 h after drug administration, suggesting a decrease in general motivation (interaction: F(1,34) = 10.6, p = 0.0026; drug vs vehicle for 1–6 h: p = 0.0141; Fig. 4C). While this is a relevant factor in interpreting the premature responding, the normalization of premature responses per trial (Fig. 4A) suggests that the drug effects on impulsive responding are not solely driven by decreases in motivation. Additionally, responding during the ITI can be driven by both impulsive and general hyperactive behavior; these responses were slightly, but not significantly, decreased for the first half of the dark cycle following drug treatment (interaction drug × time: F(1,34) = 3.1, p = 0.0873; Fig. 4D). Finally, there was also a significant effect of the agonist on the proportion of omitted trials (F(1,34) = 6.3, p = 0.0170; Fig. 4E), and this was only significant for the first 6 h following drug administration (interaction of time × drug: F(1,34) = 4.5, p = 0.0412). There was no effect of the agonist on the proportion of correct trials of those attempted (F(1,34) = 2.0, p = 0.1670; Fig. 4F), indicating the drug effects were specific to premature responding and likely not due to effects on performance or attention. These data show the utility of DIY-NAMIC boxes in assessing pharmacological manipulations, particularly in allowing for time course data. Additionally, these data show a novel effect of serotonin pharmacology on impulsivity.
Discussion
Given the recent interest in exploring more robust and multidimensional behavioral readouts of animal models for neuropsychiatric disorders, the development of high-throughput and automated behavioral screens are critical (Gordon and Dzirasa, 2016; Bale et al., 2019). Operant behavioral paradigms provide rich behavioral datasets; however, they are labor intensive and lengthy (daily training for weeks/months), and generally require food deprivation and costly equipment. To address these limitations, we developed an Arduino-based system as a homecage, low-touch, fully automated operant chamber that allows mice to self-initiate trials for their daily water intake. Data are logged continuously to a PC, and experimenter effort is only required to monitor/weigh animals to assess welfare, and upload new programs to Arduinos when switching behavioral paradigms (although even this could also be automated in future implementations). We have shown that mice learn basic Pavlovian and operant behaviors over a few days in DIY-NAMIC cages, performing hundreds of trials in a day in their dark/active phase. Additionally, we have validated its use in measuring effects of drugs on behavior, allowing for monitoring over long time frames. Finally, we show that we can measure impulsive behavior in adolescent mice and show increased impulsivity compared with adults.
The difficulty of training mice on complex operant behavioral paradigms within a few weeks using standard procedures and equipment limits their utility in examining adolescent behavior in mice given its short timeframe (Workman et al., 2013; Brust et al., 2015). We have found this to be a critical limiting factor in understanding the adolescent development of the neural and behavioral basis of impulsivity, an important sensitive period for the etiology and pathogenesis of neuropsychiatric disorders which include impulsive behavior as a core phenotype (Chambers et al., 2003; Verdejo-García et al., 2008). Our studies reported here measure behavior in mid to late adolescence, although the DIY-NAMIC system easily allows future studies to characterize impulsivity throughout various stages of adolescence including early adolescence (∼30–40 d).
There have been past efforts to study operant behavioral measures in adolescent mice. Some of these studies have taken the strategy of eliminating mice that do not learn quickly enough to progress to increasingly complex behavioral paradigms, leading to potentially biased samples (Arnold and Newland, 2018). There has also been some progress in the development of new training paradigms that reduce training time to allow testing in adolescent mice (Ciampoli et al., 2017; Sasamori et al., 2018); however, they still require food deprivation which could be detrimental to growth and the maturation of feeding circuits during adolescence. Inexpensive Arduino-based operant testing apparatus have also been developed, such as ROBucket (Devarakonda et al., 2016), although these have also been used with daily experimenter-initiated daily sessions. Finally, others have used modified commercially available designs such as the CombiCage which allow free-access to the standard costly operant conditioning chambers via a tube connected to a homecage (Remmelink et al., 2017). Overall, the DIY-NAMIC system provides an improved method to measure impulsivity in adolescent mice by combining the benefits of some preceding technology and allowing testing in a number of behavioral domains with minimal experimenter effort and high-throughput protocols.
We were able to use the rich dataset collected from the DIY-NAMIC system to tease impulsivity apart from other behavioral parameters that may also be different during adolescence and could otherwise obscure or contaminate measures of impulsive behavior. For example, previous work has shown hyperactivity, increased motivation, and decreased attention in adolescent mice (Ciampoli et al., 2017). We were able to increase the sensitivity of the task to detect impulsivity by increasing the delay length (Dalley et al., 2002). Our measure of impulsivity increased as delay length increased, while measures of hyperactivity, motivation, and attention did not. Interestingly, our results differed from a previous study which used a CombiCage for 24 h access from the homecage to a commercial testing chamber and reported no significant differences in impulsivity between adult and adolescent mice in a 5-CSRTT (Remmelink et al., 2017). Although there were a number of methodological differences between our studies, including the use of food pellets for rewards and a paradigm which seemed to result in many more initiated trials with a higher percentage of omitted trials. This may suggest a more challenging task which may have obscured age differences. On the other hand, our results were consistent with another previous report of impulsivity measured in adolescent mice using a modified training procedure for 3-CSRTT in a traditional session-based design in commercial equipment (Sasamori et al., 2018). These authors report increased impulsive action in late adolescent mice as measured increased by premature responses, however did not see increased omissions as seen in our data.
Automated home cage phenotyping provides the opportunity to measure behavior in a more reproducible manner because it limits experimenter-introduced variability (Bains et al., 2018). A system that is compatible with high-density racked cages and does not include video-based phenotyping (because of the long time frames) provides the most usable and reliable method. The DIY-NAMIC system also provides a data-rich, low-effort approach to psychoactive drug screening. We show here that the effects of acute administration of drugs can be assessed over prolonged periods of time. This is an important improvement compared with many “single-use” behavioral tests which can only reliably be performed once, requiring higher numbers of animals to be able to assess the temporal profile of drugs. Additionally, the DIY-NAMIC system provides an opportunity to assess longer-term effects of acute administration, as well as effects of chronic drug administration, with lower effort and animal numbers than traditional testing. Finally, the shortened training time required allows for the preclinical testing of drugs in adolescence, which is important given potential differential actions of drugs over the life course.
Homecage behavioral testing allows for behavioral analysis across the circadian cycle, an important variable for the interpretation of studies assessing impulsivity and other motivated behavior, that is often overlooked (Balachandran et al., 2020). Conventional session-based, non-homecage behavioral testing generally occurs during the light phase of the circadian rhythm, likely causing partial entrainment to feeding occurring in the light cycle, and resulting in dysregulation of homeostatic systems (Gritton et al., 2012). Furthermore, it is difficult to test the effect of circadian rhythms using traditional session-based operant paradigms which is critical because many manipulations, including drug administration, have interactions with time-of-day. On the other hand, the lack of control over the timing of trials can also create a confound in the interpretation of data collected over the circadian cycle. Since mice are more active/motivated for water in the dark phase, assessing the effect of circadian period on behaviors is difficult. Behavior can be normalized by trials initiated, although in many hours during the light phase, there are very few, or no, trials initiated. An alternative option with this system would be, following acquisition of task behavior, to restrict access to short (1 h) timeframes by only allowing trial initiation during “session-like” time periods. This may also be a necessary approach if using manipulation, recording, or imaging techniques to force trials within a limited time period.
Although the DIY-NAMIC system provides a number of significant advantages over standard commercially available operant boxes, it is not without its own disadvantages. One downside currently is the need to single-house mice. Although the daily stressor of handling is eliminated, housing mice singly may also result in effects on baseline stress levels and/or behavioral readouts (Meijer et al., 2007; Kamakura et al., 2016; Hebda-Bauer et al., 2019). This limits the interpretation of some results, for example, the differences we see in adolescent impulsive behavior could be in part due to a differential response to single-housing. The DIY-NAMIC system is compatible with standard homecage enrichment, and we include nesting material and an igloo hut in all cages. Future iterations of this system could use an RFID chip implanted subcutaneously and a reader in an access port to the receptacles to allow group housing. Another technical improvement is the use of WiFi/Bluetooth microprocessor board and shield (see OpenMaze.org) to allow wireless data upload/program download. Although our facility allows USB/power wires from the cages on high-density racks, some facilities or IACUCs may not allow this and the use of the wireless data transmission and onboard batteries could eliminate wiring connections completely.
We used the DIY-NAMIC system here to measure impulsive action, but many other paradigms could be implemented using this method including random ratio paradigms and other types of impulsivity, such as delayed discounting. However, paradigms that require manipulation of context would not be possible in this system. Given the Arduino platform and the modular build of the DIY-NAMIC system, additional stimuli and cues (e.g., vibration pad for tactile stimulus) would be necessary customization changes to measure some additional phenotypes.
In conclusion, we have developed the DIY-NAMIC system as a low-touch, low-cost homecage operant behavioral testing system with an opensource platform. All materials are commercially available, and build instructions are documented online in detail, including tips for researchers with minimal electrical and material engineering skills. Software for all of the programs and analysis used for experiments in this manuscript are also available online, including Arduino programs for running behavioral paradigms, Processing scripts for logging data, and Python scripts for data analysis and plotting. The DIY-NAMIC system greatly increases the ability to measure complex and robust behavior in a high-throughput manner, enabling more productive and reproducible basic research in animal models for neuropsychiatric disorders.
Acknowledgments
Acknowledgments: We thank Andrew Alvarenga for technical assistance with hardware components, darrob on the Arduino forum, and Stephanie Desrochers for helpful comments throughout the project.
Synthesis
Reviewing Editor: Mark Laubach, American University
Decisions are customarily a result of the Reviewing Editor and the peer reviewers coming together and discussing their recommendations until a consensus is reached. When revisions are invited, a fact-based synthesis statement explaining their decision and outlining what is needed to prepare a revision will be listed below. The following reviewer(s) agreed to reveal their identity: Alexxai Kravitz, Michael Saddoris.
Synthesis of Reviews
Two reviewers and I have reviewed your paper submitted to eNeuro. Both reviewers were positive about the device and agreed that the manuscript would be suitable for publication with no new experiments. The consensus was to request revisions with a second round of review. Details are provided in the following synthesis of our discussions. Please be sure to address each point raised by each reviewer.
Please also consider submitting a visual abstract for your manuscript. Both reviewers and the reviewing editor felt that it would be nice to have for your manuscript.
---------------------------------------
Comments from Reviewer #1
The authors present the design and build of a home-cage operant behavior device for rodents. The dissemination of these types of devices are sorely needed in our field, and address many bottlenecks presented by the ongoing use of commercial operant behavior systems. The authors describe a novel system here that would allow for home cage operant behavior training and testing. The potential for use of this device is immense. In preliminary experiments, the authors show that mice acquired continuously reinforced associations and cue-based discrimination, and subsequently were able to show phenotypic differences upon 5-HT1b activation. This suggests that the DIY-NAMIC is a very useful tool for home-cage operant training. We have some suggestions to improve the manuscript, which do not require any new experimentation.
Comments:
1. There should be more information on the build. Please provide detailed build instructions, including how long it takes to build, and detailed construction information (soldering, electronics). Please also provide photos of the inside of the device pink box - the manuscript only has photos of the exterior which is not super useful for getting an idea on how complicated this device would be to build. Figure 1 would be greatly improved with more photos as well as a high-level schematic diagram of the wiring.
2. More information should be given about the validation experiments. Specifically, we had the following questions: a) Were the validation experiments done with sucrose water? If not, can the authors describe how the animals were shaped, if they were not water restricted? b) what volume of liquid was dispensed on each trial? c) Was any validation of the accuracy of the solenoids performed?
3. The authors say that palatable liquids can be delivered. How do they clean the solenoid valves to prevent sticktion and clogging? Do they have a “flush” protocol able to be activated by the Arduino? If not, please include one. Having used solenoids in the past this is crucial for using them with solutions with sucrose in them.
4. Please discuss the effect of round-the-clock training on interpreting the results, specifically, the effect of circadian rhythms on learning and trial initiation. Understanding the circadian cycle is a benefit of home-cage training but it can also be a confounding variable if not accounted for. The authors mention that ∼90% of the trials occurred at night, was there a specific circadian time when they occurred? Was there a circadian influence on the animals’ accuracy on the tasks? Plotting the validation data across the circadian cycle would be informative, as well as discussing the potential benefits of a home-cage system that can collect data across the circadian cycle.
5. In the discussion, please better describe the caveats of the system. For instance, users have to modify the home cage containment to enact the use of this device. Although it is a home-cage compatible device it also requires power and data wiring, do the authors imagine it being used on a rack in a typically vivarium? How do animal caretakers deal with it? Did it receive IACUC approval at their Institution? How reliable is the system? Have they experienced any failures? In general there should be a longer paragraph discussing the caveats associated with using this system.
Minor comments:
1) Please provide exact p-values.
2) Please consider coding the random ratio and PR that is discussed in the paper and include these as options for your Arduino code. These are common programs and it will likely be easier for you to code than for someone else to figure out your code.
3) How is the device cleaned?
---------------------------------------
Comments from Reviewer #2
This manuscript explores a new and affordable approach to automated instrumental conditioning for mice within the animals’ home cages, and then goes on to demonstrate its efficacy in tasks involving impulsivity modulated by 5HT pharmacology. The studies are a valuable new piece in a revolution currently taking place in neuroscience research where open source programmable “maker” solutions to expensive equipment is becoming increasingly popular. Consistent with this, the authors make available the totality of their Arduino programming code, part list, and methods for assembly, which will be of considerable value to those looking to replicate the functionality described. (That said, because of the double-blind nature of the review, I was unable to personally review the code, but will assume it is in good shape for dissemination). Overall, I think that the design, approach, affordability ($300 per box here versus ∼$10,000 for a similar commercially-available design) and utility of the design is a welcome and timely addition to this these DIY approaches, and will have immense utility in better leveraging the behavioral repertoire of mice. Mice have obviously been the workhorses for genetic-based approaches for neuroscience for decades, but compared to rats, their relatively limited behavioral utility has most typically limited their behavioral assays to quite basic designs. The findings in this study suggest that a hidden variable in these limitations may arise from the architecture of lab design itself, namely the limitations on access to testing chambers to run several cohorts per day, potentially the stress of transport and insertion into the chambers, and circadian influences on motivation. Testing in the home cages certainly removes the constraints on box access time (and labor demands from research staff), minimizes unintended stressors in transport, and provides better flexibility in understanding circadian influences in behavior.
I want to add that these do not come without potential interpretative issues on their own. For example, testing within the home cage also presents its own challenges in understanding the differential roles of contextual learning since there is no separation between home space and learning, though this is not necessarily of interest to many experimental approaches. Related to this are issues of salience and control over the presentation of task stimuli. Since task instrumental response elements are never absent, the authors correctly note that circadian influences can drive task performance. While this is great for discovering the influences of circadian rhythms on the task, it may make it a challenge to specifically use circadian rhythms as a variable itself (e.g., comparing impulsivity in active versus inactive phases). Third, there are some other issues intrinsic to home cages that are less of a problem in dedicated chambers such as potential fouling of the response/reward elements with bedding/waste that could go undetected for long periods of time (e.g., stuffing bedding into the ports) and stressors of cage-changing day/odor changes. Finally, knowing my own experiences with IACUC, how are these expected to be cleaned regularly without jeopardizing the circuitry integrity? That said, these issues will no doubt be features experimenters contemplating in-cage testing will have considered, and should be treated as limitations as with any design. Overall, the innovation and powerful utility of the methodological approach here far outweighs these concerns.
The majority of the critiques are more related to the behavioral data presented that demonstrate the utility of the chamber. In general, while I appreciated the use of the behavioral data to show the utility of the design, it was a bit of an awkward fit with the methods part of the paper. Namely, because the focus was reasonably on the utility and design of the testing apparatus, I don’t know that there was sufficient detail on the behavioral data portions (or space for detail without the whole paper getting to unwieldy). In a perfect world, it’d be neat to have these as companion papers, but I see the value in the combination as-is. I enumerate my critiques on this portion here:
1. It would have been useful to see compare the authors’ previous data acquired with presumably similar approaches in the commercially-available dedicated test chambers. Were there differences? If not, this would suggest a solid correspondence between both approaches, and thus the savings (in both cost and time) would be clear. If so, it would be interesting to know whether these could be explained by intrinsic features of the design (e.g., time of day, lack of transit stress, etc). Note that I am explicitly NOT suggesting running new experiments here, but perhaps comparisons with similar data from prior work could be of potential value here.
2. The authors repeatedly suggest that this design allows for testing in the absence of deprivation, but it is not explicitly stated in the methods whether or not the mice tested here were deprived. The only allusion I could find was that they were explicitly ad libitum on chow, which implies fluid restriction, but it’s not clear. Furthermore, if they were non-restricted on water, why were they working for the water at all? Is this a demonstration of a contrafreeloading effect in the mice? If in contrast they were deprived, and thus the only fluid available was via the task, this certainly raises the stakes for the task in a way that’s probably not identical to typical designs where fluid obtained in the testing chamber is supplemented by later in-cage access. Related to my fouling point above, if an animal fails to learn rapidly would they be at risk of dehydration?
3. It’s not clear from the task about what (if any) experimenter control was exercised on access to the instrumental task. For example, were the ports illuminated/accessible for the continuous duration of the task? When did testing begin for the mice - i.e., did they initially learn in the inactive (light) or active (dark) phase? As I noted above as well, the circadian aspects on this are treated like an outcome, providing insight into the patterns of seeking, but it also acts a bit as a confound as it’s hard to tease apart these elements from other components of motivation when they are confounded with each other.
4. Some aspects of group differences were not fully explored in the results. For example, though M and F mice were used, I was unable to find direct comparisons (either statistical or descriptive) of potential differences. Another issue that intrinsic to the groups is the necessity of individual housing. Adolescents may be at particular risk to social housing relative to adults, and thus the effects of social isolation interacting with development could potentially contribute to differences.
Overall, however, I feel like the focus on this manuscript correctly rests on the innovation and potential utility of the design of the DIY-NAMIC system rather than the details of the behavioral outcomes. As such, I consider these behavioral considerations to be important but subordinate in assessing the overall impact of this study, which overall is excellent.
References
- Ali MA, Kravitz AV (2018) Challenges in quantifying food intake in rodents. Brain Res 1693:188–191. 10.1016/j.brainres.2018.02.040 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arnold MA, Newland MC (2018) Variable behavior and repeated learning in two mouse strains: developmental and genetic contributions. Behav Processes 157:509–518. 10.1016/j.beproc.2018.06.007 [DOI] [PubMed] [Google Scholar]
- Bains RS, Wells S, Sillito RR, Armstrong JD, Cater HL, Banks G, Nolan PM (2018) Assessing mouse behaviour throughout the light/dark cycle using automated in-cage analysis tools. J Neurosci Methods 300:37–47. 10.1016/j.jneumeth.2017.04.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Balachandran RC, Hatcher KM, Sieg ML, Sullivan EK, Molina LM, Mahoney MM, Eubig PA (2020) Pharmacological challenges examining the underlying mechanism of altered response inhibition and attention due to circadian disruption in adult Long-Evans rats. Pharmacol Biochem Behav 193:172915. 10.1016/j.pbb.2020.172915 [DOI] [PubMed] [Google Scholar]
- Bale TL, Abel T, Akil H, Carlezon WA Jr, Moghaddam B, Nestler EJ, Ressler KJ, Thompson SM (2019) The critical importance of basic animal research for neuropsychiatric disorders. Neuropsychopharmacology 44:1349–1353. 10.1038/s41386-019-0405-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bari A, Robbins TW (2013) Inhibition and impulsivity: behavioral and neural basis of response control. Prog Neurobiol 108:44–79. 10.1016/j.pneurobio.2013.06.005 [DOI] [PubMed] [Google Scholar]
- Bari A, Dalley JW, Robbins TW (2008) The application of the 5-choice serial reaction time task for the assessment of visual attentional processes and impulse control in rats. Nat Protoc 3:759–767. 10.1038/nprot.2008.41 [DOI] [PubMed] [Google Scholar]
- Bell MR (2018) Comparing postnatal development of gonadal hormones and associated social behaviors in rats, mice, and humans. Endocrinology 159:2596–2613. 10.1210/en.2018-00220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bevilacqua L, Doly S, Kaprio J, Yuan Q, Tikkanen R, Paunio T, Zhou Z, Wedenoja J, Maroteaux L, Diaz S, Belmer A, Hodgkinson CA, Dell'osso L, Suvisaari J, Coccaro E, Rose RJ, Peltonen L, Virkkunen M, Goldman D (2010) A population-specific HTR2B stop codon predisposes to severe impulsivity. Nature 468:1061–1066. 10.1038/nature09629 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brevers D, Cleeremans A, Verbruggen F, Bechara A, Kornreich C, Verbanck P, Noël X (2012) Impulsive action but not impulsive choice determines problem gambling severity. PLoS One 7:e50647. 10.1371/journal.pone.0050647 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brunner D, Hen R (1997) Insights into the neurobiology of impulsive behavior from serotonin receptor knockout mice. Ann NY Acad Sci 836:81–105. 10.1111/j.1749-6632.1997.tb52356.x [DOI] [PubMed] [Google Scholar]
- Brust V, Schindler PM, Lewejohann L (2015) Lifetime development of behavioural phenotype in the house mouse (Mus musculus). Front Zool 12 [Suppl 1]:S17. 10.1186/1742-9994-12-S1-S17 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Casey BJ (2015) Beyond simple models of self-control to circuit-based accounts of adolescent behavior. Annu Rev Psychol 66:295–319. 10.1146/annurev-psych-010814-015156 [DOI] [PubMed] [Google Scholar]
- Chambers RA, Taylor JR, Potenza MN (2003) Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Am J Psychiatry 160:1041–1052. 10.1176/appi.ajp.160.6.1041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ciampoli M, Contarini G, Mereu M, Papaleo F (2017) Attentional control in adolescent mice assessed with a modified five choice serial reaction time task. Sci Rep 7:9936. 10.1038/s41598-017-10112-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dalley JW, Robbins TW (2017) Fractionating impulsivity: neuropsychiatric implications. Nat Rev Neurosci 18:158–171. 10.1038/nrn.2017.8 [DOI] [PubMed] [Google Scholar]
- Dalley JW, Theobald DE, Eagle DM, Passetti F, Robbins TW (2002) Deficits in impulse control associated with tonically-elevated serotonergic function in rat prefrontal cortex. Neuropsychopharmacology 26:716–728. 10.1016/S0893-133X(01)00412-2 [DOI] [PubMed] [Google Scholar]
- Dalley JW, Everitt BJ, Robbins TW (2011) Impulsivity, compulsivity, and top-down cognitive control. Neuron 69:680–694. 10.1016/j.neuron.2011.01.020 [DOI] [PubMed] [Google Scholar]
- Devarakonda K, Nguyen KP, Kravitz AV (2016) ROBucket: a low cost operant chamber based on the Arduino microcontroller. Behav Res Methods 48:503–509. 10.3758/s13428-015-0603-2 [DOI] [PubMed] [Google Scholar]
- Fletcher PJ, Rizos Z, Noble K, Higgins GA (2011) Impulsive action induced by amphetamine, cocaine and MK801 is reduced by 5-HT(2C) receptor stimulation and 5-HT(2A) receptor blockade. Neuropharmacology 61:468–477. 10.1016/j.neuropharm.2011.02.025 [DOI] [PubMed] [Google Scholar]
- Fletcher PJ, Soko AD, Higgins GA (2013) Impulsive action in the 5-choice serial reaction time test in 5-HT(2)c receptor null mutant mice. Psychopharmacology (Berl) 226:561–570. 10.1007/s00213-012-2929-0 [DOI] [PubMed] [Google Scholar]
- Godynyuk E, Bluitt MN, Tooley JR, Kravitz AV, Creed MC (2019) An open-source, automated home-cage sipper device for monitoring liquid ingestive behavior in rodents. eNeuro 6:ENEURO.0292-19.2019. 10.1523/ENEURO.0292-19.2019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gordon JA, Dzirasa K (2016) Animal models of psychiatric disorders. Neuroscience 321:1–2. 10.1016/j.neuroscience.2016.02.004 [DOI] [PubMed] [Google Scholar]
- Grant JE, Chamberlain SR (2014) Impulsive action and impulsive choice across substance and behavioral addictions: cause or consequence? Addict Behav 39:1632–1639. 10.1016/j.addbeh.2014.04.022 [DOI] [PubMed] [Google Scholar]
- Gritton HJ, Kantorowski A, Sarter M, Lee TM (2012) Bidirectional interactions between circadian entrainment and cognitive performance. Learn Mem 19:126–141. 10.1101/lm.023499.111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Harrison AA, Everitt BJ, Robbins TW (1997) Central 5-HT depletion enhances impulsive responding without affecting the accuracy of attentional performance: interactions with dopaminergic mechanisms. Psychopharmacology 133:329–342. 10.1007/s002130050410 [DOI] [PubMed] [Google Scholar]
- Hebda-Bauer EK, Dokas LA, Watson SJ, Akil H (2019) Adaptation to single housing is dynamic: changes in hormone levels, gene expression, signaling in the brain, and anxiety-like behavior in adult male C57Bl/6J mice. Horm Behav 114:104541. 10.1016/j.yhbeh.2019.06.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Humby T, Wilkinson L, Dawson G (2005) Assaying aspects of attention and impulse control in mice using the 5-choice serial reaction time task. Curr Protoc Neurosci Chapter 8:Unit 8.5H 10.1002/0471142301.ns0805hs31 [DOI] [PubMed] [Google Scholar]
- Jentsch JD (2008) Impulsivity in animal models for drug abuse disorders. Drug Discov Today Dis Models 5:247–250. 10.1016/j.ddmod.2009.03.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kamakura R, Kovalainen M, Leppäluoto J, Herzig KH, Mäkelä KA (2016) The effects of group and single housing and automated animal monitoring on urinary corticosterone levels in male C57BL/6 mice. Physiol Rep 4:e12703 10.14814/phy2.12703 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Knobelman DA, Kung HF, Lucki I (2000) Regulation of extracellular concentrations of 5-hydroxytryptamine (5-HT) in mouse striatum by 5-HT(1A) and 5-HT(1B) receptors. J Pharmacol Exp Ther 292:1111–1117. [PubMed] [Google Scholar]
- Luciani KR, Frie JA, Khokhar JY (2020) An open source automated bar test for measuring catalepsy in rats. eNeuro 7:ENEURO.0488-19.2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacKillop J, Weafer J, C Gray J, Oshri A, Palmer A, de Wit H (2016) The latent structure of impulsivity: impulsive choice, impulsive action, and impulsive personality traits. Psychopharmacology (Berl) 233:3361–3370. 10.1007/s00213-016-4372-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meijer MK, Sommer R, Spruijt BM, van Zutphen LF, Baumans V (2007) Influence of environmental enrichment and handling on the acute stress response in individually housed mice. Lab Anim 41:161–173. 10.1258/002367707780378168 [DOI] [PubMed] [Google Scholar]
- Miyazaki K, Miyazaki KW, Doya K (2012) The role of serotonin in the regulation of patience and impulsivity. Mol Neurobiol 45:213–224. 10.1007/s12035-012-8232-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nautiyal KM, Tanaka KF, Barr MM, Tritschler L, Le Dantec Y, David DJ, Gardier AM, Blanco C, Hen R, Ahmari SE (2015) Distinct circuits underlie the effects of 5-HT1B receptors on aggression and impulsivity. Neuron 86:813–826. 10.1016/j.neuron.2015.03.041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nautiyal KM, Wall MM, Wang S, Magalong VM, Ahmari SE, Balsam PD, Blanco C, Hen R (2017) Genetic and modeling approaches reveal distinct components of impulsive behavior. Neuropsychopharmacology 42:1182–1191. 10.1038/npp.2016.277 [DOI] [PMC free article] [PubMed] [Google Scholar]
- New AS, Gelernter J, Goodman M, Mitropoulou V, Koenigsberg H, Silverman J, Siever LJ (2001) Suicide, impulsive aggression, and HTR1B genotype. Biol Psychiatry 50:62–65. 10.1016/s0006-3223(01)01108-8 [DOI] [PubMed] [Google Scholar]
- Nguyen KP, O'Neal TJ, Bolonduro OA, White E, Kravitz AV (2016) Feeding experimentation device (FED): a flexible open-source device for measuring feeding behavior. J Neurosci Methods 267:108–114. 10.1016/j.jneumeth.2016.04.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- NIMH (2019) NOT-MH-19-053: notice of NIMH’s considerations regarding the use of animal neurobehavioral approaches in basic and pre-clinical studies. Available from https://grants.nih.gov/grants/guide/notice-files/NOT-MH-19-053.html.
- Paus T, Keshavan M, Giedd JN (2008) Why do many psychiatric disorders emerge during adolescence? Nat Rev Neurosci 9:947–957. 10.1038/nrn2513 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Remmelink E, Chau U, Smit AB, Verhage M, Loos M (2017) A one-week 5-choice serial reaction time task to measure impulsivity and attention in adult and adolescent mice. Sci Rep 7:42519. 10.1038/srep42519 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Robinson ES, Eagle DM, Mar AC, Bari A, Banerjee G, Jiang X, Dalley JW, Robbins TW (2008) Similar effects of the selective noradrenaline reuptake inhibitor atomoxetine on three distinct forms of impulsivity in the rat. Neuropsychopharmacol 33:1028–1037. 10.1038/sj.npp.1301487 [DOI] [PubMed] [Google Scholar]
- Sasamori H, Ohmura Y, Kubo T, Yoshida T, Yoshioka M (2018) Assessment of impulsivity in adolescent mice: a new training procedure for a 3-choice serial reaction time task. Behav Brain Res 343:61–70. 10.1016/j.bbr.2018.01.014 [DOI] [PubMed] [Google Scholar]
- Schulz KM, Sisk CL (2016) The organizing actions of adolescent gonadal steroid hormones on brain and behavioral development. Neurosci Biobehav Rev 70:148–158. 10.1016/j.neubiorev.2016.07.036 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stoltenberg SF, Christ CC, Highland KB (2012) Serotonin system gene polymorphisms are associated with impulsivity in a context dependent manner. Prog Neuropsychopharmacol Biol Psychiatry 39:182–191. 10.1016/j.pnpbp.2012.06.012 [DOI] [PubMed] [Google Scholar]
- Venniro M, Russell TI, Zhang M, Shaham Y (2019) Operant social reward decreases incubation of heroin craving in male and female rats. Biol Psychiatry 86:848–856. 10.1016/j.biopsych.2019.05.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Verdejo-García A, Lawrence AJ, Clark L (2008) Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci Biobehav Rev 32:777–810. 10.1016/j.neubiorev.2007.11.003 [DOI] [PubMed] [Google Scholar]
- Winstanley CA (2011) The utility of rat models of impulsivity in developing pharmacotherapies for impulse control disorders. Br J Pharmacol 164:1301–1321. 10.1111/j.1476-5381.2011.01323.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Winstanley CA, Dalley JW, Theobald DE, Robbins TW (2004a) Fractionating impulsivity: contrasting effects of central 5-HT depletion on different measures of impulsive behavior. Neuropsychopharmacology 29:1331–1343. 10.1038/sj.npp.1300434 [DOI] [PubMed] [Google Scholar]
- Winstanley CA, Theobald DE, Dalley JW, Glennon JC, Robbins TW (2004b) 5-HT2A and 5-HT2C receptor antagonists have opposing effects on a measure of impulsivity: interactions with global 5-HT depletion. Psychopharmacology (Berl) 176:376–385. 10.1007/s00213-004-1884-9 [DOI] [PubMed] [Google Scholar]
- Winstanley CA, Eagle DM, Robbins TW (2006) Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies. Clin Psychol Rev 26:379–395. 10.1016/j.cpr.2006.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Workman AD, Charvet CJ, Clancy B, Darlington RB, Finlay BL (2013) Modeling transformations of neurodevelopmental sequences across mammalian species. J Neurosci 33:7368–7383. 10.1523/JNEUROSCI.5746-12.2013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zeeb FD, Robbins TW, Winstanley CA (2009) Serotonergic and dopaminergic modulation of gambling behavior as assessed using a novel rat gambling task. Neuropsychopharmacology 34:2329–2343. 10.1038/npp.2009.62 [DOI] [PubMed] [Google Scholar]