Home » Reward Delivery

Category: Reward Delivery


July 30, 2020

Cameron Woodard has kindly shared the following write up about PiDose, an open source system for oral drug administration to group-housed mice.

“PiDose is an open-source tool for scientists performing drug administration experiments with mice. It allows for automated daily oral dosing of mice over long time periods (weeks to months) without the need for experimenter interaction and handling. To accomplish this, a small 3D-printed chamber is mounted adjacent to a regular mouse home-cage, with an opening in the cage to allow animals to freely access the chamber. The chamber is supported by a load cell, and does not contact the cage but sits directly next to the entrance opening. Prior to treatment, mice have a small RFID capsule implanted subcutaneously, and when they enter the chamber they are detected by an RFID reader. While the mouse is in the chamber, readings are taken from the load cell in order to determine the mouse’s bodyweight. At the opposite end of the chamber from the entrance, a nose-poke port accesses a spout which dispenses drops from two separate liquid reservoirs. This spout is wired to a capacitive touch sensor controller in order to detect licks, and delivers liquid drops in response to licking. Each day, an average weight is calculated for each mouse and a drug dosage is determined based on this weight. When a mouse licks at the spout it dispenses either regular drinking water or a drop of drug solution depending on if they have received their daily dosage or not. All components are controlled by a Python script running on a Raspberry Pi 3B. PIDose is low cost (~$250 for one system) and full build instructions as well as parts for 3D-printing and software can be found online.”

Read more about PiDose in their paper!

Check out the Open Science Framework repository for the project.

Or head over to the Hackaday page to learn more!

Woodard, C. L., Nasrallah, W. B., Samiei, B. V., Murphy, T. H., & Raymond, L. A. (2020). PiDose: An open-source system for accurate and automated oral drug administration to group-housed mice. Scientific Reports, 10(1). doi:10.1038/s41598-020-68477-2


May 14, 2020

David A. Bjånes and Chet T. Moritz from the University of Washington in Seattle have developed and published their device for training rats to perform a modified center out task.

As neuroscience tools for studying rodent brains have improved in the 21st century, researchers have started to utilize increasingly complex tasks to study their behavior, sometimes adapting tasks commonly used with primates. One such task used for studying motor behavior, the center-out reaching task, has been modified for use in rodents. Bjånes and Moritz have further contributed to the adaptation of this task by creating ACRoBaT, or the Automated Center-out Rodent Behavioral Trainer. This device features two custom printed PCBs, a 3D printed housing unit, an Arduino microchip, and other commercially available parts that can be mounted outside a behavioral arena. It also provides a fully automated algorithm to train rats based on behavioral feedback fed into the device through various sensors. The authors show the effectiveness of the device with data from 18 rats across different conditions to find the optimal training procedure for this task. Information for how to build the device is available in their publication, as well as on Github.

Read the full publication here, or check out the files on GitHub!

3DOC: 3D Operant Conditioning

April 23, 2020

Raffaele Mazziotti from the Istituto di Neuroscienze CNR di Pisa has generously shared the following about 3DOC, a recently developed and published project from their team.

“Operant conditioning is a classical paradigm and a standard technique used in experimental psychology in which animals learn to perform an action in order to achieve a reward. By using this paradigm, it is possible to extract learning curves and measure accurately reaction times. Both these measurements are proxy of cognitive capabilities and can be used to evaluate the effectiveness of therapeutic interventions in mouse models of disease. Recently in our Lab, we constructed a fully 3D printable chamber able to perform operant conditioning using off-the-shelf, low-cost optical and electronic components, that can be reproduced rigorously in any laboratory equipped with a 3D printer with a total cost around 160€. Requirements include a 3D printable filament ( e.g. polylactic acid, PLA), a low-cost microcontroller (e.g. Arduino UNO), and a single-board computer (e.g. Raspberry Pi). We designed the chamber entirely using 3D modelling for several reasons: first, it has a high degree of reproducibility, since the model is standardized and can be downloaded to print the same structure with the same materials throughout different laboratories. Secondly, it can be easily customized in relation to specific experimental needs. Lastly, it can be shared through online repositories (Github: https://github.com/raffaelemazziotti/oc_chamber). With these cost-efficient and accessible components, we assayed the possibility to perform two-alternative forced-choice operant conditioning using audio-visual cues while tracking in the real-time mouse position. As a proof of principle of customizability, we added a version of the OC chamber that is able to show more complex visual stimuli (e.g. Images). This version includes an edit of the frontal wall that can host a TFT monitor and code that runs on Psychopy2 on Raspberry PI. This tool can be employed to test learning and memory in models of disease. We expect that the open design of the chamber will be useful for scientific teaching and research as well as for further improvements from the open hardware community.”

Check out the full publication here.

Or take a peak at the Github for this project.

Open Source Joystick

March 26, 2020

This week we want to talk about joy! I mean, joy-sticks. Parley Belsey, Mark Nicholas and Eric Yttri have developed and shared an open-source joystick for studying motor behavior and decision making in mice!

Mice are hopping and popping in research, and so researchers are using more creativity and innovation to understand the finite aspects of their behaviors. Recently, members of the Yttri lab at Carnegie Mellon used their skills to create an open source joystick for studying mouse motor and decision making behaviors! In their paper they describe the full behavioral set up (based on the RIVETS design from the Dudman lab), featuring a removable head fixation point, a sipping tube, and a joystick to measure reach trajectory, amplitude, speed, etc. Data is collected and devices are controlled via an Arduino, solenoid circuit, microSD card reader, and LCD readout, and data can be analyzed in real time or saved to a csv for analysis later. The Arduino can be programmed to signal reward delivery when a correct response is recorded from the joystick which streamlines outcome based reward delivery. Belsey et al. tested their device with adult mice, and the results of training can be found in the paper as well as the full build instructions and ideas for how their tool may be of interest to build and use in your lab.

For more, check out their publication or Github!

Belsey, P., Nicholas, M. A., & Yttri, E. A. (2020). Open-source joystick manipulandum for decision-making, reaching, and motor control studies in mice. Eneuro. doi: 10.1523/eneuro.0523-19.2020

Robotic Flower System for Bee Behavior

March 19, 2020

Erno Kuusela and Juho Lämsä, from the University of Oulu in Finland, have shared their design for an open source, computer controlled robotic flower system for studying bumble bee behavior.

Oh.. to be a honey bee.. collecting nectar from a robotic flower.. of open source design… splendid. As with behavioral studies from species common to neuroscience (rodents to drosophila to humans or zebrafish, etc), data collection for behavioral studies in bees can be time-consuming and sensitive to human error. Thanks to the growth in the open source movement, it’s easier than ever to develop hardware and software to automate such studies, which is what Kuusela and Lämsä have demonstrated in their publication. They developed a system of robotic flowers to study bee behavior. Their design features a control unit, based on an Arduino Mega 2560, which can collect data from and send inputs to up to 32 individual robotic flowers. Each flower contains its own servo controlled refill system. The nectar cup (in this design, a phillips screw head that can hold 1.7 uL!) is attached to servomotor’s shaft via a servo horn which, when prompted by the program, dips the cup into the flower’s individual nectar reservoir. The flower is designed in a way to capture data when an animal is feeding by the placement of IR beams that are broken when engaged on the flower’s feeding mechanism and sends data to the control unit. A covering on the system can be marked with symbols to attract bees. Custom control software is available on an open source license to be used as is, or modified to fit an experimenter’s needs. While developed and tested with bumble bees, the system can also be adapted for a number of species.

Read more about specifics of this system in Kuusela & Lämsä (2016). The circuit diagrams, parts list, and control software and source code are available in the paper’s supplemental information.

ToneBox: a system for automated auditory operant conditioning

March 12, 2020

Nikolas Francis and colleagues from the Kanold Laboratory at the University of Maryland – College Park have developed and shared ToneBox, a system for high-throughput operant conditioning in a mouse homecage.

Data collection for operant conditioning studies can be time-consuming and sensitive to variability in experimental conditions. An automated approach would both reduce experimental variability and allow for high-throughput training and data collection. To solve this, Francis et al. developed and shares a user-friendly automated system for training up to hundreds of mice in an auditory behavioral task. This system features a custom Matlab GUI running on a desktop which connects to a Raspberry Pi to administer auditory stimuli from a USB soundcard and collects data auditory data as well as licking data from a water spout with commercially available capacitive sensors. The parts list and build instructions are readily available from the paper and associated GitHub repository and are straight-forward enough for new users to build and operate without extensive coding or design experience. This system can collect data 24/7 for weeks on end, which allows for insight into behaviors not otherwise observable by experimenters who need to eat and sleep instead of observing mice at all hours.

The developers show how their tool can be used by training 24 C57BL/6J mice to perform auditory behavioral tasks. They report their results and find that circadian rhythms modulated overall behavioral activity as expected for nocturnal animals. Details about this study, as well as about building the device and where to find resources to create your very own ToneBox can be gleaned from reading their full paper on eNeuro.

Read the paper here, check out the GitHub repository here, or keep up to date with the latest from the Kanold Lab by visiting their site!

FED Development Interview

March 5, 2020

One of the co-founders of OpenBehavior, Lex Kravitz recently participated in an interview about the development of the Feeding Experiment Device, lovingly known as FED! Read more to learn about how the project started, how the device has improved and what’s next for the project, including a partnership with the OpenEphys team. Perhaps this will inspire and guide you through your own project development!

1. Tell us about FED: What is it intended to do? What was its initial purpose for use in your lab?
FED is a home-cage compatible device for training mice!  FED stands for the Feeding Experimentation Device, the name is also a pun: it was invented while my lab was at the NIH, so the FED was made by the Feds 🙂 
The initial purpose of FED was to measure feeding, and quantify daily calories eaten by mice living in home cages. Our lab studies feeding and obesity and the automated methods that exist for measuring food intake (typically small weighing scales that attach to the cage) were too expensive for our lab to purchase enough of them for our studies, which often involved >50 mice at a time.  We figured other people might have the same need so we decided to invent something to do this.  We settled on a pellet dispensing approach because we can buy pellets in precision sizes (20mg each), which means that instead of weighing the food we can calculate the calories from the number of pellets eaten.  From an engineering standpoint counting pellets seemed easier than scales too.  I was very fortunate to have a postbac Katrina Nguyen in my lab with a background in BioMedical Engineering, and she spearheaded the development of our first device, which we called FED.  After she left the lab another postbac, Mohamed Ali, worked with me to create the FED2, which was a slightly refined version of FED, and FED2 eventually evolved into the FED3 model that we’re working with today.


2. Can you briefly describe the components of the device, what it is made of, how long it takes to make one?

FED is a “smart” pellet dispenser.  At its core it’s a 3D printed pellet dispenser, which also has a microcontroller board inside, the Adafruit M0 Adalogger, which is an extremely capable microcontroller.  In addition to dispensing pellets, FED3 has two “nosepokes” for mice to interact with it, 8 multicolored LEDs, an audio generator, a screen for user feedback, and a programmable output for synchronizing FED3 behavior with other techniques like optogenetics or fiber photometry. FED3 is small enough to fit inside of rodent home cages and does not require a connected computer to operate.  FED3 is designed to simplify rodent training, it ships with 12 built-in programs, including fixed-ratio and progressive-ratio operant training routines, as well as optogenetic self-stimulation programs. Most importantly, FED3 is open-source and it can be hacked and re-programmed by users to achieve new functionality. It takes me about 1-2 hours to put one together from scratch, it would probably take a new user 3-4 hours.  The electronics parts cost  about $135, and the Open Ephys Production Site is selling assembled electronics for a small markup.  With the electronics and printed parts in hand it takes about 15 minutes to assemble.

3. Since initial development of the device, what general improvements have been made?
Since Katrina Nguyen made the first FED, we worked a lot to improve reliability of the device.  We envisioned this being an “always on” device that can sit in a cage and measure food intake around the clock.  It holds about 10 days worth of pellets and the battery lasts about a week, so in theory this is possible. The major challenge, however, is that it is a mechanical pellet dispenser that is prone to issues such as jamming or dispensing errors. In practice we clean and test the FEDs each day when we run multi-day studies.
One issue with the first FED was that we had no way to get user feedback, so if it jammed the only way we’d even know was if we opened the cage and tried to get a pellet.  For this reason we put a screen on FED2, so we could see how many pellets were dispensed and also get an error message when it was jammed.  For FED3 we added more functions, such as the two “nosepokes” for the mouse to interact with FED to run full home-cage operant tasks.  Finally, we added a synchronized BNC output connector, which let’s us sync the nosepoke and pellet data with ephys or fiber photometry. Several groups we know are doing this to synchronize fiber photometry recordings with pellet retrieval, or generate pulses for optogenetic self-stimulation.

4. Switching gears from the actual device to production and replication, what have you seen as necessary steps to getting other labs / researchers successfully using your device (documentation, forums, contact email, etc)?
In terms of my own work to get FED3 into other people’s hands, I think the most important thing was to get other people to start using it.  So I’ve tried to keep our online documentation for FED3 complete and up to date.  I also give a lot of them out in exchange for feedback – basically it’s important for other people to try building and using a device to discover its flaws that you might not realize because you’ve worked on it too long.  I don’t wait until the devices were perfect before I started giving give away so I could find out what worked and what didn’t for new users. 

5. Since updating and producing FED3, you’ve decided to connect with OpenEphys production team to sell the device on their website. Why did you decide to now sell the device and have OpenEphys distribute it? What are the advantages (to you as the developer, to OpenEphys, and to the potential users) of deciding to put the device on OpenEphys for production?
It is very challenging to distribute a hardware device as a researcher – there aren’t good revenue streams for funding development of devices like this and there aren’t good logistics for distributing them through a University setting.  It also takes a lot of time to communicate with people, mail out devices, and provide support.  Really, all of this are better suited to a company, and for several reasons I don’t want to start one. 
Therefore, I jumped at the chance to work with the Open Ephys Production Site to take on these distribution challenges!   You can see their FED3 sales page here.  Working with them has been really fun and productive – I mailed them a FED3 and they first did a thorough evaluation of the electronics and found several things they could improve in my design to make it more robust and better for manufacture.  So we worked together to implement and test those improvements. The main advantage for me is that working with them amplifies the effort our team did on this device.  I would love to see cheap and easy operant training available in every lab.  I also support their broader mission of distributing open source tools in neuroscience.  I’ll take this moment to make a brief (no) conflict of interest statement, I’m not receiving any funding back from their sales of FED3, the proceeds are all going to support their efforts to distribute FED3 and other open source hardware.

6. Describe the connection between you as a developer and OpenEphys production. Can / should others try to “pitch” their device to OpenEphys (or to other companies out there for production)?
Working with OEPS was very collaborative.  We started by evaluating whether the FED3 was something they wanted to sell, and they quickly determined it was. Filipe Carvalho then went through the design files and made some recommendations for things he wanted to change to improve manufacturability.  For example, our version relied heavily on Adafruit breakout boards, whereas he engineered the relevant chips onto the FED3 printed circuit board assembly.  This makes FED3 easier to manufacture and more reliable.  We worked together on all changes, and it was a really productive collaboration.  I would definitely suggest others “pitch” their ideas to OEPS!  Even if it doesn’t work out for OEPS to distribute the idea I’m sure they’ll get good feedback and learn something about manufacturing and distributing open source hardware.

7. What general advice or instructions do you have for other researchers looking to develop their devices in a similar way. Please let us know of anything you’d like to share with the open-source neuroscience world.
I would advise people to share their designs early and often.  Don’t wait until the design is perfect (it never will be)!  The easier you make it for others to use your device the more of a chance they’ll see the value in it that made you create it in the first place. Try to document online as you go, ie: by using github.com or hackaday.io to keep a record of changes you make and validation experiments you perform.  It can be difficult to go back and create documentation after the fact, but if you do it as you go you have a built-in record for what you did, and why you made the design decisions you made. If you keep up documentation on the way it can also turn into something that you can publish as a methods paper when it’s ready for that.  So in summary – share early and share often, and document your work!

An automated behavioral box to assess forelimb function in rats

November 7, 2019

Chelsea C. Wong and colleagues at the University of California – San Francisco have developed and shared a design for an open-source behavioral chamber for the measurement of forelimb function in rats.

Forelimb function (reaching, grasping, retrieving, etc) is a common readout of behaviors for studying neural correlates of motor learning, neural plasticity and recovery from injury. One version of the task used commonly to study these behaviors, the Whishaw single-pellet reach-to-grasp task, traditionally requires an experimenter to manually present each pellet and to shape the behavior rats by placing a subsequent pellet only when the rat has relocated to the other end of the cage over multiple trials. Wong et al. developed an open source, low-cost, automated high-throughput version of this task. The behavioral apparatus, constructed out of commercially available acrylic sheets, features a custom built pellet dispenser, cameras and IR detectors for measuring position of a rat and position of a pellet, and an Arduino board to integrate information about the animal with dispensing of the pellet. Code for automation of the task was built in MATLAB and includes a GUI for altering experiment parameters. Data collected can be analyzed using MATLAB, excel, or most other statistical programming languages. The authors provide example data from the device to highlight its potential use for combining this reaching task with chronic electrophysiological recording techniques. The full design is available in their publication in Journal of Neuroscience Methods.

Check out the full publication here!

Wong, C. C., Ramanathan, D. S., Gulati, T., Won, S. J., & Ganguly, K. (2015). An automated behavioral box to assess forelimb function in rats. Journal of Neuroscience Methods, 246, 30–37. doi: 10.1016/j.jneumeth.2015.03.008

Automated Home-Cage Rodent Two-bottle Choice Test: open-source success story

October 31, 2019

Elizabeth Godynyuk and colleagues from the Creed Lab at Washington University, St. Louis recently published their design for a two-bottle choice homecage apparatus in eNeuro. It incorporates the original design (published on Hackaday.io in May 2018), modifications from Jude Frie and Jibran Khokar (Frie & Khokhar, 2019), and additional improvements over the course of use. This project is a great example of collaborative open-source tool development.

Studies of liquid ingestive behaviors are used in neuroscience to investigate reward-related behavior, metabolism, and circadian biology. Accurate measurement of these behaviors are needed when studying drug administration, preference between two substances, and measuring caloric intake. To measure consummatory behavior in mice between two liquids, members of the Creed lab designed a low-cost and arduino-based device to automatically measure consumption in a homecage two-bottle choice test. Posted to Hackaday in May 2018, the initial version of the device used photointerrupters to measure time at the sipper, 15 mL conical tubes for volumetric measurements of fluid, and a 3D printed holder for the apparatus. Data from the photobeams are recorded to an SD card using a standard Arduino. In August 2018, the project was updated to Version 2, to make it battery powered and include a screen to display data. They made the editable TinkerCAD design available on hackaday.io.

In October 2018, Dr. Jibran Khokhar and colleagues at the University of Guelph posted a project log highlighting the modifications making the device larger and suitable for studying liquid intake in rats. This updated design was published in April 2019 in HardwareX. This device gives the advantage of being able to analyze the drinking microstructure by recording licking behavior and volume consumed in real time. Modifications include larger liquid reservoirs and adding a hydrostatic depth sensor, allowing each bout of drinking to correspond to a specific change in volume.

In current day, Elizabeth Godynyuk and colleagues from the Creed lab have shared their own updated version of the device in eNeuro. It remains low-cost and open-course and results validating the device with preference testing are shared. Furthermore, the authors show that the two-bottle choice test apparatus can be integrated with a fiber photometry system. In the eNeuro article, Godynuyuk et al. cite Frie and Khokhar’s modifications to highlight how the design can be easily adjusted to fit investigator needs.

These two projects show how open source projects can be modified and how different groups can collaborate to improve upon designs. This shows how open source projects allow research groups can modify designs to best address their research questions instead of forming their research questions based on the commercial tools available.

Creed Lab Version 1: https://hackaday.io/project/158279-automated-mouse-homecage-two-bottle-choice-test

Creed Lab Version 2: https://hackaday.io/project/160388-automated-mouse-homecage-two-bottle-choice-test-v2

Frie and Khokar 2019 (HardwareX): https://www.sciencedirect.com/science/article/pii/S2468067219300045#b0005

Godynyuk et al 2019 (eNeuro): https://www.eneuro.org/content/6/5/ENEURO.0292-19.2019.long

Frie, J. A., & Khokhar, J. Y. (2019). An open source automated two-bottle choice test apparatus for rats. HardwareX, 5, e00061. https://doi.org/10.1016/j.ohx.2019.e00061

Godynyuk, E., Bluitt, M. N., Tooley, J. R., Kravitz, A. V., & Creed, M. C. (2019). An Open-Source, Automated Home-Cage Sipper Device for Monitoring Liquid Ingestive Behavior in Rodents. Eneuro, 6(5), ENEURO.0292-19.2019. https://doi.org/10.1523/ENEURO.0292-19.2019

ELOPTA: a novel microcontroller-based operant device

December 19, 2018

In 2007, Adam Hoffman and colleagues shared their design for an Electric Operant Testing Apparatus (ELOPTA) in Behavior Research Methods.

Operant behavior is commonly studied in behavioral neuroscience, therefore there is a need for devices to train and collect data from animals in operant procedures. Commercially available systems often require training to program and use and can be expensive. Hoffman and colleagues developed a system that can automatically control operant procedures and record behavioral outputs. This system is intended to be easy to use because it is easily programmable, portable and durable.

Read more here!

Hoffman, A.M., Song, J. & Tuttle, E.M. Behavior Research Methods (2007) 39: 776. https://doi.org/10.3758/BF03192968