Multiple Monkey Pose Estimation with OpenPose

Apr 14, 2022

Salvador B. Negrete and colleagues have shared their protocol for utilizing OpenPose for tracking multiple monkey subjects. OpenPose is a deep learning software system which was originally developed for pose estimation in human subjects, now being repurposed and adjusted for monkey subjects. OpenPose software facilitates Part Affinity Fields (PAF) by tracking limb orientation rather than geographical location, which is why the similarities between primate skeletal structure and human skeletal structure made repurposing OpenPose feasible for use in monkeys.Salvador B. Negrete and colleagues have shared their protocol for utilizing OpenPose for tracking multiple monkey subjects. OpenPose is a deep learning software system which was originally developed for pose estimation in human subjects, now being repurposed and adjusted for monkey subjects. OpenPose software facilitates Part Affinity Fields (PAF) by tracking limb orientation rather than geographical location, which is why the similarities between primate skeletal structure and human skeletal structure made repurposing OpenPose feasible for use in monkeys.

OpenPose enables behavioral researchers to track the behavior of monkeys in natural environments, without disrupting their typical pattern of behavior. Researchers can analyze these monkeys during activities such as sleeping, grooming, and playing (ex. climbing) as well as specifically during interactions with other monkeys, all through the use of OpenPose. The opensource code for the OpenPose project (https://github.com/CMU-Perceptual-Computing-Lab/openpose) originated from the TensorLayer project (https://tensorlayer.readthedocs.io/en/latest/), and formed the backbone of the network for the implementation of OpenPose in monkeys. Read more about the protocol for monkey tracking from Negrete and colleagues in their recent preprint (https://www.biorxiv.org/content/10.1101/2021.01.28.428726v1). Overall, the repurposed OpenPose software will be able to be facilitated to track individual and population-wide behaviors in non-human primates, monkeys, via limb orientation which will have further implications in behavioral animal analysis.

This research tool was created by your colleagues. Please acknowledge the Principal Investigator, cite the article in which the tool was described, and include an RRID in the Materials and Methods of your future publications.  RRID:SCR_022362

Read the Paper

Learn more about using OpenPose for multiple monkey tracking from bioRxiv. 

OpenPose GitHub

Get access to the OpenPose software from GitHub!

Thanks, Cecelia!

This post was brought to you by Cecelia Cropp. This project summary is a part of the collection from neuroscience undergraduate and graduate students in the Computational Methods course at American University.