title: Shape-and-behavior encoded tracking of bee dances.
abstract: Behavior analysis of social insects has garnered impetus in recent years and has led to some advances in fields like control systems, flight navigation etc. Manual labeling of insect motions required for analyzing the behaviors of insects requires significant investment of time and effort. In this paper, we propose certain general principles that help in simultaneous automatic tracking and behavior analysis with applications in tracking bees and recognizing specific behaviors exhibited by them. The state space for tracking is defined using position, orientation and the current behavior of the insect being tracked. The position and orientation are parametrized using a shape model while the behavior is explicitly modeled using a three-tier hierarchical motion model. The first tier (dynamics) models the local motions exhibited and the models built in this tier act as a vocabulary for behavior modeling. The second tier is a Markov motion model built on top of the local motion vocabulary which serves as the behavior model. The third tier of the hierarchy models the switching between behaviors and this is also modeled as a Markov model. We address issues in learning the three-tier behavioral model, in discriminating between models, detecting and in modeling abnormal behaviors. Another important aspect of this work is that it leads to joint tracking and behavior analysis instead of the traditional track and then recognize approach. We apply these principles for tracking bees in a hive while they are executing the waggle dance and the round dance.
authors.affiliation: Department of Electrical and Computer Engineering, Center for Automation Research, University of Maryland, College Park, MD 20742, USA. vashok@umiacs.umd.edu
authors.forename: Ashok
authors.initials: A
authors.lastname: Veeraraghavan
authors.forename: Rama
authors.initials: R
authors.lastname: Chellappa
authors.forename: Mandyam
authors.initials: M
authors.lastname: Srinivasan
mesh_terms: D000465:Algorithms; D000819:Animal Communication; D000818:Animals; D001185:Artificial Intelligence; D001516:Bees / Q000033:anatomy & histology / Q000502:physiology*; D003615:Dancing / Q000502:physiology*; D005260:Female; D007089:Image Enhancement / Q000379:methods; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D021621:Imaging, Three-Dimensional / Q000379:methods; D016247:Information Storage and Retrieval / Q000379:methods; D008297:Male; D010363:Pattern Recognition, Automated / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D012919:Social Behavior