Multi-camera real-time three-dimensional tracking of multiple flying animals
Autor: | Titus R. Neumann, Michael H. Dickinson, Andrew Straw, Kristin Branson |
---|---|
Rok vydání: | 2010 |
Předmět: |
Computer science
animal behaviour Video Recording Biomedical Engineering Biophysics Pentium Bioengineering Tracking (particle physics) Biochemistry computer vision Birds Biomaterials Computer graphics 03 medical and health sciences Extended Kalman filter 0302 clinical medicine Gigabit Image Processing Computer-Assisted Animals Computer vision insects Research Articles 030304 developmental biology 0303 health sciences Computers business.industry Tracking system Models Theoretical Frame rate flight Drosophila melanogaster Filter (video) Artificial intelligence business manoeuvring Algorithms Locomotion 030217 neurology & neurosurgery Biotechnology |
Zdroj: | Journal of the Royal Society Interface |
ISSN: | 1742-5662 1742-5689 |
Popis: | Automated tracking of animal movement allows analyses that would not otherwise be possible by providing great quantities of data. The additional capability of tracking in real time—with minimal latency—opens up the experimental possibility of manipulating sensory feedback, thus allowing detailed explorations of the neural basis for control of behaviour. Here, we describe a system capable of tracking the three-dimensional position and body orientation of animals such as flies and birds. The system operates with less than 40 ms latency and can track multiple animals simultaneously. To achieve these results, a multi-target tracking algorithm was developed based on the extended Kalman filter and the nearest neighbour standard filter data association algorithm. In one implementation, an 11-camera system is capable of tracking three flies simultaneously at 60 frames per second using a gigabit network of nine standard Intel Pentium 4 and Core 2 Duo computers. This manuscript presents the rationale and details of the algorithms employed and shows three implementations of the system. An experiment was performed using the tracking system to measure the effect of visual contrast on the flight speed ofDrosophila melanogaster. At low contrasts, speed is more variable and faster on average than at high contrasts. Thus, the system is already a useful tool to study the neurobiology and behaviour of freely flying animals. If combined with other techniques, such as ‘virtual reality’-type computer graphics or genetic manipulation, the tracking system would offer a powerful new way to investigate the biology of flying animals. |
Databáze: | OpenAIRE |
Externí odkaz: |