3D Bird Reconstruction: a Dataset, Model, and Shape Recovery from a Single View
Autor: | Bernd G. Pfrommer, Marc A. Badger, Adarsh Modh, Marc F. Schmidt, Kostas Daniilidis, Ammon Perkes, Nikos Kolotouros, Yufu Wang |
---|---|
Rok vydání: | 2020 |
Předmět: |
FOS: Computer and information sciences
Computer science Computer Vision and Pattern Recognition (cs.CV) Computer Science - Computer Vision and Pattern Recognition ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Article Mesh model 03 medical and health sciences 0202 electrical engineering electronic engineering information engineering Code (cryptography) Computer vision Pose 030304 developmental biology ComputingMethodologies_COMPUTERGRAPHICS 0303 health sciences business.industry Shape regression 020207 software engineering Social cue Pipeline (software) Single view Social animal I.4.8 Artificial intelligence business |
Zdroj: | Computer Vision – ECCV 2020 ISBN: 9783030585228 ECCV (18) Comput Vis ECCV |
DOI: | 10.48550/arxiv.2008.06133 |
Popis: | Automated capture of animal pose is transforming how we study neuroscience and social behavior. Movements carry important social cues, but current methods are not able to robustly estimate pose and shape of animals, particularly for social animals such as birds, which are often occluded by each other and objects in the environment. To address this problem, we first introduce a model and multi-view optimization approach, which we use to capture the unique shape and pose space displayed by live birds. We then introduce a pipeline and experiments for keypoint, mask, pose, and shape regression that recovers accurate avian postures from single views. Finally, we provide extensive multi-view keypoint and mask annotations collected from a group of 15 social birds housed together in an outdoor aviary. The project website with videos, results, code, mesh model, and the Penn Aviary Dataset can be found at https://marcbadger.github.io/avian-mesh. Comment: In ECCV 2020 |
Databáze: | OpenAIRE |
Externí odkaz: |