HUMBI: A Large Multiview Dataset of Human Body Expressions and Benchmark Challenge
Autor: | Jae Shin Yoon, Zhixuan Yu, Jaesik Park, Hyun Soo Park |
---|---|
Rok vydání: | 2023 |
Předmět: |
FOS: Computer and information sciences
Computational Theory and Mathematics Artificial Intelligence Computer Vision and Pattern Recognition (cs.CV) Applied Mathematics Computer Science - Computer Vision and Pattern Recognition 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing 02 engineering and technology Computer Vision and Pattern Recognition Software |
Zdroj: | IEEE Transactions on Pattern Analysis and Machine Intelligence. 45:623-640 |
ISSN: | 1939-3539 0162-8828 |
Popis: | This paper presents a new large multiview dataset called HUMBI for human body expressions with natural clothing. The goal of HUMBI is to facilitate modeling view-specific appearance and geometry of five primary body signals including gaze, face, hand, body, and garment from assorted people. 107 synchronized HD cameras are used to capture 772 distinctive subjects across gender, ethnicity, age, and style. With the multiview image streams, we reconstruct high fidelity body expressions using 3D mesh models, which allows representing view-specific appearance. We demonstrate that HUMBI is highly effective in learning and reconstructing a complete human model and is complementary to the existing datasets of human body expressions with limited views and subjects such as MPII-Gaze, Multi-PIE, Human3.6M, and Panoptic Studio datasets. Based on HUMBI, we formulate a new benchmark challenge of a pose-guided appearance rendering task that aims to substantially extend photorealism in modeling diverse human expressions in 3D, which is the key enabling factor of authentic social tele-presence. HUMBI is publicly available at http://humbi-data.net Comment: 18 pages; Accepted to TPAMI |
Databáze: | OpenAIRE |
Externí odkaz: |