Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
| Autor: | Hongrui Cai, Zhuang Peng, Juyong Zhang, Yudong Guo |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Source code Computer science Computer Vision and Pattern Recognition (cs.CV) media_common.quotation_subject Computer Science - Computer Vision and Pattern Recognition ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION GeneralLiterature_MISCELLANEOUS Computer Science - Graphics media_common Abstraction (linguistics) Landmark Artificial neural network business.industry Orientation (computer vision) Pattern recognition Computer Graphics and Computer-Aided Design Graphics (cs.GR) Modeling and Simulation Face (geometry) Parametric model Algorithm design Geometry and Topology Artificial intelligence business Software |
| Zdroj: | Graphical Models. 115:101103 |
| ISSN: | 1524-0703 |
| DOI: | 10.1016/j.gmod.2021.101103 |
| Popis: | Caricature is an artistic abstraction of the human face by distorting or exaggerating certain facial features, while still retains a likeness with the given face. Due to the large diversity of geometric and texture variations, automatic landmark detection and 3D face reconstruction for caricature is a challenging problem and has rarely been studied before. In this paper, we propose the first automatic method for this task by a novel 3D approach. To this end, we first build a dataset with various styles of 2D caricatures and their corresponding 3D shapes, and then build a parametric model on vertex based deformation space for 3D caricature face. Based on the constructed dataset and the nonlinear parametric model, we propose a neural network based method to regress the 3D face shape and orientation from the input 2D caricature image. Ablation studies and comparison with state-of-the-art methods demonstrate the effectiveness of our algorithm design. Extensive experimental results demonstrate that our method works well for various caricatures. Our constructed dataset, source code and trained model are available at https://github.com/Juyong/CaricatureFace. Comment: The code is available at https://github.com/Juyong/CaricatureFace |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect