Multilinear Modelling of Faces and Expressions
| Autor: | Sami S. Brandt, Hanno Ackermann, Stella Grasshof, Jörn Ostermann |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
expression transfer
Multilinear map Computer science 02 engineering and technology Pattern Recognition Automated Artificial Intelligence Tensor (intrinsic definition) 0202 electrical engineering electronic engineering information engineering Humans Point (geometry) person transfer Tensor Models Statistical 3D-reconstruction business.industry Applied Mathematics Statistical shape model Pattern recognition Linear subspace Expression (mathematics) Computational Theory and Mathematics Face (geometry) Face HOSVD 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence tensor model business Software Subspace topology Algorithms |
| Zdroj: | Grasshof, S, Ackermann, H, Brandt, S S & Ostermann, J 2021, ' Multilinear Modelling of Faces and Expressions ', I E E E Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 10, pp. 3540-3554 . https://doi.org/10.1109/TPAMI.2020.2986496 |
| DOI: | 10.1109/TPAMI.2020.2986496 |
| Popis: | In this work, we present a new versatile 3D multilinear statistical face model, based on a tensor factorisation of 3D face scans, that decomposes the shapes into person and expression subspaces. Investigation of the expression subspace reveals an inherent low-dimensional substructure, and further, a star-shaped structure. This is due to two novel findings. (1) Increasing the strength of one emotion approximately forms a linear trajectory in the subspace. (2) All these trajectories intersect at a single point – not at the neutral expression as assumed by almost all prior works—but at an apathetic expression. We utilise these structural findings by reparameterising the expression subspace by the fourth-order moment tensor centred at the point of apathy. We propose a 3D face reconstruction method from single or multiple 2D projections by assuming an uncalibrated projective camera model. The non-linearity caused by the perspective projection can be neatly included into the model. The proposed algorithm separates person and expression subspaces convincingly, and enables flexible, natural modelling of expressions for a wide variety of human faces. Applying the method on independent faces showed that morphing between different persons and expressions can be performed without strong deformations. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|