On the Exact Recovery Conditions of 3D Human Motion from 2D Landmark Motion with Sparse Articulated Motion
| Autor: | Abed Malti |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2019 |
| Předmět: |
FOS: Computer and information sciences
Ideal (set theory) Property (programming) Computer science Computer Vision and Pattern Recognition (cs.CV) Information Theory (cs.IT) Computer Science - Information Theory Constraint (computer-aided design) Reprojection error Computer Science - Computer Vision and Pattern Recognition Motion (geometry) 020207 software engineering 02 engineering and technology Kinematics Circular motion Norm (mathematics) Signal Processing 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Algorithm Software |
| Popis: | In this paper, we address the problem of exact recovery condition in retrieving 3D human motion from 2D landmark motion. We use a skeletal kinematic model to represent the 3D motion as a vector of angular articulation motion. We address this problem based on the observation that at high tracking rate, regardless of the global rigid motion, only few angular articulations have non-zero motion. We propose a first ideal formulation with l 0 -norm to minimize the cardinal of non-zero angular articulation motion given an equality constraint on the time-differentiation of the reprojection error. The second relaxed formulation relies on an l 1 -norm to minimize the sum of absolute values of the angular articulation motion. This formulation has the advantage of being able to provide 3D motion even in the under-determined case when twice the number of 2D landmarks is smaller than the number of angular articulations. We define a specific property which is the Projective Kinematic Space Property (PKSP) that takes into account the reprojection constraint and the kinematic model. We prove that, for the relaxed formulation, we are able to recover the exact 3D human motion from 2D landmarks if and only if the PKSP property is verified. We further demonstrate that solving the relaxed formulation provides the same ground-truth solution as the ideal formulation if and only if the PKSP condition is filled. Results with simulated sparse skeletal angular motion show the ability of the proposed method to recover exact location of angular motion. We provide results on publicly available real data ( Human3.6M , Panoptic , MPI-I3DHP and 3DPW ) and show that our method is able to achieve state-of-the-art 3D reconstructions. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|