Denoise and Contrast for Category Agnostic Shape Completion
| Autor: | Diego Valsesia, Tatiana Tommasi, Enrico Magli, Giulia Fracastoro, Antonio Alliegro |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
business.industry Computer science Computer Vision and Pattern Recognition (cs.CV) Deep learning Frame (networking) Computer Science - Computer Vision and Pattern Recognition Context (language use) Pattern recognition 02 engineering and technology Semantics 030218 nuclear medicine & medical imaging Task (project management) 03 medical and health sciences 0302 clinical medicine object completion Robustness (computer science) 0202 electrical engineering electronic engineering information engineering Embedding 3d learning 020201 artificial intelligence & image processing Artificial intelligence Representation (mathematics) business |
| Zdroj: | CVPR |
| Popis: | In this paper, we present a deep learning model that exploits the power of self-supervision to perform 3D point cloud completion, estimating the missing part and a context region around it. Local and global information are encoded in a combined embedding. A denoising pretext task provides the network with the needed local cues, decoupled from the high-level semantics and naturally shared over multiple classes. On the other hand, contrastive learning maximizes the agreement between variants of the same shape with different missing portions, thus producing a representation which captures the global appearance of the shape. The combined embedding inherits category-agnostic properties from the chosen pretext tasks. Differently from existing approaches, this allows to better generalize the completion properties to new categories unseen at training time. Moreover, while decoding the obtained joint representation, we better blend the reconstructed missing part with the partial shape by paying attention to its known surrounding region and reconstructing this frame as auxiliary objective. Our extensive experiments and detailed ablation on the ShapeNet dataset show the effectiveness of each part of the method with new state of the art results. Our quantitative and qualitative analysis confirms how our approach is able to work on novel categories without relying neither on classification and shape symmetry priors, nor on adversarial training procedures. Accepted at CVPR 2021 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|