SASO: Joint 3D semantic‐instance segmentation via multi‐scale semantic association and salient point clustering optimization

Autor: Jingang Tan, Lili Chen, Kangru Wang, Jiamao Li, Xiaolin Zhang
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: IET Computer Vision, Vol 15, Iss 5, Pp 366-379 (2021)
Druh dokumentu: article
ISSN: 1751-9640
1751-9632
DOI: 10.1049/cvi2.12033
Popis: Abstract Jointly performing semantic and instance segmentation of 3D point cloud remains a challenging task. In this work, a novel framework called joint 3D semantic‐instance segmentation via multi‐scale Semantic Association and Salient point clustering Optimization was proposed to tackle this problem. Inspired by the inherent correlation among objects in semantic space, a Multi‐scale Semantic Association (MSA) module to explore the constructive effect of the context information for semantic segmentation is designed. For instance, segmentation, different from previous works utilising clustering only in inference procedure, a Salient Point Clustering Optimization (SPCO) module is put forward to introduce the clustering algorithm into the training phase, which impels the network to focus on points that are difficult to be distinguished. Furthermore, affected by the inherent structure of indoor scenes, the problem of uneven distribution of categories has rarely been considered in the previous work, but it significantly limits the performance of 3D scene perception. To address the issue, an adaptive Water Filling Sampling (WFS) algorithm to balance the category distribution of training data is presented. Extensive experiments on a variety of changing datasets show that the authors’ method outperforms the state‐of‐the‐art methods in both tasks of semantic segmentation and instance segmentation.
Databáze: Directory of Open Access Journals
Externí odkaz: