FlyBy CNN: A 3D surface segmentation framework

Autor: Gisele F. Neiva, Fabiana N. Soki, Camila Massaro, Hector F. Rios, Erika Benavides, Marilia Yatabe, Marcos Ioshida, Aron Aliaga-Del Castillo, Serge Brosset, Antonio Carlos de Oliveira Ruellas, Martin Styner, Lucia H. S. Cevidanes, Maxime Dumont, Juan Carlos Prieto, Marcela Gurgel, Beatriz Paniagua, Jonas Bianchi, Louis Boubolo
Rok vydání: 2021
Předmět:
Zdroj: Proc SPIE Int Soc Opt Eng
ISSN: 0277-786X
Popis: In this paper, we present FlyBy CNN, a novel deep learning based approach for 3D shape segmentation. FlyByCNN consists of sampling the surface of the 3D object from different view points and extracting surface features such as the normal vectors. The generated 2D images are then analyzed via 2D convolutional neural networks such as RUNETs. We test our framework in a dental application for segmentation of intra-oral surfaces. The RUNET is trained for the segmentation task using image pairs of surface features and image labels as ground truth. The resulting labels from each segmented image are put back into the surface thanks to our sampling approach that generates 1-1 correspondence of image pixels and triangles in the surface model. The segmentation task achieved an accuracy of 0.9.
Databáze: OpenAIRE