TOWARDS MESH-BASED DEEP LEARNING FOR SEMANTIC SEGMENTATION IN PHOTOGRAMMETRY
| Autor: | M. Knott, R. Groenendijk |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Technology
business.industry Computer science Deep learning Engineering (General). Civil engineering (General) TA1501-1820 Photogrammetry Margin (machine learning) Search algorithm Chunking (psychology) Benchmark (computing) Polygon mesh Segmentation Computer vision Applied optics. Photonics Artificial intelligence TA1-2040 business ComputingMethodologies_COMPUTERGRAPHICS |
| Zdroj: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol V-2-2021, Pp 59-66 (2021) |
| ISSN: | 2194-9050 2194-9042 |
| Popis: | This research is the first to apply MeshCNN – a deep learning model that is specifically designed for 3D triangular meshes – in the photogrammetry domain. We highlight the challenges that arise when applying a mesh-based deep learning model to a photogrammetric mesh, especially w.r.t. data set properties. We provide solutions on how to prepare a remotely sensed mesh for a machine learning task. The most notable pre-processing step proposed is a novel application of the Breadth-First Search algorithm for chunking a large mesh into computable pieces. Furthermore, this work extends MeshCNN such that photometric features based on the mesh texture are considered in addition to the geometric information. Experiments show that including color information improves the predictive performance of the model by a large margin. Besides, experimental results indicate that segmentation performance could be advanced substantially with the introduction of a high-quality benchmark for semantic segmentation on meshes. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|