Multi-view 3D Reconstruction Based on Deformable Convolution and Laplace Pyramid Residuals.

Autor: Zhaoming Hao, Ziyang Zhang, Hongyan Li, Baoqing Xu, Xiaoqiong Zhang, Meng Xu, Weifeng Wang
Předmět:
Zdroj: IAENG International Journal of Computer Science; Jul2024, Vol. 51 Issue 7, p896-905, 10p
Abstrakt: The current deep learning-based multi-view stereo point cloud reconstruction method has been found to have low reconstruction accuracy for target boundary contours. This paper proposes a high-precision and high-completeness multi-view stereo reconstruction network (DL-PatchMatchNet) based on an improved PatchMatchNet. Firstly, to increase the robustness of the model's feature extraction, a deformable convolution-based feature extraction network is proposed. Secondly, to improve model reconstruction of target contours and boundaries, the Laplace pyramid residuals are introduced to guide the decoding process of the model. Lastly, a fused loss function (GSS) is proposed to enhance the accuracy of point cloud reconstruction by simultaneously considering geometric consistency loss, structural similarity metric and smoothing loss. The results of the experimental analysis on the DTU dataset demonstrate that the DL-PatchMatchNet model exhibits a lower mean absolute error (MAE) and error rate (ER) than other competing networks. This performance is reflected in the high accuracy and completeness of reconstruction achieved by the DL-PatchMatchNet model. [ABSTRACT FROM AUTHOR]
Databáze: Supplemental Index