GANana: Unsupervised Domain Adaptation for Volumetric Regression of Fruit
| Autor: | Aaron S. Jackson, Zane K. J. Hartley, Michael P. Pound, Andrew P. French |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
business.industry
Computer science 3D reconstruction ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION Botany Plant culture Pattern recognition QH426-470 Real image Synthetic data Task (project management) Image (mathematics) Domain (software engineering) SB1-1110 Consistency (database systems) QK1-989 Genetics Artificial intelligence Focus (optics) business Agronomy and Crop Science Research Article |
| Zdroj: | Plant Phenomics, Vol 2021 (2021) Plant Phenomics |
| ISSN: | 2643-6515 |
| Popis: | 3D reconstruction of fruit is important as a key component of fruit grading and an important part of many size estimation pipelines. Like many computer vision challenges, the 3D reconstruction task suffers from a lack of readily available training data in most domains, with methods typically depending on large datasets of high-quality image-model pairs. In this paper, we propose an unsupervised domain-adaptation approach to 3D reconstruction where labelled images only exist in our source synthetic domain, and training is supplemented with different unlabelled datasets from the target real domain. We approach the problem of 3D reconstruction using volumetric regression and produce a training set of 25,000 pairs of images and volumes using hand-crafted 3D models of bananas rendered in a 3D modelling environment (Blender). Each image is then enhanced by a GAN to more closely match the domain of photographs of real images by introducing a volumetric consistency loss, improving performance of 3D reconstruction on real images. Our solution harnesses the cost benefits of synthetic data while still maintaining good performance on real world images. We focus this work on the task of 3D banana reconstruction from a single image, representing a common task in plant phenotyping, but this approach is general and may be adapted to any 3D reconstruction task including other plant species and organs. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|