A convolutional neural network approach for counting and geolocating citrus-trees in UAV multispectral imagery

Autor: Lucas Prado Osco, Wesley Nunes Gonçalves, Neemias Buceli da Silva, Mauro dos Santos de Arruda, José Eduardo Creste, Érika Akemi Saito Moryia, Ana Paula Marques Ramos, Jonathan Li, Danillo Roberto Pereira, Nilton Nobuhiro Imai, Edson Takashi Matsubara, José Marcato Junior
Přispěvatelé: Universidade Federal de Mato Grosso do Sul (UFMS), Univ Western Sao Paulo, Soo Paulo State Univ, Univ Waterloo, Universidade Estadual Paulista (Unesp)
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Web of Science
Repositório Institucional da UNESP
Universidade Estadual Paulista (UNESP)
instacron:UNESP
Popis: Made available in DSpace on 2020-12-10T20:13:32Z (GMT). No. of bitstreams: 0 Previous issue date: 2020-02-01 Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) Fundect Visual inspection has been a common practice to determine the number of plants in orchards, which is a labor-intensive and time-consuming task. Deep learning algorithms have demonstrated great potential for counting plants on unmanned aerial vehicle (UAV)-borne sensor imagery. This paper presents a convolutional neural network (CNN) approach to address the challenge of estimating the number of citrus trees in highly dense orchards from UAV multispectral images. The method estimates a dense map with the confidence that a plant occurs in each pixel. A flight was conducted over an orchard of Valencia-orange trees planted in linear fashion, using a multispectral camera with four bands in green, red, red-edge and near-infrared. The approach was assessed considering the individual bands and their combinations. A total of 37,353 trees were adopted in point feature to evaluate the method. A variation of a (0.5; 1.0 and 1.5) was used to generate different ground truth confidence maps. Different stages (T) were also used to refine the confidence map predicted. To evaluate the robustness of our method, we compared it with two state-of-the-art object detection CNN methods (Faster R-CNN and RetinaNet). The results show better performance with the combination of green, red and near-infrared bands, achieving a Mean Absolute Error (MAE), Mean Square Error (MSE), R-2 and Normalized Root-MeanSquared Error (NRMSE) of 2.28, 9.82, 0.96 and 0.05, respectively. This band combination, when adopting sigma = 1 and a stage (T = 8), resulted in an R-2, MAE, Precision, Recall and F1 of 0.97, 2.05, 0.95, 0.96 and 0.95, respectively. Our method outperforms significantly object detection methods for counting and geolocation. It was concluded that our CNN approach developed to estimate the number and geolocation of citrus trees in highdensity orchards is satisfactory and is an effective strategy to replace the traditional visual inspection method to determine the number of plants in orchards trees. Univ Fed Mato Grosso do Sul, Fac Engn Architecture & Urbanism & Geog, Campo Grande, MS, Brazil Univ Fed Mato Grosso do Sul, Fac Comp Sci, Campo Grande, MS, Brazil Univ Western Sao Paulo, Fac Agron, Sao Paulo, Brazil Univ Western Sao Paulo, Fac Engn & Architecture, Sao Paulo, Brazil Soo Paulo State Univ, Dept Cartog Sci, BR-19060900 Presidente Prudente, SP, Brazil Univ Western Sao Paulo, Fac Comp Sci, Sao Paulo, Brazil Univ Waterloo, Dept Geog & Environm Management, Waterloo, ON N2L 3G1, Canada Univ Waterloo, Dept Syst Design Engn, Waterloo, ON N2L 3G1, Canada CNPq: 433783/2018-4 CNPq: 304173/2016-9 CAPES: 88881.311850/2018-01 Fundect: 59/300.066/2015
Databáze: OpenAIRE