Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages

被引:137
作者
Chen, Yang [1 ,2 ]
Lee, Won Suk [2 ]
Gan, Hao [3 ]
Peres, Natalia [4 ]
Fraisse, Clyde [2 ]
Zhang, Yanchao [5 ]
He, Yong [1 ]
机构
[1] Zhejiang Univ, Coll Biosyst Engn & Food Sci, Hangzhou 310058, Zhejiang, Peoples R China
[2] Univ Florida, Dept Agr & Biol Engn, Gainesville, FL 32611 USA
[3] Univ Tennessee, Inst Agr, Dept Biosyst Engn & Soil Sci, Knoxville, TN 37996 USA
[4] Univ Florida, Gulf Coast Res & Educ Ctr, Wimauma, FL 33598 USA
[5] Zhejiang Sci Tech Univ, Fac Mech Engn & Automat, Hangzhou 310018, Zhejiang, Peoples R China
关键词
strawberry yield prediction; unmanned aerial vehicle; orthoimages; deep neural network; distribution map; GROWTH; UAV; FRUIT; SEASON;
D O I
10.3390/rs11131584
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Strawberry growers in Florida suffer from a lack of efficient and accurate yield forecasts for strawberries, which would allow them to allocate optimal labor and equipment, as well as other resources for harvesting, transportation, and marketing. Accurate estimation of the number of strawberry flowers and their distribution in a strawberry field is, therefore, imperative for predicting the coming strawberry yield. Usually, the number of flowers and their distribution are estimated manually, which is time-consuming, labor-intensive, and subjective. In this paper, we develop an automatic strawberry flower detection system for yield prediction with minimal labor and time costs. The system used a small unmanned aerial vehicle (UAV) (DJI Technology Co., Ltd., Shenzhen, China) equipped with an RGB (red, green, blue) camera to capture near-ground images of two varieties (Sensation and Radiance) at two different heights (2 m and 3 m) and built orthoimages of a 402 m(2) strawberry field. The orthoimages were automatically processed using the Pix4D software and split into sequential pieces for deep learning detection. A faster region-based convolutional neural network (R-CNN), a state-of-the-art deep neural network model, was chosen for the detection and counting of the number of flowers, mature strawberries, and immature strawberries. The mean average precision (mAP) was 0.83 for all detected objects at 2 m heights and 0.72 for all detected objects at 3 m heights. We adopted this model to count strawberry flowers in November and December from 2 m aerial images and compared the results with a manual count. The average deep learning counting accuracy was 84.1% with average occlusion of 13.5%. Using this system could provide accurate counts of strawberry flowers, which can be used to forecast future yields and build distribution maps to help farmers observe the growth cycle of strawberry fields.
引用
收藏
页数:21
相关论文
共 53 条
[1]  
Abdel-Mawgoud AMR, 2010, EUR J SCI RES, V39, P161
[2]  
[Anonymous], 14091556 ARXIV
[3]  
[Anonymous], P 2004 ASAE ANN M KY
[4]  
[Anonymous], FLOR CROPS SEAS AV T
[5]  
[Anonymous], COMPUT ELECT AGR
[6]  
[Anonymous], PROC CVPR IEEE
[7]  
[Anonymous], IEEE T PATTERN ANAL
[8]  
[Anonymous], REMOTE SENS SPAT INF
[9]  
[Anonymous], 2017, P 2017 ANN INT M ASA
[10]   Assessment of vineyard water status variability by thermal and multispectral imagery using an unmanned aerial vehicle (UAV) [J].
Baluja, Javier ;
Diago, Maria P. ;
Balda, Pedro ;
Zorer, Roberto ;
Meggio, Franco ;
Morales, Fermin ;
Tardaguila, Javier .
IRRIGATION SCIENCE, 2012, 30 (06) :511-522