Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages

被引:137
作者
Chen, Yang [1 ,2 ]
Lee, Won Suk [2 ]
Gan, Hao [3 ]
Peres, Natalia [4 ]
Fraisse, Clyde [2 ]
Zhang, Yanchao [5 ]
He, Yong [1 ]
机构
[1] Zhejiang Univ, Coll Biosyst Engn & Food Sci, Hangzhou 310058, Zhejiang, Peoples R China
[2] Univ Florida, Dept Agr & Biol Engn, Gainesville, FL 32611 USA
[3] Univ Tennessee, Inst Agr, Dept Biosyst Engn & Soil Sci, Knoxville, TN 37996 USA
[4] Univ Florida, Gulf Coast Res & Educ Ctr, Wimauma, FL 33598 USA
[5] Zhejiang Sci Tech Univ, Fac Mech Engn & Automat, Hangzhou 310018, Zhejiang, Peoples R China
关键词
strawberry yield prediction; unmanned aerial vehicle; orthoimages; deep neural network; distribution map; GROWTH; UAV; FRUIT; SEASON;
D O I
10.3390/rs11131584
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Strawberry growers in Florida suffer from a lack of efficient and accurate yield forecasts for strawberries, which would allow them to allocate optimal labor and equipment, as well as other resources for harvesting, transportation, and marketing. Accurate estimation of the number of strawberry flowers and their distribution in a strawberry field is, therefore, imperative for predicting the coming strawberry yield. Usually, the number of flowers and their distribution are estimated manually, which is time-consuming, labor-intensive, and subjective. In this paper, we develop an automatic strawberry flower detection system for yield prediction with minimal labor and time costs. The system used a small unmanned aerial vehicle (UAV) (DJI Technology Co., Ltd., Shenzhen, China) equipped with an RGB (red, green, blue) camera to capture near-ground images of two varieties (Sensation and Radiance) at two different heights (2 m and 3 m) and built orthoimages of a 402 m(2) strawberry field. The orthoimages were automatically processed using the Pix4D software and split into sequential pieces for deep learning detection. A faster region-based convolutional neural network (R-CNN), a state-of-the-art deep neural network model, was chosen for the detection and counting of the number of flowers, mature strawberries, and immature strawberries. The mean average precision (mAP) was 0.83 for all detected objects at 2 m heights and 0.72 for all detected objects at 3 m heights. We adopted this model to count strawberry flowers in November and December from 2 m aerial images and compared the results with a manual count. The average deep learning counting accuracy was 84.1% with average occlusion of 13.5%. Using this system could provide accurate counts of strawberry flowers, which can be used to forecast future yields and build distribution maps to help farmers observe the growth cycle of strawberry fields.
引用
收藏
页数:21
相关论文
共 53 条
[41]   Strawberry Production, Growth and Development in Northern Climates [J].
Sonsteby, Anita ;
Karhu, Saila .
INTERNATIONAL JOURNAL OF FRUIT SCIENCE, 2005, 5 (01) :107-114
[42]  
Taylor P, 2008, ROUTL UACES CONTEMP, V5, P24
[43]   Configuration and Specifications of an Unmanned Aerial Vehicle (UAV) for Early Site Specific Weed Management [J].
Torres-Sanchez, Jorge ;
Lopez-Granados, Francisca ;
Isabel De Castro, Ana ;
Manuel Pena-Barragan, Jose .
PLOS ONE, 2013, 8 (03)
[44]  
Triggs B., 2000, VISION ALGORITHMS TH, P298, DOI [DOI 10.1007/3-540-44480-7_21THISWORKWASSUPPORTEDINPARTBYTHEEUROPEAN, DOI 10.1007/3-540-44480-7_21]
[45]   An object-oriented framework for distributed hydrologic and geomorphic modeling using triangulated irregular networks [J].
Tucker, GE ;
Lancaster, ST ;
Gasparini, NM ;
Bras, RL ;
Rybarczyk, SM .
COMPUTERS & GEOSCIENCES, 2001, 27 (08) :959-973
[46]   Selective Search for Object Recognition [J].
Uijlings, J. R. R. ;
van de Sande, K. E. A. ;
Gevers, T. ;
Smeulders, A. W. M. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2013, 104 (02) :154-171
[47]   Effect of plant growth temperature on antioxidant capacity in strawberry [J].
Wang, SY ;
Zheng, W .
JOURNAL OF AGRICULTURAL AND FOOD CHEMISTRY, 2001, 49 (10) :4977-4982
[48]   Development of a low-cost agricultural remote sensing system based on an autonomous unmanned aerial vehicle (UAV) [J].
Xiang, Haitao ;
Tian, Lei .
BIOSYSTEMS ENGINEERING, 2011, 108 (02) :174-190
[49]   Using lightweight unmanned aerial vehicles to monitor tropical forest recovery [J].
Zahawi, Rakan A. ;
Dandois, Jonathan P. ;
Holl, Karen D. ;
Nadwodny, Dana ;
Reid, J. Leighton ;
Ellis, Erle C. .
BIOLOGICAL CONSERVATION, 2015, 186 :287-295
[50]   Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods [J].
Zarco-Tejada, P. J. ;
Diaz-Varela, R. ;
Angileri, V. ;
Loudjani, P. .
EUROPEAN JOURNAL OF AGRONOMY, 2014, 55 :89-99