title: Towards Automated Large-Scale 3D Phenotyping of Vineyards under Field Conditions.
abstract: In viticulture, phenotypic data are traditionally collected directly in the field via visual and manual means by an experienced person. This approach is time consuming, subjective and prone to human errors. In recent years, research therefore has focused strongly on developing automated and non-invasive sensor-based methods to increase data acquisition speed, enhance measurement accuracy and objectivity and to reduce labor costs. While many 2D methods based on image processing have been proposed for field phenotyping, only a few 3D solutions are found in the literature. A track-driven vehicle consisting of a camera system, a real-time-kinematic GPS system for positioning, as well as hardware for vehicle control, image storage and acquisition is used to visually capture a whole vine row canopy with georeferenced RGB images. In the first post-processing step, these images were used within a multi-view-stereo software to reconstruct a textured 3D point cloud of the whole grapevine row. A classification algorithm is then used in the second step to automatically classify the raw point cloud data into the semantic plant components, grape bunches and canopy. In the third step, phenotypic data for the semantic objects is gathered using the classification results obtaining the quantity of grape bunches, berries and the berry diameter.
authors.affiliation: Institute of Geodesy and Geoinformation, Department of Geodesy, University of Bonn, Nussallee 17, 53115 Bonn, Germany. rose@igg.uni-bonn.de.
authors.forename: Johann Christian
authors.initials: JC
authors.lastname: Rose
authors.affiliation: Julius Kühn-Institut, Federal Research Centre of Cultivated Plants, Institute for Grapevine Breeding Geilweilerhof, 76833 Siebeldingen, Germany. anna.kicherer@julius-kuehn.de.
authors.forename: Anna
authors.initials: A
authors.lastname: Kicherer
authors.affiliation: Institute of Geodesy and Geoinformation, Department of Geodesy, University of Bonn, Nussallee 17, 53115 Bonn, Germany. wieland@igg.uni-bonn.de.
authors.forename: Markus
authors.initials: M
authors.lastname: Wieland
authors.affiliation: Institute of Geodesy and Geoinformation, Department of Geodesy, University of Bonn, Nussallee 17, 53115 Bonn, Germany. klingbeil@igg.uni-bonn.de.
authors.forename: Lasse
authors.initials: L
authors.lastname: Klingbeil
authors.affiliation: Julius Kühn-Institut, Federal Research Centre of Cultivated Plants, Institute for Grapevine Breeding Geilweilerhof, 76833 Siebeldingen, Germany. reinhard.toepfer@julius-kuehn.de.
authors.forename: Reinhard
authors.initials: R
authors.lastname: Töpfer
authors.affiliation: Institute of Geodesy and Geoinformation, Department of Geodesy, University of Bonn, Nussallee 17, 53115 Bonn, Germany. heiner.kuhlmann@uni-bonn.de.
authors.forename: Heiner
authors.initials: H
authors.lastname: Kuhlmann
mesh_terms: D000465:Algorithms; D001331:Automation; D005638:Fruit / Q000033:anatomy & histology; D021621:Imaging, Three-Dimensional; D009929:Organ Size; D010641:Phenotype; D018520:Plant Shoots / Q000033:anatomy & histology; D012371:Robotics; D027843:Vitis / Q000033:anatomy & histology*
keywords: 3D point cloud; berry diameter; classification; field phenotyping; multi-view-stereo; number of berries; number of grape bunches; viticulture