title: Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry.
abstract: This paper presents a novel multi-sensor framework to efficiently identify, track, localise and map every piece of fruit in a commercial mango orchard. A multiple viewpoint approach is used to solve the problem of occlusion, thus avoiding the need for labour-intensive field calibration to estimate actual yield. Fruit are detected in images using a state-of-the-art faster R-CNN detector, and pair-wise correspondences are established between images using trajectory data provided by a navigation system. A novel LiDAR component automatically generates image masks for each canopy, allowing each fruit to be associated with the corresponding tree. The tracked fruit are triangulated to locate them in 3D, enabling a number of spatial statistics per tree, row or orchard block. A total of 522 trees and 71,609 mangoes were scanned on a Calypso mango orchard near Bundaberg, Queensland, Australia, with 16 trees counted by hand for validation, both on the tree and after harvest. The results show that single, dual and multi-view methods can all provide precise yield estimates, but only the proposed multi-view approach can do so without calibration, with an error rate of only 1.36% for individual trees.
authors.affiliation: Division of Automatic Control Department of Electrical Engineering, Linköping University, Linköping SE-581 83, Sweden. madst314@student.liu.se.
authors.forename: Madeleine
authors.initials: M
authors.lastname: Stein
authors.affiliation: The Australian Centre for Field Robotics (ACFR), Department of Aerospace, Mechanical and Mechatronic Engineering (AMME),The University of Sydney, Sydney, NSW 2006, Australia. suchet.bargoti@sydney.edu.au.
authors.forename: Suchet
authors.initials: S
authors.lastname: Bargoti
authors.affiliation: The Australian Centre for Field Robotics (ACFR), Department of Aerospace, Mechanical and Mechatronic Engineering (AMME),The University of Sydney, Sydney, NSW 2006, Australia. james.underwood@sydney.edu.au.
authors.forename: James
authors.initials: J
authors.lastname: Underwood
mesh_terms: D000465:Algorithms; D015374:Biosensing Techniques / Q000379:methods*; D005638:Fruit; D031022:Mangifera; D012371:Robotics
keywords: agrivision; computer vision; field robotics; fruit detection; yield estimation