title: Structured Light-Based 3D Reconstruction System for Plants.
abstract: Camera-based 3D reconstruction of physical objects is one of the most popular computer vision trends in recent years. Many systems have been built to model different real-world subjects, but there is lack of a completely robust system for plants. This paper presents a full 3D reconstruction system that incorporates both hardware structures (including the proposed structured light system to enhance textures on object surfaces) and software algorithms (including the proposed 3D point cloud registration and plant feature measurement). This paper demonstrates the ability to produce 3D models of whole plants created from multiple pairs of stereo images taken at different viewing angles, without the need to destructively cut away any parts of a plant. The ability to accurately predict phenotyping features, such as the number of leaves, plant height, leaf size and internode distances, is also demonstrated. Experimental results show that, for plants having a range of leaf sizes and a distance between leaves appropriate for the hardware design, the algorithms successfully predict phenotyping features in the target crops, with a recall of 0.97 and a precision of 0.89 for leaf detection and less than a 13-mm error for plant size, leaf size and internode distance.
authors.affiliation: Department of Computer Science, University of California, Davis, CA 95616, USA. thnguyen@ucdavis.edu.
authors.forename: Thuy Tuong
authors.initials: TT
authors.lastname: Nguyen
authors.affiliation: Department of Biological and Agricultural Engineering, University of California, Davis, CA 95616, USA. dcslaughter@ucdavis.edu.
authors.forename: David C
authors.initials: DC
authors.lastname: Slaughter
authors.affiliation: Department of Computer Science, University of California, Davis, CA 95616, USA. max@cs.ucdavis.edu.
authors.forename: Nelson
authors.initials: N
authors.lastname: Max
authors.affiliation: Department of Plant Biology, University of California, Davis, CA 95616, USA. jnmaloof@ucdavis.edu.
authors.forename: Julin N
authors.initials: JN
authors.lastname: Maloof
authors.affiliation: Department of Plant Biology, University of California, Davis, CA 95616, USA. nrsinha@ucdavis.edu.
authors.forename: Neelima
authors.initials: N
authors.lastname: Sinha
mesh_terms: D000465:Algorithms; D001937:Brassica / Q000033:anatomy & histology; D018553:Cucumis sativus / Q000033:anatomy & histology; D021621:Imaging, Three-Dimensional / Q000379:methods*; D008027:Light; D018551:Solanum lycopersicum / Q000033:anatomy & histology; D009929:Organ Size; D010641:Phenotype; D018515:Plant Leaves / Q000033:anatomy & histology; D010944:Plants / Q000033:anatomy & histology*; D012987:Soil
chemical_list: D012987:Soil
keywords: 3D feature extraction; 3D reconstruction; plant phenotyping; point cloud; stereo vision; structured light