Lincoln's Annotated Spatio-Temporal Strawberry Dataset (LAST-Straw) (2403.00566v1)
Abstract: Automated phenotyping of plants for breeding and plant studies promises to provide quantitative metrics on plant traits at a previously unattainable observation frequency. Developers of tools for performing high-throughput phenotyping are, however, constrained by the availability of relevant datasets on which to perform validation. To this end, we present a spatio-temporal dataset of 3D point clouds of strawberry plants for two varieties, totalling 84 individual point clouds. We focus on the end use of such tools - the extraction of biologically relevant phenotypes - and demonstrate a phenotyping pipeline on the dataset. This comprises of the steps, including; segmentation, skeletonisation and tracking, and we detail how each stage facilitates the extraction of different phenotypes or provision of data insights. We particularly note that assessment is focused on the validation of phenotypes, extracted from the representations acquired at each step of the pipeline, rather than singularly focusing on assessing the representation itself. Therefore, where possible, we provide \textit{in silico} ground truth baselines for the phenotypes extracted at each step and introduce methodology for the quantitative assessment of skeletonisation and the length trait extracted thereof. This dataset contributes to the corpus of freely available agricultural/horticultural spatio-temporal data for the development of next-generation phenotyping tools, increasing the number of plant varieties available for research in this field and providing a basis for genuine comparison of new phenotyping methodology.
- Large-scale standardized phenotyping of strawberry in RosBREED, Journal- American Pomological Society 67 (2013) 205–216.
- Resources for image-based high-throughput phenotyping in crops and data sharing challenges, Plant Physiology 187 (2021) 699–715. doi:10.1093/plphys/kiab301.
- A review of computer vision technologies for plant phenotyping, Computers and Electronics in Agriculture 176 (2020) 105672. doi:10.1016/j.compag.2020.105672.
- S. Paulus, Measuring crops in 3D: Using geometry for plant phenotyping, Plant Methods 15 (2019) 103. doi:10.1186/s13007-019-0490-0.
- The added value of 3D point clouds for digital plant phenotyping – a case study on internode length measurements in cucumber, Biosystems Engineering 234 (2023) 1–12. doi:10.1016/j.biosystemseng.2023.08.010.
- Leveraging image analysis for high-throughput plant phenotyping, Frontiers in Plant Science 10 (2019). doi:10.3389/fpls.2019.00508.
- Y. Jiang, C. Li, Convolutional neural networks for image-based high-throughput plant phenotyping: A review, Plant Phenomics 2020 (2020) 4152816. doi:10.34133/2020/4152816.
- A novel 3D imaging system for strawberry phenotyping, Plant Methods 13 (2017) 93. doi:10.1186/s13007-017-0243-x.
- Leveraging image analysis to compute 3D plant phenotypes based on voxel-grid plant reconstruction, Frontiers in Plant Science 11 (2020). doi:10.3389/fpls.2020.521431.
- Images carried before the fire: The power, promise, and responsibility of latent phenotyping in plants, The Plant Phenome Journal 4 (2021) e20023. doi:10.1002/ppj2.20023.
- High-throughput phenotyping for breeding targets—current status and future directions of strawberry trait automation, Plants, People, Planet (2022) 1–12. doi:10.1002/ppp3.10275.
- Y. Lu, S. Young, A survey of public datasets for computer vision tasks in precision agriculture, Computers and Electronics in Agriculture 178 (2020) 105760. doi:10.1016/j.compag.2020.105760.
- A novel benchmark RGBD dataset for dormant apple trees and its application to automatic pruning, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016, pp. 347–354. doi:10.1109/CVPRW.2016.50.
- Lettuce production in intelligent greenhouses—3D imaging and computer vision for plant spacing decisions, Sensors 23 (2023) 2929. doi:10.3390/s23062929.
- A spatio temporal spectral framework for plant stress phenotyping, Plant Methods 15 (2019) 13.
- Multi-modality imagery database for plant phenotyping, Machine Vision and Applications 27 (2016) 735–749. doi:10.1007/s00138-015-0734-6.
- LFuji-air dataset: Annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions, Data in Brief 29 (2020) 105248. doi:10.1016/j.dib.2020.105248.
- ROSE-X: an annotated data set for evaluation of 3D plant organ segmentation methods, Plant Methods 16 (2020) 28. doi:10.1186/s13007-020-00573-w.
- Soybean-MVS: annotated three-dimensional model dataset of whole growth period soybeans for 3D plant organ segmentation, Agriculture 13 (2023) 1321. doi:10.3390/agriculture13071321.
- Pheno4D: A spatio-temporal dataset of maize and tomato plant point clouds for phenotyping and advanced plant analysis, PLoS ONE 16 (2021) e0256340. doi:10.1371/journal.pone.0256340.
- The growing strawberries dataset: Tracking multiple objects with biological development over an extended period, in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024, pp. 7104–7114. doi:10.4121/e3b31ece-cc88-4638-be10-8ccdd4c5f2f7.v1.
- Knowledge and heuristic-based modeling of laser-scanned trees, ACM Transactions on Graphics 26 (2007) 19–es. doi:10.1145/1289603.1289610.
- How to make sense of 3D representations for plant phenotyping: a compendium of processing and analysis techniques, Plant Methods 19 (2023) 60. doi:10.1186/s13007-023-01031-z.
- Segmentation-based 4D registration of plants point clouds for phenotyping, in: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020, pp. 2433–2439. doi:10.1109/IROS45743.2020.9340918.
- Deep semantic segmentation of 3D plant point clouds, in: Towards Autonomous Robotic Systems, TAROS 2021, Springer, Lincoln, UK, September 8–10, 2021, Proceedings 22, 2021, pp. 36–45. doi:10.1007/978-3-030-89177-0_4.
- 3D data-augmentation methods for semantic segmentation of tomato plant parts, Frontiers in Plant Science 14 (2023). doi:10.3389/fpls.2023.1045545.
- Dissecting spatiotemporal biomass accumulation in barley under different water regimes using high-throughput image analysis, Plant, Cell & Environment 38 (2015) 1980–1996. doi:10.1111/pce.12516.
- Robust surface reconstruction of plant leaves from 3D point clouds, Plant Phenomics 2021 (2021) 3184185. doi:10.34133/2021/3184185.
- Geometric models for plant leaf area estimation from 3D point clouds: a comparative study, Graphics and Visual Computing 7 (2022) 200057.
- The ball-pivoting algorithm for surface reconstruction, IEEE Transactions on Visualization and Computer Graphics 5 (1999) 349–359. doi:10.1109/2945.817351.
- MeshLab: an open-source mesh processing tool, in: V. Scarano, R. D. Chiara, U. Erra (Eds.), Eurographics Italian Chapter Conference, The Eurographics Association, 2008. doi:10.2312/LocalChapterEvents/ItalChap/ItalianChapConf2008/129-136.
- Automated surface area estimation of plants based on 3D point clouds, in: 7th workshop on Computer Vision in Plant Phenotyping and Agriculture at ICCV, 2021.
- Spatio-temporal non-rigid registration of 3D point clouds of plants, in: 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 3112–3118. doi:10.1109/ICRA40945.2020.9197569.
- Robust skeletonization for plant root structure reconstruction from MRI, in: 2020 25th International Conference on Pattern Recognition (ICPR), 2021, pp. 10689–10696. doi:10.1109/ICPR48806.2021.9413045.
- D. F. Crouse, On implementing 2D rectangular assignment algorithms, IEEE Transactions on Aerospace and Electronic Systems 52 (2016) 1679–1696. doi:10.1109/TAES.2016.140952.
- A. Chaudhury, C. Godin, Skeletonization of plant point cloud data using stochastic optimization framework, Frontiers in Plant Science 11 (2020). doi:10.3389/fpls.2020.00773.
- L1-medial skeleton of point cloud, ACM Transactions on Graphics 32 (2013) 65. doi:10.1145/2461912.2461913.
- Registration of spatio-temporal point clouds of plants for phenotyping, PloS ONE 16 (2021) e0247243. doi:10.1371/journal.pone.0247243.
- Multi-scale space-time registration of growing plants, in: 2021 International Conference on 3D Vision (3DV), IEEE, 2021, pp. 310–319. doi:10.1109/3DV53792.2021.00041.
- Statistical shape representations for temporal registration of plant components in 3D, in: 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 9587–9593. doi:10.1109/ICRA48891.2023.10160709.
- Three-dimensional location methods for the vision system of strawberry-harvesting robots: development and comparison, Precision Agriculture 24 (2023) 764––782. doi:10.1007/s11119-022-09974-4.
- Mobile robotics platform for strawberry temporal–spatial yield monitoring within precision indoor farming systems, Frontiers in Plant Science 14 (2023). URL: https://www.frontiersin.org/journals/plant-science/articles/10.3389/fpls.2023.1162435. doi:10.3389/fpls.2023.1162435.
- Functional–structural plant models mission in advancing crop science: Opportunities and prospects, Frontiers in Plant Science 12 (2021). URL: https://www.frontiersin.org/journals/plant-science/articles/10.3389/fpls.2021.747142. doi:10.3389/fpls.2021.747142.
- SAM3D: Segment anything in 3D scenes, arXiv preprint arXiv:2306.03908 (2023).