Accurate and Efficient Urban Street Tree Inventory with Deep Learning on Mobile Phone Imagery (2401.01180v1)
Abstract: Deforestation, a major contributor to climate change, poses detrimental consequences such as agricultural sector disruption, global warming, flash floods, and landslides. Conventional approaches to urban street tree inventory suffer from inaccuracies and necessitate specialised equipment. To overcome these challenges, this paper proposes an innovative method that leverages deep learning techniques and mobile phone imaging for urban street tree inventory. Our approach utilises a pair of images captured by smartphone cameras to accurately segment tree trunks and compute the diameter at breast height (DBH). Compared to traditional methods, our approach exhibits several advantages, including superior accuracy, reduced dependency on specialised equipment, and applicability in hard-to-reach areas. We evaluated our method on a comprehensive dataset of 400 trees and achieved a DBH estimation accuracy with an error rate of less than 2.5%. Our method holds significant potential for substantially improving forest management practices. By enhancing the accuracy and efficiency of tree inventory, our model empowers urban management to mitigate the adverse effects of deforestation and climate change.
- M. Mokroš, X. Liang, P. Surovỳ, P. Valent, J. Čerňava, F. Chudỳ, D. Tunák, Š. Saloň, and J. Merganič, “Evaluation of close-range photogrammetry image collection methods for estimating tree diameters,” ISPRS International Journal of Geo-Information, vol. 7, no. 3, p. 93, 2018.
- Z. Yang, Q. Liu, P. Luo, Q. Ye, G. Duan, R. P. Sharma, H. Zhang, G. Wang, and L. Fu, “Prediction of individual tree diameter and height to crown base using nonlinear simultaneous regression and airborne lidar data,” Remote Sensing, vol. 12, no. 14, 2020.
- S. Li, L. Fang, Y. Sun, L. Xia, and X. Lou, “Development of measuring device for diameter at breast height of trees,” Forests, vol. 14, no. 2, p. 192, 2023.
- R. Zhou, D. Wu, R. Zhou, L. Fang, X. Zheng, and X. Lou, “Estimation of dbh at forest stand level based on multi-parameters and generalized regression neural network,” Forests, vol. 10, no. 9, p. 778, 2019.
- R. Zhou, D. Wu, R. Zhou, L. Fang, X. Zheng, and X. Lou, “Estimation of dbh at forest stand level based on multi-parameters and generalized regression neural network,” Forests, vol. 10, no. 9, 2019.
- M. J. Diamantopoulou, “Artificial neural networks as an alternative tool in pine bark volume estimation,” Computers and electronics in agriculture, vol. 48, no. 3, pp. 235–244, 2005.
- R. Özçelik, M. J. Diamantopoulou, J. R. Brooks, and H. V. Wiant Jr, “Estimating tree bole volume using artificial neural network models for four species in turkey,” Journal of environmental management, vol. 91, no. 3, pp. 742–753, 2010.
- H. G. Leite, M. L. M. da Silva, D. H. B. Binoti, L. Fardin, and F. H. Takizawa, “Estimation of inside-bark diameter and heartwood diameter for tectona grandis linn. trees using artificial neural networks,” European Journal of Forest Research, vol. 130, pp. 263–269, 2011.
- H. Hamraz, N. B. Jacobs, M. A. Contreras, and C. H. Clark, “Deep learning for conifer/deciduous classification of airborne lidar 3d point clouds representing individual trees,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 158, pp. 219–230, 2019.
- L. Piermattei, W. Karel, D. Wang, M. Wieser, M. Mokroš, P. Surovỳ, M. Koreň, J. Tomaštík, N. Pfeifer, and M. Hollaus, “Terrestrial structure from motion photogrammetry for deriving forest inventory data,” Remote Sensing, vol. 11, no. 8, p. 950, 2019.
- X. Liang, A. Jaakkola, Y. Wang, J. Hyyppä, E. Honkavaara, J. Liu, and H. Kaartinen, “The use of a hand-held camera for individual tree 3d mapping in forest sample plots,” Remote Sensing, vol. 6, no. 7, pp. 6587–6603, 2014.
- S. Ahn, J. Choi, N. L. Doh, and W. K. Chung, “A practical approach for ekf-slam in an indoor environment: fusing ultrasonic sensors and stereo camera,” Autonomous robots, vol. 24, pp. 315–335, 2008.
- S. Kumar and H. Furuhashi, “Long-range measurement system using ultrasonic range sensor with high-power transmitter array in air,” Ultrasonics, vol. 74, pp. 186–195, 2017.
- J. Sun, G. Sun, P. Ma, T. Dong, and Y. Yang, “Laser target localization based on symmetric wavelet denoising and asymmetric gauss fitting,” Chinese Journal of Lasers, vol. 44, no. 6, p. 0604001, 2017.
- L. Cheng and G. Wu, “Obstacles detection and depth estimation from monocular vision for inspection robot of high voltage transmission line,” Cluster Computing, vol. 22, p. 2611–2627, mar 2019.
- C. S. Royden, D. Parsons, and J. Travatello, “The effect of monocular depth cues on the detection of moving objects by moving observers,” Vision Research, vol. 124, pp. 7–14, 2016.
- M. Mansour, P. Davidson, O. Stepanov, and R. Piché, “Relative importance of binocular disparity and motion parallax for depth estimation: A computer vision approach,” Remote Sensing, vol. 11, no. 17, 2019.
- H. Li and B. Zhang, “Application of integrated binocular stereo vision measurement and wireless sensor system in athlete displacement test,” Alexandria Engineering Journal, vol. 60, no. 5, pp. 4325–4335, 2021.
- R. Zhang, L. Xu, Z. Yu, Y. Shi, C. Mu, and M. Xu, “Deep-irtarget: An automatic target detector in infrared imagery using dual-domain feature extraction and allocation,” IEEE Transactions on Multimedia, vol. 24, pp. 1735–1749, 2022.
- R. Zhang, L. Wu, Y. Yang, W. Wu, Y. Chen, and M. Xu, “Multi-camera multi-player tracking with deep player identification in sports video,” Pattern Recognition, vol. 102, p. 107260, 2020.
- Y. Yang, X. Meng, and M. Gao, “Vision system of mobile robot combining binocular and depth cameras,” J. Sensors, vol. 2017, pp. 4562934:1–4562934:11, 2017.
- E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “Segformer: Simple and efficient design for semantic segmentation with transformers,” in Advances in Neural Information Processing Systems (M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, eds.), vol. 34, pp. 12077–12090, Curran Associates, Inc., 2021.
- S. Sayeed, “Distance to objects using single vision camera.” https://www.youtube.com/watch?v=Qm7vunJAtKY&t=4s, 2014. [Online; accessed 27-June-2021].
- B. Dwyer, J. Nelson, and J. Solawetz, “Roboflow annotate.” https://roboflow.com/annotate, 2022. (Accessed on 07/15/2023).
- T. Shao, Y. Qu, and J. Du, “A low-cost integrated sensor for measuring tree diameter at breast height (dbh),” Computers and Electronics in Agriculture, vol. 199, p. 107140, 2022.
- A. Holcomb, L. Tong, and S. Keshav, “Robust single-image tree diameter estimation with mobile phones,” Remote Sensing, vol. 15, no. 3, 2023.
- S. Tatsumi, K. Yamaguchi, and N. Furuya, “Forestscanner: A mobile application for measuring and mapping trees with lidar-equipped iphone and ipad,” Methods in Ecology and Evolution, vol. 14, no. 7, pp. 1603–1609, 2023.
- S. Gülci, H. Yurtseven, A. O. Akay, and M. Akgul, “Measuring tree diameter using a lidar-equipped smartphone: a comparison of smartphone-and caliper-based dbh,” Environmental Monitoring and Assessment, vol. 195, no. 6, p. 678, 2023.