Tree Counting by Bridging 3D Point Clouds with Imagery (2403.01932v3)
Abstract: Accurate and consistent methods for counting trees based on remote sensing data are needed to support sustainable forest management, assess climate change mitigation strategies, and build trust in tree carbon credits. Two-dimensional remote sensing imagery primarily shows overstory canopy, and it does not facilitate easy differentiation of individual trees in areas with a dense canopy and does not allow for easy separation of trees when the canopy is dense. We leverage the fusion of three-dimensional LiDAR measurements and 2D imagery to facilitate the accurate counting of trees. We compare a deep learning approach to counting trees in forests using 3D airborne LiDAR data and 2D imagery. The approach is compared with state-of-the-art algorithms, like operating on 3D point cloud and 2D imagery. We empirically evaluate the different methods on the NeonTreeCount data set, which we use to define a tree-counting benchmark. The experiments show that FuseCountNet yields more accurate tree counts.
- An unexpectedly large count of trees in the west african sahara and sahel. Nature, 587(7832):78–82, 2020.
- Bigdetection: A large-scale benchmark for improved object detector pre-training. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4777–4787, 2022.
- Transformer for tree counting in aerial images. Remote Sensing, 14(3):476, 2022.
- Voxelnext: Fully sparse voxelnet for 3d object detection and tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21674–21683, 2023.
- 4d spatio-temporal convnets: Minkowski convolutional neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3075–3084, 2019.
- High aboveground carbon stock of african tropical montane forests. Nature, 596(7873):536–542, 2021.
- Learning independent instance maps for crowd localization. CoRR, abs/2012.04164, 2020.
- Benchmarking individual tree mapping with sub-meter imagery, 2023.
- Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7132–7141, 2018.
- Lei Li. Hierarchical edge aware learning for 3d point cloud. In Computer Graphics International Conference, pages 81–92. Springer, 2023.
- Lei Li. Segment any building. In Computer Graphics International Conference, pages 155–166. Springer, 2023.
- Lei Li. Cpseg: Finer-grained image semantic segmentation via chain-of-thought language prompting. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 513–522, 2024.
- Mask-fpan: Semi-supervised face parsing in the wild with de-occlusion and uv gan. Computers & Graphics, 116:185–193, 2023.
- Buildseg buildseg: A general framework for the segmentation of buildings. Nordic Machine Intelligence, 2(3), 2022.
- Deep learning enables image-based tree counting, crown segmentation, and height prediction at national scale. PNAS nexus, 2(4), 2023.
- Large-scale oil palm tree detection from high-resolution satellite images using two-stage convolutional neural networks. Remote Sensing, 11(1):11, 2018.
- An end-to-end transformer model for crowd localization. European Conference on Computer Vision, 2022.
- Reciprocal distance transform maps for crowd counting and people localization in dense crowd. CoRR, abs/2102.07925, 2021.
- Point in, box out: Beyond counting persons in crowds. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
- Lidar supported estimators of wood volume and aboveground biomass from the Danish national forest inventory (2012–2016). 211:146–153, 2018.
- Nation-wide mapping of tree-level aboveground carbon stocks in rwanda. Nature Climate Change, 13(1):91–97, 2023.
- Deep learning based 3d point cloud regression for estimating forest biomass. In Proceedings of the 30th International Conference on Advances in Geographic Information Systems, pages 1–4, 2022.
- Deep point cloud regression for above-ground forest biomass estimation from airborne lidar. Remote Sensing of Environment, 302:113968, 2024.
- Towards perspective-free object counting with deep learning. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII 14, pages 615–629. Springer, 2016.
- Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 652–660, 2017.
- Above-ground biomass prediction for croplands at a sub-meter resolution using uav–lidar and machine learning methods. Remote Sensing, 14(16):3912, 2022.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234–241. Springer, 2015.
- Individual tree detection in urban als point clouds with 3d convolutional networks. Remote Sensing, 14(6):1317, 2022.
- Rethinking counting and localization in crowds: A purely point-based framework. 2021.
- Kpconv: Flexible and deformable convolution for point clouds. In Proceedings of the IEEE/CVF international conference on computer vision, pages 6411–6420, 2019.
- A self-training approach for point-supervised object detection and counting in crowds. IEEE Transactions on Image Processing, 30:2876–2887, 2021.
- Individual tree-crown detection in rgb imagery using semi-supervised deep learning neural networks. Remote Sensing, 11(11):1309, 2019.
- Autoscale: Learning to scale for crowd counting. International Journal of Computer Vision, 130:1–30, 02 2022.