Early Detection of Bark Beetle Attack Using Remote Sensing and Machine Learning: A Review (2210.03829v3)
Abstract: This paper provides a comprehensive review of past and current advances in the early detection of bark beetle-induced tree mortality from three primary perspectives: bark beetle & host interactions, RS, and ML/DL. In contrast to prior efforts, this review encompasses all RS systems and emphasizes ML/DL methods to investigate their strengths and weaknesses. We parse existing literature based on multi- or hyper-spectral analyses and distill their knowledge based on: bark beetle species & attack phases with a primary emphasis on early stages of attacks, host trees, study regions, RS platforms & sensors, spectral/spatial/temporal resolutions, spectral signatures, spectral vegetation indices (SVIs), ML approaches, learning schemes, task categories, models, algorithms, classes/clusters, features, and DL networks & architectures. Although DL-based methods and the random forest (RF) algorithm showed promising results, highlighting their potential to detect subtle changes across visible, thermal, and short-wave infrared (SWIR) spectral regions, they still have limited effectiveness and high uncertainties. To inspire novel solutions to these shortcomings, we delve into the principal challenges & opportunities from different perspectives, enabling a deeper understanding of the current state of research and guiding future research directions.
- Tree species classification and health status assessment for a mixed broadleaf-conifer forest with uas multispectral imaging. Remote Sensing, 12(22), 2020.
- Sensitivity of Landsat-8 OLI and TIRS data to foliar properties of early stage bark beetle (Ips typographus, L.) infestation. Remote Sensing, 11(4), 2019a.
- Sentinel-2 accurately maps green-attack stage of European spruce bark beetle (Ips typographus, L.) compared with Landsat-8. Remote Sensing in Ecology and Conservation, 5(1):87–106, 2019b.
- UAV & satellite synergies for optical remote sensing applications: A literature review. Science of Remote Sensing, 3:100019, 2021.
- Predicting live and dead tree basal area of bark beetle affected forests from discrete-return LiDAR. Canadian Journal of Remote Sensing, 39(sup1):S99–S111, 2013.
- Early detection of bark beetle infestation in Norway spruce forests of Central Europe using Sentinel-2. International Journal of Applied Earth Observation and Geoinformation, 100:102335, 2021.
- Comparison of field survey and remote sensing techniques for detection of bark beetle-infested trees. Forest Ecology and Management, 506:119984, 2022.
- Mapping boreal forest spruce beetle health status at the individual crown scale using fused spectral and structural data. Forests, 12(9), 2021.
- Deep learning-based automated forest health diagnosis from aerial images. IEEE Access, 8:144064–144076, 2020.
- Integrating remotely sensed and ancillary data sources to characterize a mountain pine beetle infestation. Remote Sensing of Environment, 105(2):83–97, 2006.
- ImageNet: A large-scale hierarchical image database. In Proc. CVPR, pages 248–255, 2009.
- Assessing canopy mortality during a mountain pine beetle outbreak using GeoEye-1 high spatial resolution satellite data. Remote Sensing of Environment, 114(11):2431–2435, 2010.
- Towards UAV-based forest monitoring. In Proc. Workshop on UAV-basaed Remote Sensing Methods for Monitoring Vegetation, pages 21–32, 2014.
- Recent advances in forest insect pests and diseases monitoring using UAV-based data: A systematic review. Forests, 13(6), 2022.
- A bark beetle infestation predictive model based on satellite data in the frame of decision support system TANABBO. iForest - Biogeosciences and Forestry, 13(3):215–223, 2020.
- UAV-based forest health monitoring: A systematic review. Remote Sensing, 14(13), 2022.
- Cascading impacts of bark beetle-caused tree mortality on coupled biogeophysical and biogeochemical processes. Frontiers in Ecology and the Environment, 10(8):416–424, 2012.
- Early detection of spruce vitality loss with hyperspectral data: Results of an experimental study in Bavaria, Germany. Remote Sensing of Environment, 266:112676, 2021.
- Combined drought and bark beetle attacks deplete non-structural carbohydrates and promote death of mature pine trees. Plant, Cell & Environment, 44(12):3866–3881, 2021.
- An angular vegetation index for imaging spectroscopy data—Preliminary results on forest damage detection in the Bavarian National Park, Germany. International Journal of Applied Earth Observation and Geoinformation, 19:308–321, 2012.
- Assessing the potential of hyperspectral imagery to map bark beetle-induced tree mortality. Remote Sensing of Environment, 140:533–548, 2014.
- Monitoring bark beetle forest damage in Central Europe. A remote sensing approach validated with field data. Remote Sensing, 12(21), 2020.
- The effectiveness of vegetation management practices for prevention and control of bark beetle infestations in coniferous forests of the western and southern United States. Forest Ecology and Management, 238(1):24–53, 2007.
- Spectral evidence of early-stage spruce beetle infestation in Engelmann spruce. Forest Ecology and Management, 384:347–357, 2017.
- Mountain pine beetle red-attack forest damage classification using stratified Landsat TM data in British Columbia, Canada. Photogrammetric Engineering and Remote Sensing, 69(3):283–288, 2003.
- Kamal J.K. Gandhi and Richard W. Hofstetter, editors. Bark Beetle Management, Ecology, and Climate Change. Elsevier, 2021. doi: 10.1016/C2019-0-04282-3.
- Quantifying tree mortality in a mixed species woodland using multitemporal high spatial resolution satellite imagery. Remote Sensing of Environment, 129:54–65, 2013.
- Detection of mountain pine beetle-killed ponderosa pine in a heterogeneous landscape using high-resolution aerial imagery. International Journal of Remote Sensing, 36(21):5353–5372, 2015.
- A correction for serial nonindependence in mountain pine beetle aerial survey data to reduce overestimation of cumulative damage. Canadian Journal of Forest Research, 2022.
- Alberta Government. Alberta Forest health aerial survey manual, 2014.
- LIU JIAN GUO. Balance contrast enhancement technique and its application in image colour composition. International Journal of Remote Sensing, 12(10):2133–2151, 1991.
- Remote sensing of forest pest damage: A review and lessons learned from a canadian perspective. The Canadian Entomologist, 148(S1):296–356, 2016.
- Detection of spruce beetle-induced tree mortality using high- and medium-resolution remotely sensed imagery. Remote Sensing of Environment, 168:134–145, 2015.
- Deep residual learning for image recognition. In Proc. IEEE CVPR, pages 770–778, 2016.
- Mapping european spruce bark beetle infestation at its early phase using gyrocopter-mounted hyperspectral data and field measurements. Remote Sensing, 13(22), 2021.
- Mapping whitebark pine mortality caused by a mountain pine beetle outbreak with high spatial resolution satellite imagery. International Journal of Remote Sensing, 30(17):4427–4441, 2009.
- Bark beetle outbreaks in Europe: State of knowledge and ways forward for management. Current Forestry Reports, 7(3):138–165, 2021.
- Using multitemporal hyper- and multispectral UAV imaging for detecting bark beetle infestation on norway spruce. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLIII-B3-2020:429–434, 2020.
- Effect of spatial resolution on classification errors of pure and mixed pixels in remote sensing. IEEE Trans. Geoscience and Remote Sensing, 39(12):2657–2663, 2001.
- Densely connected convolutional networks. In Proc. IEEE CVPR, pages 2261–2269, 2017.
- Early detection of forest stress from european spruce bark beetle attack, and a new vegetation index: Normalized distance red & SWIR (NDRS). Remote Sensing of Environment, 255:112240, 2021.
- Early detection of bark beetle infestation in norway spruce (Picea abies, L.) using WorldView-2 data. Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 5:351–367, 2014.
- Dead wood detection based on semantic segmentation of VHR aerial CIR imagery using optimized FCN-Densenet. In Proc. Joint ISPRS Conference on Photogrammetric Image Analysis and Munich Remote Sensing Symposium, pages 127–133, 2019.
- Multispectral imagery provides benefits for mapping spruce tree decline due to bark beetle infestation when acquired late in the season. Remote Sensing, 14(4), 2022.
- Habitat and stand factors related to spatial dynamics of Norway spruce dieback driven by Ips typographus (L.) in the Białowieża forest district. Forest Ecology and Management, 476:118432, 2020.
- Classification of bark beetle-induced forest tree mortality using deep learning. In Proc. ICPR Workshop, 2022.
- Extending deep learning approaches for forest disturbance segmentation on very high-resolution satellite images. Remote Sensing in Ecology and Conservation, 7(3):355–368, 2021.
- The use of UAV mounted sensors for precise detection of bark beetle infestation. Remote Sensing, 11(13), 2019.
- Cross-scale interaction of host tree size and climatic water deficit governs bark beetle-induced tree mortality. Nat Commun, 12(129), 2021.
- Assessment of machine learning algorithms for modeling the spatial distribution of bark beetle infestation. Forests, 12(4), 2021.
- Mountain pine beetle and forest carbon feedback to climate change. Nature, 452(7190):987–990, 2008.
- Object-based extraction of bark beetle (Ips typographus L.) infestations using multi-date LANDSAT and SPOT satellite imagery. Progress in Physical Geography: Earth and Environment, 38(6):755–785, 2014a.
- Spatial characterization of bark beetle infestations by a multidate synergy of SPOT and Landsat imagery. Environmental Monitoring and Assessment, 186:441–456, 2014b.
- Synthetic RapidEye data used for the detection of area-based spruce tree mortality induced by bark beetles. GIScience & Remote Sensing, 55(6):839–859, 2018.
- Forecasting potential bark beetle outbreaks based on spruce forest vitality using hyperspectral remote-sensing techniques at different scales. Forest Ecology and Management, 308:76–89, 2013.
- Applications in remote sensing to forest ecology and management. One Earth, 2(5):405–412, 2020.
- Random frog: An efficient reversible jump Markov Chain Monte Carlo-like approach for variable selection with applications to gene selection and disease classification. Analytica Chimica Acta, 740:20–26, 2012.
- Mapping mountain pine beetle mortality through growth trend analysis of time-series landsat data. Remote Sensing, 6(6):5696–5716, 2014.
- Stimulation of tree defenses by Ophiostomatoid fungi can explain attack success of bark beetles on conifers. Annals of Forest Science, 66(8), 2009.
- Detection of pine shoot beetle (PSB) stress on pine forests at individual tree level using UAV-based hyperspectral imagery and LiDAR. Remote Sensing, 11(21), 2019.
- Mapping standing dead trees in temperate montane forests using a pixel- and object-based image fusion method and stereo WorldView-3 imagery. Ecological Indicators, 133:108438, 2021.
- Mapping percent tree mortality due to mountain pine beetle damage. Forest Science, 62(4):392–402, 04 2016.
- How canopy shadow affects invasive plant species classification in high spatial resolution remote sensing. Remote Sensing in Ecology and Conservation, 5(4):302–317, 2019.
- Deep learning for visual tracking: A comprehensive survey. IEEE Trans. Intelligent Transportation Systems, 23(5):3943–3968, 2022.
- Evaluating the potential of multispectral imagery to map multiple stages of tree mortality. Remote Sensing of Environment, 115(7):1632–1642, 2011.
- Evaluating methods to detect bark beetle-caused tree mortality using single-date and multi-date Landsat imagery. Remote Sensing of Environment, 132:49–58, 2013.
- Landsat-based monitoring of southern pine beetle infestation severity and severity change in a temperate mixed forest. Remote Sensing of Environment, 269:112847, 2022.
- Automatic tree crown extraction from uas multispectral imagery for the detection of bark beetle disturbance in mixed forests. Remote Sensing, 12(24), 2020.
- Detection of bark beetle disturbance at tree level using UAS multispectral imagery and deep learning. Remote Sensing, 13(23), 2021.
- The mountain pine beetle epidemic in the Black Hills, South Dakota: The consequences of long term fire policy, climate change and the use of remote sensing to enhance mitigation. Journal of Geography and Geology, 10(1):69–82, 2018.
- Individual sick fir tree (abies mariesii) identification in insect infested forests by means of uav images and deep learning. Remote Sensing, 13(2), 2021.
- Hyperspectral remote sensing of mountain pine beetle with an emphasis on previsual assessment. Canadian Journal of Remote Sensing, 41(3):191–202, 2015.
- Using UAV-based photogrammetry and hyperspectral imaging for mapping bark beetle damage at tree-level. Remote Sensing, 7(11):15467–15493, 2015.
- Remote sensing of bark beetle damage in urban forests at individual tree level using a novel hyperspectral camera from UAV and aircraft. Urban Forestry & Urban Greening, 30:72–83, 2018.
- Government of Alberta. Mountain Pine Beetle Detection and Management in Alberta. 2016. [Online; accessed 10-Feb-2022].
- Early detection of bark beetle green attack using TerraSAR-X and RapidEye data. Remote Sensing, 5(4):1912–1931, 2013.
- Remote sensing for early, detailed, and accurate detection of forest disturbance and decline for protection of biodiversity, pages 121–154. Springer International Publishing, 2020.
- YOLO9000: Better, faster, stronger. In Proc. CVPR, July 2017.
- YOLOv3: An incremental improvement. CoRR, abs/1804.02767, 2018.
- Detection of fir trees (Abies sibirica) damaged by the bark beetle in unmanned aerial vehicle images with deep learning. Remote Sensing, 11(6), 2019.
- Detection of norway spruce trees (Picea Abies) infested by bark beetle in UAV images using YOLOs architectures. IEEE Access, 10:10384–10392, 2022.
- Detection of bark beetle infestation in drone imagery via thresholding cellular automata. Journal of Applied Remote Sensing, 15(1):1 – 20, 2021.
- Characterizing spectral–temporal patterns of defoliator and bark beetle disturbances using Landsat time series. Remote Sensing of Environment, 170:166–177, 2015.
- Remote sensing of forest insect disturbances: Current state and future directions. International Journal of Applied Earth Observation and Geoinformation, 60:49–60, 2017.
- A comparison of WorldView-2 and Landsat-8 images for the classification of forests affected by bark beetle outbreaks using a support vector machine and a neural network: A case study in the Sumava mountains. Geosciences, 9(9), 2019.
- A framework for detecting conifer mortality across an ecoregion using high spatial resolution spaceborne imaging spectroscopy. Remote Sensing of Environment, 209:195–210, 2018.
- Remote sensing platforms and sensors: A survey. ISPRS Journal of Photogrammetry and Remote Sensing, 115:22–36, 2016.
- Northernmost european spruce bark beetle Ips typographus outbreak: Modelling tree mortality using remote sensing and climate data. Forest Ecology and Management, 505:119829, 2022.
- Current and near-term advances in Earth observation for ecological applications. Ecological Processes, 10(1), 2021.
- Bark beetles: Biology and ecology of native and invasive species. Academic Press, 2014.
- Dogs trained to recognise a bark beetle pheromone locate recently attacked spruces better than human experts. Forest Ecology and Management, 528:120626, 2023.
- Forest health arial overview survey standards for British Columbia, 2019.
- Detection of red attack stage mountain pine beetle infestation with high spatial resolution satellite imagery. Remote Sensing of Environment, 96(3):340–351, 2005.
- Conservation drones: Mapping and monitoring biodiversity. Oxford University Press, 2018.
- Estimating the probability of mountain pine beetle red-attack damage. Remote Sensing of Environment, 101(2):150–166, 2006a.
- Surveying mountain pine beetle damage of forests: A review of remote sensing opportunities. Forest Ecology and Management, 221(1):27–41, 2006b.
- Challenges for the operational detection of mountain pine beetle green attack with remote sensing. The Forestry Chronicle, 85(1):32–38, 2009.
- Remote sensing imagery in vegetation mapping: a review. Journal of Plant Ecology, 1(1):9–23, 2008.
- Detecting subtle change from dense landsat time series: Case studies of mountain pine beetle and spruce beetle disturbance. Remote Sensing of Environment, 263:112560, 2021.
- A review of major factors influencing the accuracy of mapping green-attack stage of bark beetle infestations using satellite imagery: Prospects to avoid data redundancy. Remote Sensing Applications: Society and Environment, 24:100638, 2021.
- Combining GF-2 and Sentinel-2 images to detect tree mortality caused by red turpentine beetle during the early outbreak stage in north China. Forests, 11(2), 2020.
- Object detection with deep learning: A review. IEEE Trans. Neural Networks and Learning Systems, 30(11):3212–3232, 2019.