Energy-Efficient Uncertainty-Aware Biomass Composition Prediction at the Edge (2404.11230v1)
Abstract: Clover fixates nitrogen from the atmosphere to the ground, making grass-clover mixtures highly desirable to reduce external nitrogen fertilization. Herbage containing clover additionally promotes higher food intake, resulting in higher milk production. Herbage probing however remains largely unused as it requires a time-intensive manual laboratory analysis. Without this information, farmers are unable to perform localized clover sowing or take targeted fertilization decisions. Deep learning algorithms have been proposed with the goal to estimate the dry biomass composition from images of the grass directly in the fields. The energy-intensive nature of deep learning however limits deployment to practical edge devices such as smartphones. This paper proposes to fill this gap by applying filter pruning to reduce the energy requirement of existing deep learning solutions. We report that although pruned networks are accurate on controlled, high-quality images of the grass, they struggle to generalize to real-world smartphone images that are blurry or taken from challenging angles. We address this challenge by training filter-pruned models using a variance attenuation loss so they can predict the uncertainty of their predictions. When the uncertainty exceeds a threshold, we re-infer using a more accurate unpruned model. This hybrid approach allows us to reduce energy consumption while retaining a high accuracy. We evaluate our algorithm on two datasets: the GrassClover and the Irish clover using an NVIDIA Jetson Nano edge device. We find that we reduce energy reduction with respect to state-of-the-art solutions by 50% on average with only 4% accuracy loss.
- Semi-supervised dry herbage mass estimation using automatic data and synthetic images. In IEEE International Conference on Computer Vision (ICCV), 2021.
- Unsupervised domain adaptation and super resolution on drone images for autonomous dry herbage biomass estimation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2022a.
- Utilizing unsupervised learning to improve sward content prediction and herbage mass estimation. In European Grassland Federation Symposium, 2022b.
- Structured pruning of deep convolutional neural networks. ACM Journal on Emerging Technologies in Computing Systems (JETC), 13(3):1–18, 2017.
- A cloud-based environment for generating yield estimation maps from apple orchards using uav imagery and a deep learning technique. Frontiers in plant science, 11:1086, 2020.
- Mixmatch: A holistic approach to semi-supervised learning. Advances in Neural Information Processing Systems (NeurIPS), 2019.
- Optimized deep learning model as a basis for fast uav mapping of weed species in winter wheat crops. Remote Sensing, 13(9):1704, 2021.
- Real-time crop classification using edge computing and deep learning. In 2020 IEEE 17th Annual Consumer Communications & Networking Conference (CCNC), pages 1–4. IEEE, 2020.
- The lottery ticket hypothesis: Finding sparse, trainable neural networks. In International Conference on Learning Representations, 2018.
- Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149, 2015.
- Eie: Efficient inference engine on compressed deep neural network. ACM SIGARCH Computer Architecture News, 44(3):243–254, 2016.
- Using image analysis and machine learning to estimate sward clover content. Grassland Science in Europe, Vol. 26 – Sensing – New Insights into Grassland Science and Practice, pages 132–134, 2021.
- Deep Residual Learning for Image Recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
- Pruning filters for efficient convnets. In International Conference on Learning Representations, 2016.
- Non-structured dnn weight pruning—is it beneficial in any platform? IEEE transactions on neural networks and learning systems, 33(9):4930–4944, 2021.
- Studying the plasticity in deep convolutional neural networks using random pruning. Machine Vision and Applications, 30(2):203–216, 2019.
- Very deep convolutional networks for large-scale image recognition. In IEEE International Conference on Learning Representations (ICLR), 2014.
- Predicting dry matter composition of grass clover leys using data simulation and camera-based segmentation of field canopies into white clover, red clover, grass and weeds. In International Conference on Precision Agriculture, 2018.
- The GrassClover image dataset for semantic and hierarchical species understanding in agriculture. In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019.
- Robust species distribution mapping of crop mixtures using color images and convolutional neural networks. Sensors, 2021.
- A deeper look into aleatoric and epistemic uncertainty disentanglement. In IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2022.
- GLStyleNet: exquisite style transfer combining global and local pyramid features. IET Computer Vision, 2020.
- Complexity-driven model compression for resource-constrained deep learning on edge. IEEE Transactions on Artificial Intelligence, pages 1–15, 2024.