Investigating the Segment Anything Foundation Model for Mapping Smallholder Agriculture Field Boundaries Without Training Labels (2407.01846v1)
Abstract: Accurate mapping of agricultural field boundaries is crucial for enhancing outcomes like precision agriculture, crop monitoring, and yield estimation. However, extracting these boundaries from satellite images is challenging, especially for smallholder farms and data-scarce environments. This study explores the Segment Anything Model (SAM) to delineate agricultural field boundaries in Bihar, India, using 2-meter resolution SkySat imagery without additional training. We evaluate SAM's performance across three model checkpoints, various input sizes, multi-date satellite images, and edge-enhanced imagery. Our results show that SAM correctly identifies about 58% of field boundaries, comparable to other approaches requiring extensive training data. Using different input image sizes improves accuracy, with the most significant improvement observed when using multi-date satellite images. This work establishes proof of concept for using SAM and maximizing its potential in agricultural field boundary mapping. Our work highlights SAM's potential in delineating agriculture field boundary in training-data scarce settings to enable a wide range of agriculture related analysis.
- James B. Campbell. Introduction to remote sensing. Guilford Press, New York, fifth edition edition, 2011. ISBN 978-1-4625-0675-0. OCLC: 778454548.
- A generalized computer vision approach to mapping crop fields in heterogeneous agricultural landscapes. Remote Sensing of Environment, 179:210–221, 2016. ISSN 0034-4257. doi: https://doi.org/10.1016/j.rse.2016.03.010. URL https://www.sciencedirect.com/science/article/pii/S0034425716301031.
- High resolution, annual maps of field boundaries for smallholder-dominated croplands at national scales. Frontiers in Artificial Intelligence, 4, 2022. ISSN 2624-8212. doi: 10.3389/frai.2021.744863. URL https://www.frontiersin.org/articles/10.3389/frai.2021.744863.
- Core building blocks: Next gen geo spatial GPT application, 2023. URL http://arxiv.org/abs/2310.11029.
- Artur Gafurov. Automated Mapping of Cropland Boundaries Using Deep Neural Networks. AgriEngineering, 5(3):1568–1580, September 2023. ISSN 2624-7402. doi: 10.3390/agriengineering5030097. URL https://www.mdpi.com/2624-7402/5/3/97.
- Food demand and the food security challenge with rapid economic growth in the emerging economies of India and China. Food Research International, 63:108–124, September 2014. ISSN 0963-9969. doi: 10.1016/j.foodres.2014.03.015. URL https://www.sciencedirect.com/science/article/pii/S0963996914001732.
- The Outlining of Agricultural Plots Based on Spatiotemporal Consensus Segmentation. Remote Sensing, 10(12):1991, December 2018. ISSN 2072-4292. doi: 10.3390/rs10121991. URL http://www.mdpi.com/2072-4292/10/12/1991.
- Foundation models for generalist geospatial artificial intelligence, 2023. URL http://arxiv.org/abs/2310.18660.
- Segment anything, 2023.
- Autonomous gis: the next-generation ai-powered gis. International Journal of Digital Earth, 16(2):4668–4686, 2023. doi: 10.1080/17538947.2023.2278895. URL https://doi.org/10.1080/17538947.2023.2278895.
- Using deep learning and very-high-resolution imagery to map smallholder field boundaries. Remote Sensing, 14(13), 2022. ISSN 2072-4292. doi: 10.3390/rs14133046.
- Boundary delineation of agricultural fields in multitemporal satellite imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(1):237–251, 2018.
- Devis Peressutti. Automatic field delineation: New release. Sentinel Hub Blog: EO research, 2023. URL https://medium.com/sentinel-hub/automatic-field-delineation-new-release-1c2938399f0.
- Chapter 9 - deep learning approach for monitoring urban land cover changes. In Amit Kumar, Prashant K. Srivastava, Purabi Saikia, and Rajesh Kumar Mall, editors, Earth Observation in Urban Monitoring, Earth Observation, pages 171–196. Elsevier, 2024. ISBN 978-0-323-99164-3. doi: https://doi.org/10.1016/B978-0-323-99164-3.00003-3. URL https://www.sciencedirect.com/science/article/pii/B9780323991643000033.
- Planet Labs Inc. Planet skysat public ortho imagery, rgb. Google Earth Engine Data Catalog, 2023. URL https://developers.google.com/earth-engine/datasets/catalog/SKYSAT_GEN-A_PUBLIC_ORTHO_RGB.
- Image enhancement via adaptive unsharp masking. IEEE transactions on image processing, 9(3):505–510, 2000. doi: 10.1109/83.826787.
- QGIS Development Team. QGIS Geographic Information System. Open Source Geospatial Foundation, 2022. URL http://qgis.osgeo.org.
- A generalizable and accessible approach to machine learning with global satellite imagery. Nature Communications, 12(1):4392, 2021. ISSN 2041-1723. doi: 10.1038/s41467-021-24638-z. URL https://www.nature.com/articles/s41467-021-24638-z. Publisher: Nature Publishing Group.
- Smallholder farmers in india: Food security and agricultural policy. Smallholder farmers in India: Food security and agricultural policy, 2002.
- Advanced Fully Convolutional Networks for Agricultural Field Boundary Detection. Remote Sensing, 13(4):722, January 2021. ISSN 2072-4292. doi: 10.3390/rs13040722. URL https://www.mdpi.com/2072-4292/13/4/722. Number: 4 Publisher: Multidisciplinary Digital Publishing Institute.
- Extracting Agricultural Fields from Remote Sensing Imagery Using Graph-Based Growing Contours. Remote Sensing, 12(7):1205, April 2020. ISSN 2072-4292. doi: 10.3390/rs12071205. URL https://www.mdpi.com/2072-4292/12/7/1205.
- Deep learning on edge: Extracting field boundaries from satellite images with a convolutional neural network. Remote Sensing of Environment, 245:111741, August 2020. ISSN 0034-4257. doi: 10.1016/j.rse.2020.111741. URL https://www.sciencedirect.com/science/article/pii/S0034425720301115.
- Agricultural Field Boundary Delineation with Satellite Image Segmentation for High-Resolution Crop Mapping: A Case Study of Rice Paddy. Agronomy, 12(10):2342, September 2022a. ISSN 2073-4395. doi: 10.3390/agronomy12102342. URL https://www.mdpi.com/2073-4395/12/10/2342.
- Unlocking large-scale crop field delineation in smallholder farming systems with transfer learning and weak supervision. Remote Sensing, 14(22), 2022b. ISSN 2072-4292. doi: 10.3390/rs14225738.
- Gpt, large language models (llms) and generative artificial intelligence (gai) models in geospatial science: a systematic review. International Journal of Digital Earth, 17(1):2353122, 2024. URL https://doi.org/10.1080/17538947.2024.2353122.
- Remote sensing for agricultural applications: A meta-review. Remote Sensing of Environment, 236:111402, 2020. ISSN 0034-4257. doi: https://doi.org/10.1016/j.rse.2019.111402. URL https://www.sciencedirect.com/science/article/pii/S0034425719304213.
- samgeo: A python package for segmenting geospatial data with the segment anything model (sam). Journal of Open Source Software, 8(89):5663, 2023. doi: 10.21105/joss.05663. URL https://doi.org/10.21105/joss.05663.
- Detecting functional field units from satellite images in smallholder farming systems using a deep learning based computer vision approach: A case study from bangladesh. Remote Sensing Applications: Society and Environment, 20:100413, 2020. ISSN 2352-9385. doi: https://doi.org/10.1016/j.rsase.2020.100413. URL https://www.sciencedirect.com/science/article/pii/S2352938519301831.
- Parcel-level mapping of crops in a smallholder agricultural area: A case of central china using single-temporal vhsr imagery. Computers and Electronics in Agriculture, 175:105581, 2020.
- GeoGPT: Understanding and processing geospatial tasks through an autonomous GPT, 2023. URL http://arxiv.org/abs/2307.07930.