Satellite Imagery and AI: A New Era in Ocean Conservation, from Research to Deployment and Impact (2312.03207v1)
Abstract: Illegal, unreported, and unregulated (IUU) fishing poses a global threat to ocean habitats. Publicly available satellite data offered by NASA and the European Space Agency (ESA) provide an opportunity to actively monitor this activity. Effectively leveraging satellite data for maritime conservation requires highly reliable machine learning models operating globally with minimal latency. This paper introduces three specialized computer vision models designed for synthetic aperture radar (Sentinel-1), optical imagery (Sentinel-2), and nighttime lights (Suomi-NPP/NOAA-20). It also presents best practices for developing and delivering real-time computer vision services for conservation. These models have been deployed in Skylight, a real time maritime monitoring platform, which is provided at no cost to users worldwide.
- Alaska Department of Fish and Game. 2022/23 bering sea snow crab season closed, 2022. URL https://www.adfg.alaska.gov/static/applications/dcfnewsrelease/1441272349.pdf. Accessed on December 4, 2023.
- FAO. The State of World Fisheries and Aquaculture 2020: Sustainability in Action. Rome, 2020.
- Skylight, 2023. URL https://www.skylight.global/. Accessed on: September 1 2023.
- Lutz Roeder. Netron - visualizer for neural network models, 2023. URL https://github.com/lutzroeder/netron.
- Allen Institute for AI. Vessel detection with viirs. https://github.com/allenai/vessel-detection-viirs, 2023. Accessed on: September 1 2023.
- Allen Institute for AI. Vessel detection with sentinels. https://github.com/allenai/vessel-detection-sentinels, Year of access. Accessed on: Current date.
- Viirs night-time lights. International Journal of Remote Sensing, 38:5860 – 5879, 2017. URL https://api.semanticscholar.org/CorpusID:134847136.
- Recurrent ancient geomagnetic field anomalies shed light on future evolution of the south atlantic anomaly. Proceedings of the National Academy of Sciences of the United States of America, 119, 2022. URL https://api.semanticscholar.org/CorpusID:249434557.
- Automatic boat identification system for viirs low light imaging data. Remote. Sens., 7:3020–3036, 2015. URL https://api.semanticscholar.org/CorpusID:10198494.
- Development of an operational land water mask for modis collection 6, and influence on downstream data products. International Journal of Digital Earth, 10(2):207–218, 2017. doi: 10.1080/17538947.2016.1232756. URL https://doi.org/10.1080/17538947.2016.1232756.
- S. Ackerman et al. Viirs atmosphere l2 cloud mask product. NASA MODIS Adaptive Processing System, Goddard Space Flight Center, USA, 2017a.
- S. Ackerman et al. Viirs atmosphere l2 cloud mask product. NASA MODIS Adaptive Processing System, Goddard Space Flight Center, USA, 2017b.
- Gmes sentinel-1 mission. Remote sensing of environment, 120:9–24, 2012.
- Karen Fletcher. SENTINEL 1: ESA’s Radar Observatory Mission for GMES Operational Services. European Space Agency, 2012.
- Faster R-CNN: Towards Real-time Object Detection with Region Proposal Networks. Advances in Neural Information Processing Systems, 28, 2015.
- Feature Pyramid Networks for Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2117–2125, 2017.
- xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagery. Advances in Neural Information Processing Systems, 35:37604–37616, 2022.
- European Space Agency. Sentinel-2: Esa’s optical high-resolution mission for gmes operational services. ESA Publications, 2012. URL https://www.esa.int/About_Us/ESA_Publications/ESA_SP-1322_2_Sentinel_2. ESA SP-1322/2.
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10012–10022, 2021.
- SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understanding. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023.
- Allen Institute for AI. Geospatial data products. https://github.com/allenai/satlas/blob/main/GeospatialDataProducts.md, 2023. Accessed: [insert access date here].
- A shortest augmenting path algorithm for dense and sparse linear assignment problems. Computing, 38:325–340, 1987. URL https://api.semanticscholar.org/CorpusID:7806079.
- Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825–2830, 2011.
- Seasonal variation in morphotype composition of pelagic sargassum influx events is linked to oceanic origin. Scientific Reports, 13, 2023. URL https://api.semanticscholar.org/CorpusID:257367760.
- Sentinel Hub. sentinel2-cloud-detector. https://github.com/sentinel-hub/sentinel2-cloud-detector, 2023. Accessed: 2023-11-18.
- Cloud mask intercomparison exercise (cmix): An evaluation of cloud masking algorithms for landsat 8 and sentinel-2. Remote Sensing of Environment, 274:112990, 2022. ISSN 0034-4257. doi: https://doi.org/10.1016/j.rse.2022.112990. URL https://www.sciencedirect.com/science/article/pii/S0034425722001043.