A citizen science toolkit to collect human perceptions of urban environments using open street view images (2403.00174v4)
Abstract: Street View Imagery (SVI) is a valuable data source for studies (e.g., environmental assessments, green space identification or land cover classification). While commercial SVI is available, such providers commonly restrict copying or reuse in ways necessary for research. Open SVI datasets are readily available from less restrictive sources, such as Mapillary, but due to the heterogeneity of the images, these require substantial preprocessing, filtering, and careful quality checks. We present an efficient method for automated downloading, processing, cropping, and filtering open SVI, to be used in a survey of human perceptions of the streets portrayed in these images. We demonstrate our open-source reusable SVI preparation and smartphone-friendly perception-survey software with Amsterdam (Netherlands) as the case study. Using a citizen science approach, we collected from 331 people 22,637 ratings about their perceptions for various criteria. We have published our software in a public repository for future re-use and reproducibility.
- Targeting social learning and engagement: what serious games and gamification can offer to participatory modeling. Environmental Modelling & Software 134, 104846.
- Making modeling and software FAIR. Environmental Modelling & Software 156.
- Street view imagery in urban analytics and GIS: a review. Landscape and Urban Planning 215, 104217. doi:doi.org/10.1016/j.landurbplan.2021.104217.
- The OpenCV Library. Dr. Dobb’s Journal of Software Tools .
- Crowdsourcing geo-information on landscape perceptions and preferences: a review. Landscape and Urban Planning 184, 101–111.
- Come take a walk with me: the “Go-Along” interview as a novel method for studying the implications of place for health and well-being. Health & Place 15, 263–272.
- Masked-attention mask transformer for universal image segmentation, in: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 1290–1299.
- The Cityscapes dataset for semantic urban scene understanding, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3213–3223.
- Quality of life in the planning literature. Journal of Planning Literature 15, 135–161. doi:10.1177/08854120022092962.
- Deep learning the city: quantifying urban perception at a global scale, in: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, NL, October 11–14, 2016, Proceedings, Part I 14, Springer. pp. 196–212.
- Computer vision-enhanced selection of geo-tagged photos on social network sites for land cover classification. Environmental Modelling & Software 128, 104696.
- Citizen science in environmental and ecological sciences. Nature Reviews Methods Primers 2, 64.
- Learning generalized zero-shot learners for open-domain image geolocalization. arXiv:2302.00275.
- Citizen science and policy: a European perspective. Technical Report. Woodrow Wilson International Center for Scholars. Washington, DC, USA.
- The utility of street view imagery in environmental audits for runnability. Applied Geography 162, 103167.
- To use or not to use proprietary street view images in (health and place) research? That is the question. arXiv:2402.11504.
- FAIR principles for research software (FAIR4RS principles). Research Data Alliance .
- A survey of the Hough transform. Computer Vision, Graphics, and Image Processing 44, 87--116. doi:doi.org/10.1016/S0734-189X(88)80033-1.
- Road lane detection using computer vision. International Journal for Research in Applied Science & Engineering Technology (IJRASET) 10, 1993--2002. doi:doi.org/10.22214/ijraset.2022.45634.
- Urban parks: visitors’ perceptions versus spatial indicators. Land use policy 64, 233--244.
- Spatial dimensions of the influence of urban green-blue spaces on human health: a systematic review. Environmental research 180, 108869.
- Measuring and modelling perceptions of the built environment for epidemiological research using crowd-sourcing and image-based deep learning models. Journal of Exposure Science & Environmental Epidemiology 32, 892--899.
- Analyzing accessibility dimension of urban quality of life: where urban designers face duality between subjective and objective reading of place. Social Indicators Research 94, 417--435.
- The image of the city. The MIT Press, Cambridge, MA, USA.
- The state of Mapillary: an exploratory analysis. ISPRS International Journal of Geo-Information 9, 10.
- What is the strength of the link between objective and subjective indicators of urban quality of life? Applied research in quality of life 1, 79--96.
- Streetscore - predicting the perceived safety of one million streetscapes, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
- Beauty is in the eye of the beholder: moderate ability to predict perceptions of beauty, restorativeness, and naturalness, in imagery among 10,727 participants. Landscape and Urban Planning 243, 104958.
- 8 charts on technology use around the world. URL: www.pewresearch.org/short-reads/2024/02/05/8-charts-on-technology-use-around-the-world/.
- Learning transferable visual models from natural language supervision, in: Meila, M., Zhang, T. (Eds.), Proceedings of the 38th International Conference on Machine Learning, PMLR. pp. 8748--8763. URL: https://proceedings.mlr.press/v139/radford21a.html.
- Systematic review of the use of Google Street View in health research: Major themes, strengths, weaknesses and possibilities for future research. Health & place 52, 240--246.
- Place Pulse: Measuring the collaborative image of the city. Ph.D. thesis. Massachusetts Institute of Technology.
- Measuring and enhancing image quality attributes. URL: https://towardsdatascience.com/measuring-enhancing-image-quality-attributes-234b0f250e10.
- Absolute identification by relative judgment. Psychological review 112, 881.
- Semantic segmentation using Vision Transformers: a survey. Engineering Applications of Artificial Intelligence 126, 106669. doi:doi.org/10.1016/j.engappai.2023.106669.
- Designed natural spaces: informal gardens are perceived to be more restorative than formal gardens. Frontiers in Psychology 7. doi:10.3389/fpsyg.2016.00088.
- Linking green space to health: a comparative study of two urban neighbourhoods in Ghent, Belgium. Population and Environment 34, 171--193.
- SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods 17, 261--272. doi:10.1038/s41592-019-0686-2.
- Scikit-image: image processing in Python. PeerJ 2, e453.
- Comment: the FAIR guiding principles for scientific data management and stewardship. Scientific Data 3, 1--9. doi:10.1038/sdata.2016.18.
- HuggingFace’s Transformers: state-of-the-art natural language processing. arXiv:1910.03771.
- Automatic land cover classification of geo-tagged field photos by deep learning. Environmental Modelling & Software 91, 127--134.
- A human-machine adversarial scoring framework for urban perception assessment using street-view images. International Journal of Geographical Information Science 33, 2363--2384.
- The visual quality of streets: a human-centred continuous measurement based on machine learning algorithms and street view images. Environment and Planning B: Urban Analytics and City Science 46, 1439--1457.
- Method for applying crowdsourced street-level imagery data to evaluate street-level greenness. ISPRS International Journal of Geo-Information 12, 108.