Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

CityPulse: Fine-Grained Assessment of Urban Change with Street View Time Series (2401.01107v2)

Published 2 Jan 2024 in cs.CV

Abstract: Urban transformations have profound societal impact on both individuals and communities at large. Accurately assessing these shifts is essential for understanding their underlying causes and ensuring sustainable urban planning. Traditional measurements often encounter constraints in spatial and temporal granularity, failing to capture real-time physical changes. While street view imagery, capturing the heartbeat of urban spaces from a pedestrian point of view, can add as a high-definition, up-to-date, and on-the-ground visual proxy of urban change. We curate the largest street view time series dataset to date, and propose an end-to-end change detection model to effectively capture physical alterations in the built environment at scale. We demonstrate the effectiveness of our proposed method by benchmark comparisons with previous literature and implementing it at the city-wide level. Our approach has the potential to supplement existing dataset and serve as a fine-grained and accurate assessment of urban change.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Street-view change detection with deconvolutional networks. Autonomous Robots, 42: 1301–1322.
  2. Emerging Properties in Self-Supervised Vision Transformers. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 9630–9640.
  3. DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detection. 2021 IEEE Intelligent Vehicles Symposium (IV), 502–509.
  4. SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery. ArXiv, abs/2207.08051.
  5. SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery. In Oh, A. H.; Agarwal, A.; Belgrave, D.; and Cho, K., eds., Advances in Neural Information Processing Systems.
  6. Daniel, K. 2015. Goal 11: Make cities and human settlements inclusive, safe, resilient and sustainable. The Sustainable Development Goals Report 2018.
  7. Fully Convolutional Siamese Networks for Change Detection. 2018 25th IEEE International Conference on Image Processing (ICIP), 4063–4067.
  8. Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks. IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium, 2115–2118.
  9. Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States. Proceedings of the National Academy of Sciences, 114(50): 13108–13113.
  10. Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks. IEEE Transactions on Neural Networks and Learning Systems, 27: 125–138.
  11. Classifying Street Spaces with Street View Images for a Spatial Indicator of Urban Functions. Sustainability, 11: 6424.
  12. Bootstrap your own latent-a new approach to self-supervised learning. Advances in neural information processing systems, 33: 21271–21284.
  13. Unsupervised Semantic Segmentation by Distilling Feature Correspondences. In International Conference on Learning Representations.
  14. Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 16000–16009.
  15. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778.
  16. Detecting Neighborhood Gentrification at Scale via Street-level Visual Data. 2022 IEEE International Conference on Big Data (Big Data), 1632–1640.
  17. Learning Neighborhood Representation from Multi-Modal Multi-Graph: Image, Text, Mobility Graph and Beyond.
  18. Unequal Displacement: Gentrification, Racial Stratification, and Residential Destinations in Philadelphia1. American Journal of Sociology, 126: 354 – 406.
  19. Divergent Pathways of Gentrification: Racial Inequality and the Social Order of Renewal in Chicago Neighborhoods. American Sociological Review, 79: 726–751.
  20. Divergent Pathways of Gentrification: Racial Inequality and the Social Order of Renewal in Chicago Neighborhoods. American Sociological Review, 79(4): 726–751.
  21. Predicting Livelihood Indicators from Community-Generated Street-Level Imagery. In AAAI.
  22. Self-supervised pre-training enhances change detection in Sentinel-2 imagery. In ICPR Workshops.
  23. Assessing street-level urban greenery using Google Street View and a modified green view index. Urban Forestry & Urban Greening, 14: 675–685.
  24. Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection. Remote. Sens., 8: 506.
  25. Change Event Dataset for Discovery from Spatio-temporal Remote Sensing Imagery. In Neural Information Processing Systems.
  26. Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Data. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 9394–9403.
  27. Estimating building energy efficiency from street view imagery, aerial imagery, and land surface temperature data. Applied Energy, 333: 120542.
  28. Computer vision uncovers predictors of physical urban change. Proceedings of the National Academy of Sciences, 114(29): 7571–7576.
  29. Streetscore – Predicting the Perceived Safety of One Million Streetscapes. 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 793–799.
  30. DINOv2: Learning Robust Visual Features without Supervision. ArXiv, abs/2304.07193.
  31. Urbanization and agricultural land loss in India: comparing satellite estimates with census data. Journal of environmental management, 148: 53–66.
  32. Learning transferable visual models from natural language supervision. In International conference on machine learning, 8748–8763. PMLR.
  33. Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation. In British Machine Vision Conference.
  34. Weakly Supervised Silhouette-based Semantic Scene Change Detection. In ICRA, 6861–6867. IEEE.
  35. Sustainability in an urbanizing planet. Proceedings of the National Academy of Sciences, 114: 8935 – 8938.
  36. A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection. IEEE Transactions on Geoscience and Remote Sensing, 60: 1–16.
  37. Using Building Permits to Monitor Disaster Recovery: A Spatio-Temporal Case Study of Coastal Mississippi Following Hurricane Katrina. Cartography and Geographic Information Science, 37: 57 – 68.
  38. Strauss, J. 2013. Does housing drive state-level job growth? Building permits and consumer expectations forecast a state’s economic activity. Journal of Urban Economics, 73: 77–93.
  39. Neighborhood Change and Urban Policy. Journal of Planning Education and Research, 15: 159 – 170.
  40. Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding. arXiv:2001.11101.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now