Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Open-source data pipeline for street-view images: a case study on community mobility during COVID-19 pandemic (2401.13087v1)

Published 23 Jan 2024 in cs.CV and stat.AP

Abstract: Street View Images (SVI) are a common source of valuable data for researchers. Researchers have used SVI data for estimating pedestrian volumes, demographic surveillance, and to better understand built and natural environments in cityscapes. However, the most common source of publicly available SVI data is Google Street View. Google Street View images are collected infrequently, making temporal analysis challenging, especially in low population density areas. Our main contribution is the development of an open-source data pipeline for processing 360-degree video recorded from a car-mounted camera. The video data is used to generate SVIs, which then can be used as an input for temporal analysis. We demonstrate the use of the pipeline by collecting a SVI dataset over a 38-month longitudinal survey of Seattle, WA, USA during the COVID-19 pandemic. The output of our pipeline is validated through statistical analyses of pedestrian traffic in the images. We confirm known results in the literature and provide new insights into outdoor pedestrian traffic patterns. This study demonstrates the feasibility and value of collecting and using SVI for research purposes beyond what is possible with currently available SVI data. Limitations and future improvements on the data pipeline and case study are also discussed.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (65)
  1. Cinnamon J, Jahiu L. Panoramic Street-Level Imagery in Data-Driven Urban Research: A Comprehensive Global Review of Applications, Techniques, and Practical Considerations. ISPRS International Journal of Geo-Information. 2021;10(7):471. doi:10.3390/ijgi10070471.
  2. Gilge C. Google Street View and the Image as Experience. GeoHumanities. 2016;2(2):469–484. doi:10.1080/2373566X.2016.1217741.
  3. Street View Imagery (SVI) in the Built Environment: A Theoretical and Systematic Review. Buildings. 2022;12(8):1167. doi:10.3390/buildings12081167.
  4. Using deep learning and Google Street View to estimate the demographic makeup of neighborhoods across the United States. Proceedings of the National Academy of Sciences - PNAS. 2017;114(50):13108–13113.
  5. Can Virtual Streetscape Audits Reliably Replace Physical Streetscape Audits? Journal of Urban Health. 2010;87(6):1007–1016. doi:10.1007/s11524-010-9505-x.
  6. Automated survey of selected common plant species in Thai homegardens using Google Street View imagery and a deep neural network. Earth Science Informatics. 2021;14(1):179–191. doi:10.1007/s12145-020-00557-3.
  7. ‘Big data’ for pedestrian volume: Exploring the use of Google Street View images for pedestrian counts. Applied Geography. 2015;63:337–345. doi:10.1016/j.apgeog.2015.07.010.
  8. Systematic review of the use of Google Street View in health research: Major themes, strengths, weaknesses and possibilities for future research. Health & Place. 2018;52:240–246. doi:10.1016/j.healthplace.2018.07.001.
  9. Using street view data and machine learning to assess how perception of neighborhood safety influences urban residents’ mental health. Health & Place. 2019;59:102186. doi:10.1016/j.healthplace.2019.102186.
  10. Towards Detecting Building Facades with Graffiti Artwork Based on Street View Images. ISPRS International Journal of Geo-Information. 2020;9(2). doi:10.3390/ijgi9020098.
  11. Mapillary. Mapillary; 2013. Available from: https://www.mapillary.com.
  12. Crowdsourcing Street View Imagery: A Comparison of Mapillary and OpenStreetCam. ISPRS International Journal of Geo-Information. 2020;9(6). doi:10.3390/ijgi9060341.
  13. Multimodal deep learning from satellite and street-level imagery for measuring income, overcrowding, and environmental deprivation in urban areas. Remote Sensing of Environment. 2021;257:112339.
  14. Google street view image availability in the Bronx and San Diego, 2007–2020: Understanding potential biases in virtual audits of urban built environments. Health & Place. 2021;72:102701. doi:10.1016/j.healthplace.2021.102701.
  15. Evaluating post-Katrina recovery in Mississippi using repeat photography. Disasters. 2011;35(3):488–509. doi:10.1111/j.1467-7717.2010.01227.x.
  16. The use of photos to investigate ecological change. Journal of Ecology. 2022;110(6):1220–1236. doi:10.1111/1365-2745.13876.
  17. Estimating the spatial-temporal distribution of urban street ponding levels from surveillance videos based on computer vision. Water Resources Management. 2022;36(6):1799–1812. doi:10.1007/s11269-022-03107-2.
  18. Detecting, Tracking and Counting People Getting On/Off a Metropolitan Train Using a Standard Video Camera. Sensors (Basel, Switzerland). 2020;20(21):6251. doi:10.3390/s20216251.
  19. Bureau USC. Understanding Geographic Identifiers (GEOIDs); 2021. Available from: https://www.census.gov/programs-surveys/geography/guidance/geo-identifiers.html.
  20. Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond. arXiv preprint arXiv:220103176. 2022;.
  21. CrowdHuman: A Benchmark for Detecting Human in a Crowd. arXiv preprint arXiv:180500123. 2018;.
  22. Street View Data Collection Design for Disaster Reconnaissance. arXiv preprint arXiv:230806284. 2023;.
  23. Miles SB. Foundations of community disaster resilience: Well-being, identity, services, and capitals. Environmental Hazards. 2015;14(2):103–121.
  24. DesignSafe: New Cyberinfrastructure for Natural Hazards Engineering. Natural hazards review. 2017;18(3).
  25. In: Frontera: The Evolution of Leadership Computing at the National Science Foundation. New York, NY, USA: Association for Computing Machinery; 2020. p. 106–111. Available from: https://doi.org/10.1145/3311790.3396656.
  26. Globus: Research Data Management as Service and Platform. PEARC17. New York, NY, USA: Association for Computing Machinery; 2017.Available from: https://doi.org/10.1145/3093338.3093367.
  27. Mutha NS. How to map Equirectangular projection to Rectilinear projection; 2017. Available from: https://blog.nitishmutha.com/equirectangular/360degree/2017/06/12/How-to-project-Equirectangular-image-to-rectilinear-view.html.
  28. Van Rossum G, Drake FL. Python 3 Reference Manual. Scotts Valley, CA: CreateSpace; 2009.
  29. Intracounty modeling of COVID-19 infection with human mobility: Assessing spatial heterogeneity with business traffic, age, and race. Proceedings of the National Academy of Sciences. 2021;118(24):e2020524118. doi:10.1073/pnas.2020524118.
  30. COVID-19 lockdown induces disease-mitigating structural changes in mobility networks. Proceedings of the National Academy of Sciences. 2020;117(52):32883–32890. doi:10.1073/pnas.2012326117.
  31. Measuring life-space mobility in community-dwelling older adults. Journal of the American Geriatrics Society. 2003;51(11):1610–1614.
  32. Time out-of-home and cognitive, physical, and emotional wellbeing of older adults: a longitudinal mixed effects model. PloS one. 2015;10(10):e0139643.
  33. Zhu J, Fan Y. Daily travel behavior and emotional well-being: Effects of trip mode, duration, purpose, and companionship. Transportation Research Part A: Policy and Practice. 2018;118:360–373.
  34. Life-space mobility and dimensions of depressive symptoms among community-dwelling older adults. Aging & Mental Health. 2015;19(9):781–789.
  35. The role of daily mobility in mental health inequalities: the interactive influence of activity space and neighbourhood of residence on depression. Social science & medicine. 2011;73(8):1133–1144.
  36. The relationship between community mobility, health status, and quality of life (QOL) in older adults. The American Journal of Occupational Therapy. 2019;73(4_Supplement_1):7311505078p1–7311505078p1.
  37. Subjective well-being related to satisfaction with daily travel. Transportation. 2011;38(1):1–15.
  38. Socioeconomic disparities in community mobility reduction and COVID-19 growth. In: Mayo Clinic Proceedings. vol. 96. Elsevier; 2021. p. 78–85.
  39. Social distancing and inequality in the United States amid COVID-19 outbreak. Environment and Planning A: Economy and Space. 2021;53(1):3–5.
  40. Measuring inequality in community resilience to natural disasters using large-scale mobility data. Nature communications. 2021;12(1):1–9.
  41. Lewis J. Exposures in the City: Looking for Socioeconomic Patterns for the Urban Exposome. Environmental Health Perspectives. 2019;127(4):044003.
  42. Google COVID-19 Community Mobility Reports; 2020. Available from: https://www.google.com/covid19/mobility/.
  43. Apple COVID-19 Mobility Trends Reports; 2020. Available from: https://covid19.apple.com/mobility.
  44. Causal Modeling to Mitigate Selection Bias and Unmeasured Confounding in Internet-Based Epidemiology of COVID-19: Model Development and Validation. JMIR public health and surveillance. 2022;8(7):e31306–e31306. doi:10.2196/31306.
  45. Jonas Klingwort, Rainer Schnell. Critical Limitations of Digital Epidemiology. Survey research methods. 2020;14(2). doi:10.18148/srm/2020.v14i2.7726.
  46. Physical activity monitoring data following disasters. Sustainable Cities and Society. 2022;81:103814. doi:https://doi.org/10.1016/j.scs.2022.103814.
  47. Correcting Bias in Crowdsourced Data to Map Bicycle Ridership of All Bicyclists. Urban Science. 2019;3(2). doi:10.3390/urbansci3020062.
  48. Assessing Bias in Smartphone Mobility Estimates in Low Income Countries. In: ACM SIGCAS Conference on Computing and Sustainable Societies; 2021. p. 364–378.
  49. Quantifying the importance and location of SARS-CoV-2 transmission events in large metropolitan areas. Proceedings of the National Academy of Sciences. 2022;119(26):e2112182119. doi:10.1073/pnas.2112182119.
  50. Birenboim A, Shoval N. Mobility Research in the Age of the Smartphone. Annals of the American Association of Geographers. 2016;106(2):283–291.
  51. Thimm T, Seepold R. Past, present and future of tourist tracking. Journal of Tourism Futures. 2016;2(1):43–55.
  52. Center PR. Mobile Fact Sheet; 2021. Available from: https://www.pewresearch.org/internet/fact-sheet/mobile/.
  53. Social distancing responses to COVID-19 emergency declarations strongly differentiated by income. Proceedings of the National Academy of Sciences. 2020;117(33):19658–19660. doi:10.1073/pnas.2009412117.
  54. Change of human mobility during COVID-19: A United States case study. PLOS ONE. 2021;16(11):e0259031. doi:10.1371/journal.pone.0259031.
  55. Impacts of introducing and lifting nonpharmaceutical interventions on COVID-19 daily growth rate and compliance in the United States. Proceedings of the National Academy of Sciences. 2021;118(12):e2021359118. doi:10.1073/pnas.2021359118.
  56. Mobility network models of COVID-19 explain inequities and inform reopening. Nature. 2021;589(7840):82–87. doi:10.1038/s41586-020-2923-3.
  57. Kraus S, Koch N. Provisional COVID-19 infrastructure induces large, rapid increases in cycling. Proceedings of the National Academy of Sciences. 2021;118(15):e2024399118. doi:10.1073/pnas.2024399118.
  58. How did outdoor biking and walking change during COVID-19?: A case study of three U.S. cities. PloS one. 2021;16(1):e0245514. doi:10.1371/journal.pone.0245514.
  59. Fotheringham AS, Wong DW. The modifiable areal unit problem in multivariate statistical analysis. Environment and planning A. 1991;23(7):1025–1044.
  60. Generalizable pedestrian detection: The elephant in the room. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2021. p. 11328–11337.
  61. Biljecki F, Ito K. Street view imagery in urban analytics and GIS: A review. Landscape and Urban Planning. 2021;215:104217. doi:10.1016/j.landurbplan.2021.104217.
  62. Measuring changes in neighborhood disorder using Google Street View longitudinal imagery: a feasibility study. Cities & Health. 2023;7(5):823–829. doi:10.1080/23748834.2023.2207931.
  63. EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing. IEEE Transactions on Intelligent Transportation Systems. 2023; p. 1–13. doi:10.1109/TITS.2023.3306368.
  64. Review of Empirical Quantitative Data Use in Lifeline Infrastructure Restoration Modeling. Natural hazards review. 2021;22(4).
  65. Curtis A, Mills JW. Spatial video data collection in a post-disaster landscape: The Tuscaloosa Tornado of April 27th 2011. Applied Geography. 2012;32(2):393–400. doi:10.1016/j.apgeog.2011.06.002.
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now