Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
144 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Pedestrian crossing decisions can be explained by bounded optimal decision-making under noisy visual perception (2402.04370v1)

Published 6 Feb 2024 in cs.AI

Abstract: This paper presents a model of pedestrian crossing decisions, based on the theory of computational rationality. It is assumed that crossing decisions are boundedly optimal, with bounds on optimality arising from human cognitive limitations. While previous models of pedestrian behaviour have been either 'black-box' machine learning models or mechanistic models with explicit assumptions about cognitive factors, we combine both approaches. Specifically, we model mechanistically noisy human visual perception and assumed rewards in crossing, but we use reinforcement learning to learn bounded optimal behaviour policy. The model reproduces a larger number of known empirical phenomena than previous models, in particular: (1) the effect of the time to arrival of an approaching vehicle on whether the pedestrian accepts the gap, the effect of the vehicle's speed on both (2) gap acceptance and (3) pedestrian timing of crossing in front of yielding vehicles, and (4) the effect on this crossing timing of the stopping distance of the yielding vehicle. Notably, our findings suggest that behaviours previously framed as 'biases' in decision-making, such as speed-dependent gap acceptance, might instead be a product of rational adaptation to the constraints of visual perception. Our approach also permits fitting the parameters of cognitive constraints and rewards per individual, to better account for individual differences. To conclude, by leveraging both RL and mechanistic modelling, our model offers novel insights about pedestrian behaviour, and may provide a useful foundation for more accurate and scalable pedestrian models.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (82)
  1. Predicting pedestrian intention to cross the road. IEEE Access 8, 72558–72569.
  2. A framework for modeling human-like driving behaviors for autonomous vehicles in driving simulators, in: Proceedings of the fifth international conference on Autonomous agents, pp. 286–291.
  3. Social lstm: Human trajectory prediction in crowded spaces, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 961–971.
  4. Automatic generation of safety-critical test scenarios for collision avoidance of road vehicles, in: 2018 IEEE Intelligent Vehicles Symposium (IV), IEEE. pp. 1326–1333.
  5. Pedestrian road crossing behavior under mixed traffic conditions: a comparative study of an intersection before and after implementing control measures. Transportation in developing economies 2, 14.
  6. Computational modeling in human-computer interaction, in: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–7.
  7. Pedestrian models for autonomous driving part ii: high-level models of human behavior. IEEE Transactions on Intelligent Transportation Systems 22, 5453–5472.
  8. Apparently irrational choice as optimal sequential decision making, in: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 792–800.
  9. An adaptive model of gaze-based selection, in: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–11.
  10. Social interaction-aware dynamical models and decision-making for autonomous vehicles. Advanced Intelligent Systems , 2300575.
  11. Modeling vehicle interactions via modified lstm models for trajectory prediction. IEEE Access 7, 38287–38296.
  12. Critical roles for distance, task, and motion in space perception: Initial conceptual framework and practical implications. Human Factors 50, 811–820.
  13. Perception of Collision. Cambridge University Press. Cambridge Handbooks in Psychology, p. 568–591. doi:10.1017/CBO9780511973017.035.
  14. Ithaca365: Dataset and driving perception under repeated and challenging weather conditions, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 21383–21392.
  15. Predicting occupancy distributions of walking humans with convolutional neural networks. IEEE Robotics and Automation Letters 3, 1522–1528.
  16. Proxemics and kinesics in automated vehicle–pedestrian communication: Representing ethnographic observations. Transportation research record 2673, 70–81.
  17. Integrating perceptual and cognitive modeling for adaptive and intelligent human-computer interaction. Proceedings of the IEEE 90, 1272–1289.
  18. Noise in the nervous system. Nature reviews neuroscience 9, 292–303.
  19. Behavioral dynamics of steering, obstable avoidance, and route selection. Journal of Experimental Psychology: Human Perception and Performance 29, 343.
  20. Empirical and theoretical limits on lag recency in free recall. Psychonomic Bulletin & Review 15, 1236–1250.
  21. Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science 349, 273–278.
  22. At the zebra crossing: Modelling complex decision processes with variable-drift diffusion models, in: Proceedings of the 41st annual meeting of the cognitive science society, Cognitive Science Society. pp. 366–372.
  23. Agent-based modeling for urban development planning based on human needs. conceptual basis and model formulation. Land Use Policy 101, 105110.
  24. Observation results on pedestrian-vehicle interactions at non-signalized intersections towards simulation. Transportation research part F: traffic psychology and behaviour 59, 269–285.
  25. Towards machines that understand people. AI Magazine 44, 312–327.
  26. Multiagent reinforcement learning: theoretical framework and an algorithm., in: ICML, pp. 242–250.
  27. Pedestrian crossing behaviour analysis at intersections. International Journal for Traffic and Transport Engineering 4, 103–116.
  28. Bayesian Parameter Inference for Cognitive Simulators. Cambridge University Press, Cambridge, United Kingdom. pp. 308–334. doi:10.1017/9781108874830.016.
  29. Multitasking in driving as optimal adaptation under uncertainty. Human factors 63, 1324–1341.
  30. Adaptive feature guidance: Modelling visual search with graphical layouts. International Journal of Human-Computer Studies 136, 102376.
  31. Reinforcement learning: A survey. Journal of artificial intelligence research 4, 237–285.
  32. Amortised experimental design and parameter estimation for user models of pointing, in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pp. 1–17.
  33. Scenario factory: Creating safety-critical traffic scenarios for automated vehicles, in: 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), IEEE. pp. 1–7.
  34. The bayesian brain: the role of uncertainty in neural coding and computation. TRENDS in Neurosciences 27, 712–719.
  35. Pedestrian safety models for urban environments with high roadside activities. Safety Science 130, 104847.
  36. Cnn-based pedestrian orientation estimation from a single image, in: 2017 4th IAPR Asian conference on pattern recognition (ACPR), IEEE. pp. 13–18.
  37. Unifying account of visual motion and position perception. Proceedings of the National Academy of Sciences 112, 8142–8147.
  38. Modeling and evolving human behaviors and emotions in road traffic networks. Procedia-Social and Behavioral Sciences 54, 999–1009.
  39. Computational rationality: Linking mechanism and behavior through bounded utility maximization. Topics in cognitive science 6, 279–311.
  40. Human dynamics based driver model for autonomous car. IET Intelligent Transport Systems 10, 545–554.
  41. Graph-based spatial transformer with memory replay for multi-future pedestrian trajectory prediction, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2231–2241.
  42. Modeling touch-based menu selection performance of blind users via reinforcement learning, in: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA. URL: https://doi.org/10.1145/3544548.3580640, doi:10.1145/3544548.3580640.
  43. Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources. Behavioral and brain sciences 43, e1.
  44. Age-related differences in street-crossing decisions: The effects of vehicle speed and time constraints on gap selection in an estimation task. Accident analysis & prevention 39, 934–943.
  45. Capformer: Pedestrian crossing action prediction using transformer. Sensors 21, 5694.
  46. Models of human behavior for human-robot interaction and automated driving: How accurate do the models of human behavior need to be? IEEE Robotics I& Automation Magazine , 2–7doi:10.1109/MRA.2022.3182892.
  47. A farewell to brake reaction times? kinematics-dependent brake response in naturalistic rear-end emergencies. Accident Analysis & Prevention 95, 209–226.
  48. Explaining human interactions on the road by large-scale integration of computational psychological theory. PNAS nexus 2, 163.
  49. Human-level control through deep reinforcement learning. nature 518, 529–533.
  50. Distance determined by the angular declination below the horizon. Nature 414, 197–200.
  51. Computational rationality as a theory of interaction, in: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–14.
  52. Crossing roads safely: an experimental study of age differences in gap selection by pedestrians. Accident Analysis & Prevention 37, 962–971.
  53. Variable-drift diffusion models of pedestrian road-crossing decisions. Computational Brain & Behavior , 1–21.
  54. Modeling and urban planning: A systematic review of performance-based approaches. Sustainable cities and society 52, 101867.
  55. On the relationship between pedestrian gap acceptance and time to arrival estimates. Accident Analysis & Prevention 72, 127–133.
  56. Holistic lstm for pedestrian trajectory prediction. IEEE transactions on image processing 30, 3229–3239.
  57. Diffusion decision model: Current issues and history. Trends in cognitive sciences 20, 260–281.
  58. Human-vehicle interfaces: The power of vehicle movement gestures in human road user coordination, pp. 186–192. doi:10.17077/drivingassessment.1633.
  59. Analyzing driver-pedestrian interaction at crosswalks: A contribution to autonomous driving in urban environments, in: 2016 IEEE intelligent vehicles symposium (IV), IEEE. pp. 38–43.
  60. Mastering the game of go with deep neural networks and tree search. nature 529, 484–489.
  61. Mastering the game of go without human knowledge. nature 550, 354–359.
  62. A behavioral model of rational choice. The quarterly journal of economics , 99–118.
  63. Beyond rmse: Do machine-learned models of road user interaction produce human-like behavior? IEEE Transactions on Intelligent Transportation Systems .
  64. Noise characteristics and prior expectations in human visual speed perception. Nature neuroscience 9, 578–585.
  65. The estimation of vehicle speed and stopping distance by pedestrians crossing streets in a naturalistic traffic environment. Transportation research part F: traffic psychology and behaviour 30, 97–106.
  66. Reinforcement learning: An introduction. MIT press.
  67. Explaining unsafe pedestrian road crossing behaviours using a psychophysics-based gap acceptance model. Safety science 154, 105837.
  68. Deceleration parameters as implicit communication signals for pedestrians’ crossing decisions and estimations of automated vehicle behaviour. Accident Analysis & Prevention 190, 107173.
  69. Understanding human avoidance behavior: interaction-aware decision making based on game theory. International journal of social robotics 8, 331–351.
  70. Deep reinforcement learning with double q-learning, in: Proceedings of the AAAI conference on artificial intelligence.
  71. Theory of games and economic behavior, 2nd rev .
  72. Modeling human road crossing decisions as reward maximization with visual perception limitations, in: 2023 IEEE Intelligent Vehicles Symposium (IV), pp. 1–6. doi:10.1109/IV55152.2023.10186617.
  73. Dueling network architectures for deep reinforcement learning, in: International conference on machine learning, PMLR. pp. 1995–2003.
  74. Classes of multiagent q-learning dynamics with epsilon-greedy exploration, in: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 1167–1174.
  75. Iterative reinforcement learning based design of dynamic locomotion skills for cassie. arXiv preprint arXiv:1903.09537 .
  76. Explainable object-induced action decision for autonomous vehicles, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9523–9532.
  77. A social force based pedestrian motion model considering multi-pedestrian interaction with a vehicle. ACM Transactions on Spatial Algorithms and Systems (TSAS) 6, 1–27.
  78. Pedestrian behavior understanding and prediction with deep neural networks, in: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14, Springer. pp. 263–279.
  79. Multimodal transformer networks for pedestrian trajectory prediction., in: IJCAI, pp. 1259–1265.
  80. Agentformer: Agent-aware transformers for socio-temporal multi-agent forecasting, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9813–9823.
  81. St crossingpose: A spatial-temporal graph convolutional network for skeleton-based pedestrian crossing intention prediction. IEEE Transactions on Intelligent Transportation Systems 23, 20773–20782.
  82. Effect of urban street trees on pedestrian safety: A micro-level pedestrian casualty model using multivariate bayesian spatial approach. Accident Analysis & Prevention 176, 106818.
Citations (1)

Summary

We haven't generated a summary for this paper yet.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets