Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
167 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

uTRAND: Unsupervised Anomaly Detection in Traffic Trajectories (2404.12712v1)

Published 19 Apr 2024 in cs.CV, cs.AI, and cs.LG

Abstract: Deep learning-based approaches have achieved significant improvements on public video anomaly datasets, but often do not perform well in real-world applications. This paper addresses two issues: the lack of labeled data and the difficulty of explaining the predictions of a neural network. To this end, we present a framework called uTRAND, that shifts the problem of anomalous trajectory prediction from the pixel space to a semantic-topological domain. The framework detects and tracks all types of traffic agents in bird's-eye-view videos of traffic cameras mounted at an intersection. By conceptualizing the intersection as a patch-based graph, it is shown that the framework learns and models the normal behaviour of traffic agents without costly manual labeling. Furthermore, uTRAND allows to formulate simple rules to classify anomalous trajectories in a way suited for human interpretation. We show that uTRAND outperforms other state-of-the-art approaches on a dataset of anomalous trajectories collected in a real-world setting, while producing explainable detection results.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Armstrong Aboah. A vision-based system for traffic anomaly detection using deep learning and decision trees. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pages 4207–4212, 2021.
  2. Video analysis for traffic anomaly detection using support vector machines. Proceedings of the World Congress on Intelligent Control and Automation (WCICA), 2015:5500–5505, 2015.
  3. Anomaly detection: A survey. ACM Comput. Surv., 41(3), 2009.
  4. Unsupervised anomaly detection for intricate kpis via adversarial training of vae. In IEEE INFOCOM 2019-IEEE Conference on Computer Communications, pages 1891–1899. IEEE, 2019.
  5. Monocular vehicle 3d bounding box estimation using homograhy and geometry in traffic scene. In ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1995–1999, 2022.
  6. Mgfn: Magnitude-contrastive glance-and-focus network for weakly-supervised video anomaly detection. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 387–395, 2023.
  7. CROW. Intersection topology format (itf). topology guidelines version 2.1. Technical report, Crow, 2018.
  8. Designing huge repositories of moving vehicles trajectories for efficient extraction of semantic data. IEEE Trans. on Intelligent Transportation Systems, 16(4):2038–2049, 2015.
  9. Automated camera calibration via homography estimation with gnns. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 5876–5883, 2024.
  10. Online anomaly detection in surveillance videos with asymptotic bounds on false alarm rate. CoRR, abs/2010.07110, 2020.
  11. Anomaly detection in video via self-supervised and multi-task learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12742–12752, 2021.
  12. Memorizing normality to detect anomaly: Memory-augmented deep autoencoder for unsupervised anomaly detection. CoRR, abs/1904.02639, 2019.
  13. A weakly supervised framework for abnormal behavior detection and localization in crowded scenes. Neurocomputing, 383:270–281, 2020.
  14. Self-supervised attentive generative adversarial networks for video anomaly detection. IEEE transactions on neural networks and learning systems, 2022.
  15. Object-centric auto-encoders and dummy anomalies for abnormal event detection in video. CoRR, abs/1812.04960, 2018.
  16. An introduction to variational autoencoders. CoRR, abs/1906.02691, 2019.
  17. Auto-encoding variational bayes, 2022.
  18. Video trajectory classification and anomaly detection using hybrid cnn-vae. arXiv preprint arXiv:1812.07203, 2018.
  19. Self-training multi-sequence learning with transformer for weakly supervised video anomaly detection. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 1395–1403, 2022.
  20. Anomaly detection for time series using vae-lstm hybrid model. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 4322–4326. Ieee, 2020.
  21. Accumulated relative density outlier detection for large scale traffic data. Electronic Imaging, 30(9):239–1–239–1, 2018a.
  22. Future frame prediction for anomaly detection – a new baseline. In 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018b.
  23. A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction. CoRR, abs/2108.06852, 2021a.
  24. A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction. CoRR, abs/2108.06852, 2021b.
  25. Remembering history with convolutional lstm for anomaly detection. 2017 IEEE International Conference on Multimedia and Expo (ICME), pages 439–444, 2017.
  26. Anomaly detection in crowded scenes. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1975–1981, 2010.
  27. Detection of traffic anomalies for a safety system of smart city. In CEUR Workshop Proceedings, pages 337–342, 2020.
  28. Gee: A gradient-based explainable variational autoencoder for network anomaly detection. In 2019 IEEE Conference on Communications and Network Security (CNS), pages 91–99. IEEE, 2019.
  29. Lstm-based vae-gan for time-series anomaly detection. Sensors, 20(13):3738, 2020.
  30. Trajectory-based anomalous event detection. IEEE Transactions on Circuits and Systems for Video Technology, 18(11):1544–1554, 2008.
  31. Real-time flying object detection with yolov8, 2023.
  32. Attribute-based representations for accurate and interpretable video anomaly detection, 2022.
  33. Road user abnormal trajectory detection using a deep autoencoder. In Advances in Visual Computing: 13th International Symposium, ISVC 2018, Las Vegas, NV, USA, November 19–21, 2018, Proceedings 13, pages 748–757. Springer, 2018.
  34. Anomaly detection in road traffic using visual surveillance: A survey. ACM Comput. Surv., 53(6), 2020.
  35. Vehicular trajectory classification and traffic anomaly detection in videos using a hybrid cnn-vae architecture. IEEE Transactions on Intelligent Transportation Systems, 23(8):11891–11902, 2021.
  36. Semi-supervised anomaly detection in video-surveillance scenes in the wild. Sensors, 21(12):3993, 2021.
  37. Real-world anomaly detection in surveillance videos. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 6479–6488, 2018.
  38. Weakly-supervised video anomaly detection with robust temporal feature magnitude learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 4975–4986, 2021.
  39. Fusing segmentation and domain-knowledge model to extract intersection topologies from aerial/terrestrial orthographic images. In International Symposium on Electronic Imaging 2024. SPIE, 2024.
  40. Weakly-supervised spatio-temporal anomaly detection in surveillance video. arXiv preprint arXiv:2108.03825, 2021.
  41. Self-supervised sparse representation for video anomaly detection. In Computer Vision – ECCV 2022, pages 729–745, Cham, 2022. Springer Nature Switzerland.
  42. Cloze test helps: Effective video anomaly detection via learning to complete video events. CoRR, abs/2008.11988, 2020.
  43. Weakly supervised anomaly detection in videos considering the openness of events. IEEE Transactions on Intelligent Transportation Systems, 23(11):21687–21699, 2022.
  44. Vae-based deep svdd for anomaly detection. Neurocomputing, 453:131–140, 2021.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets