Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
149 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Evaluating the Effectiveness of Video Anomaly Detection in the Wild: Online Learning and Inference for Real-world Deployment (2404.18747v1)

Published 29 Apr 2024 in cs.CV and cs.AI

Abstract: Video Anomaly Detection (VAD) identifies unusual activities in video streams, a key technology with broad applications ranging from surveillance to healthcare. Tackling VAD in real-life settings poses significant challenges due to the dynamic nature of human actions, environmental variations, and domain shifts. Many research initiatives neglect these complexities, often concentrating on traditional testing methods that fail to account for performance on unseen datasets, creating a gap between theoretical models and their real-world utility. Online learning is a potential strategy to mitigate this issue by allowing models to adapt to new information continuously. This paper assesses how well current VAD algorithms can adjust to real-life conditions through an online learning framework, particularly those based on pose analysis, for their efficiency and privacy advantages. Our proposed framework enables continuous model updates with streaming data from novel environments, thus mirroring actual world challenges and evaluating the models' ability to adapt in real-time while maintaining accuracy. We investigate three state-of-the-art models in this setting, focusing on their adaptability across different domains. Our findings indicate that, even under the most challenging conditions, our online learning approach allows a model to preserve 89.39% of its original effectiveness compared to its offline-trained counterpart in a specific target domain.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Understanding the challenges and opportunities of pose-based anomaly detection. In Proceedings of the 8th International Workshop on Sensor-Based Activity Recognition and Artificial Intelligence, New York, NY, USA, 2023. Association for Computing Machinery.
  2. Ssmtl++: Revisiting self-supervised multi-task learning for video anomaly detection. Computer Vision and Image Understanding, 229:103656, 2023.
  3. Nm-gan: Noise-modulated generative adversarial network for video anomaly detection. Pattern Recognition, 116:107969, 2021.
  4. Multiscale spatial temporal attention graph convolution network for skeleton-based anomaly behavior detection. Journal of Visual Communication and Image Representation, 90:103707, 2023.
  5. Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation. IEEE Transactions on Image Processing, 24(12):5288–5301, 2015.
  6. Toward abnormal trajectory and event detection in video surveillance. IEEE Transactions on Circuits and Systems for Video Technology, 27(3):683–695, 2016.
  7. Chad: Charlotte anomaly dataset. In Scandinavian Conference on Image Analysis, pages 50–66. Springer, 2023.
  8. Online anomaly detection in surveillance videos with asymptotic bound on false alarm rate. Pattern Recognition, 114:107865, 2021.
  9. Towards interpretable video anomaly detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 2655–2664, 2023.
  10. Anomaly detection in video via self-supervised and multi-task learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12742–12752, 2021a.
  11. A background-agnostic framework with adversarial training for abnormal event detection in video. IEEE transactions on pattern analysis and machine intelligence, 44(9):4505–4523, 2021b.
  12. Normalizing flows for human pose anomaly detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13545–13554, 2023.
  13. Hierarchical graph embedded pose regularity learning via spatio-temporal transformer for abnormal behavior detection. In Proceedings of the 30th ACM International Conference on Multimedia, pages 307–315, 2022.
  14. Multi-level memory-augmented appearance-motion correspondence framework for video anomaly detection. In 2023 IEEE International Conference on Multimedia and Expo (ICME), pages 2717–2722. IEEE, 2023.
  15. Posecvae: Anomalous human activity detection. In 2020 25th International Conference on Pattern Recognition (ICPR), pages 2927–2934. IEEE, 2021.
  16. Real-time weakly supervised video anomaly detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 6848–6856, 2024.
  17. Future frame prediction for anomaly detection–a new baseline. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 6536–6545, 2018.
  18. Graph embedded pose clustering for anomaly detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10539–10547, 2020.
  19. Learning regularity in skeleton trajectories for anomaly detection in videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
  20. An exploratory study on human-centric video anomaly detection through variational autoencoders and trajectory prediction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 995–1004, 2024.
  21. Multi-timescale trajectory prediction for abnormal human activity detection. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2626–2634, 2020.
  22. Video anomaly detection by solving decoupled spatio-temporal jigsaw puzzles. In European Conference on Computer Vision, pages 494–511. Springer, 2022.
  23. Regularity learning via explicit distribution modeling for skeletal video anomaly detection. IEEE Transactions on Circuits and Systems for Video Technology, 2023.
  24. Online anomaly detection in crowd scenes via structure analysis. IEEE transactions on cybernetics, 45(3):548–561, 2014.
  25. Generative cooperative learning for unsupervised video anomaly detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14744–14754, 2022.
  26. A hierarchical spatio-temporal graph convolutional neural network for anomaly detection in videos. IEEE Transactions on Circuits and Systems for Video Technology, 33(1):200–212, 2021.
  27. Online video anomaly detection. Sensors, 23(17):7442, 2023.
Citations (2)

Summary

We haven't generated a summary for this paper yet.