Evaluating the Significance of Outdoor Advertising from Driver's Perspective Using Computer Vision (2311.07390v2)
Abstract: Outdoor advertising, such as roadside billboards, plays a significant role in marketing campaigns but can also be a distraction for drivers, potentially leading to accidents. In this study, we propose a pipeline for evaluating the significance of roadside billboards in videos captured from a driver's perspective. We have collected and annotated a new BillboardLamac dataset, comprising eight videos captured by drivers driving through a predefined path wearing eye-tracking devices. The dataset includes annotations of billboards, including 154 unique IDs and 155 thousand bounding boxes, as well as eye fixation data. We evaluate various object tracking methods in combination with a YOLOv8 detector to identify billboard advertisements with the best approach achieving 38.5 HOTA on BillboardLamac. Additionally, we train a random forest classifier to classify billboards into three classes based on the length of driver fixations achieving 75.8% test accuracy. An analysis of the trained classifier reveals that the duration of billboard visibility, its saliency, and size are the most influential features when assessing billboard significance.
- O. Oviedo-Trespalacios, V. Truelove, B. Watson, and J. A. Hinton, “The impact of road advertising signs on driver behaviour and implications for road safety: A critical systematic review,” Transportation Research Part A: Policy and Practice, vol. 122, pp. 85–98, 2019. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0965856418310632
- D. Beijer, A. Smiley, and M. Eizenman, “Observed driver glance behavior at roadside advertising signs,” Transportation Research Record, vol. 1899, no. 1, pp. 96–103, 2004.
- R. Brome, M. Awad, and N. M. Moacdieh, “Roadside digital billboard advertisements: Effects of static, transitioning, and animated designs on drivers’ performance and attention,” Transportation research part F: traffic psychology and behaviour, vol. 83, pp. 226–237, 2021.
- K. Yellappan, Y. Ghani, M. Musa, M. Siam, and C. Tan, “Exposure and perception on distraction towards roadside digital advertisements,” 2016.
- A. Smiley, B. Persaud, G. Bahar, C. Mollett, C. Lyon, T. Smahel, and W. L. Kelman, “Traffic safety evaluation of video advertising signs,” Transportation research record, vol. 1937, no. 1, pp. 105–112, 2005.
- M. Costa, L. Bonetti, V. Vignali, A. Bichicchi, C. Lantieri, and A. Simone, “Driver’s visual attention to different categories of roadside advertising signs,” Applied ergonomics, vol. 78, pp. 127–136, 2019.
- D. Crundall, E. Van Loon, and G. Underwood, “Attraction and distraction of attention with roadside advertisements,” Accident Analysis & Prevention, vol. 38, no. 4, pp. 671–677, 2006.
- M. Zalesinska, “The impact of the luminance, size and location of led billboards on drivers’ visual performance—laboratory tests,” Accident Analysis & Prevention, vol. 117, pp. 439–448, 2018.
- K. Mollu, J. Cornu, K. Brijs, A. Pirdavani, and T. Brijs, “Driving simulator study on the influence of digital illuminated billboards near pedestrian crossings,” Transportation research part F: traffic psychology and behaviour, vol. 59, pp. 45–56, 2018.
- J. Harasimczuk, N. E. Maliszewski, A. Olejniczak-Serowiec, and A. Tarnowski, “Are longer advertising slogans more dangerous? the influence of the length of ad slogans on drivers’ attention and motor behavior,” Current Psychology, vol. 40, pp. 429–441, 2021.
- L. Meuleners, P. Roberts, and M. Fraser, “Identifying the distracting aspects of electronic advertising billboards: A driving simulation study,” Accident Analysis & Prevention, vol. 145, p. 105710, 2020.
- N. Maliszewski, A. Olejniczak-Serowiec, and J. Harasimczuk, “Influence of sexual appeal in roadside advertising on drivers’ attention and driving behavior,” PloS one, vol. 14, no. 5, p. e0216919, 2019.
- A. Tarnowski, A. Olejniczak-Serowiec, and A. Marszalec, “Roadside advertising and the distraction of driver’s attention,” in MATEC Web of Conferences, vol. 122. EDP Sciences, 2017, p. 03010.
- H. Marciano et al., “The effect of billboard design specifications on driving: a pilot study,” Accident Analysis & Prevention, vol. 104, pp. 174–184, 2017.
- M. Chan and A. Singhal, “The emotional side of cognitive distraction: Implications for road safety,” Accident Analysis & Prevention, vol. 50, pp. 147–154, 2013.
- G. Jocher, A. Chaurasia, and J. Qiu, “YOLO by Ultralytics,” Jan. 2023. [Online]. Available: https://github.com/ultralytics/ultralytics
- M. Broström, “Real-time multi-object, segmentation and pose tracking using Yolov8 with DeepOCSORT and LightMBN.” [Online]. Available: https://github.com/mikel-brostrom/yolov8_tracking
- G. Neuhold, T. Ollmann, S. R. Bulò, and P. Kontschieder, “The mapillary vistas dataset for semantic understanding of street scenes,” 2017 IEEE International Conference on Computer Vision (ICCV), pp. 5000–5009, 2017.
- J. Cao, J. Pang, X. Weng, R. Khirodkar, and K. Kitani, “Observation-centric sort: Rethinking sort for robust multi-object tracking,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 9686–9696.
- G. Maggiolino, A. Ahmad, J. Cao, and K. Kitani, “Deep oc-sort: Multi-pedestrian tracking by adaptive re-identification,” arXiv preprint arXiv:2302.11813, 2023.
- Y. Du, Z. Zhao, Y. Song, Y. Zhao, F. Su, T. Gong, and H. Meng, “Strongsort: Make deepsort great again,” IEEE Transactions on Multimedia, pp. 1–14, 2023.
- N. Aharon, R. Orfaig, and B.-Z. Bobrovsky, “Bot-sort: Robust associations multi-pedestrian tracking,” arXiv preprint arXiv:2206.14651, 2022.
- Y. Zhang, P. Sun, Y. Jiang, D. Yu, F. Weng, Z. Yuan, P. Luo, W. Liu, and X. Wang, “Bytetrack: Multi-object tracking by associating every detection box,” in Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXII. Springer, 2022, pp. 1–21.
- A. Bewley, Z. Ge, L. Ott, F. Ramos, and B. Upcroft, “Simple online and realtime tracking,” in 2016 IEEE International Conference on Image Processing (ICIP), 2016, pp. 3464–3468.
- J. Luiten, A. Osep, P. Dendorfer, P. Torr, A. Geiger, L. Leal-Taixé, and B. Leibe, “Hota: A higher order metric for evaluating multi-object tracking,” International journal of computer vision, vol. 129, pp. 548–578, 2021.
- G. Bellitto, F. Proietto Salanitri, S. Palazzo, F. Rundo, D. Giordano, and C. Spampinato, “Hierarchical domain-adapted feature learning for video saliency prediction,” International Journal of Computer Vision, vol. 129, pp. 3216–3232, 2021.
- Z. Bylinskii, T. Judd, A. Oliva, A. Torralba, and F. Durand, “What do different evaluation metrics tell us about saliency models?” IEEE transactions on pattern analysis and machine intelligence, vol. 41, no. 3, pp. 740–757, 2018.