Papers
Topics
Authors
Recent
2000 character limit reached

IMAGO: A family photo album dataset for a socio-historical analysis of the twentieth century (2012.01955v1)

Published 3 Dec 2020 in cs.CV, cs.CY, and cs.MM

Abstract: Although one of the most popular practices in photography since the end of the 19th century, an increase in scholarly interest in family photo albums dates back to the early 1980s. Such collections of photos may reveal sociological and historical insights regarding specific cultures and times. They are, however, in most cases scattered among private homes and only available on paper or photographic film, thus making their analysis by academics such as historians, social-cultural anthropologists and cultural theorists very cumbersome. In this paper, we analyze the IMAGO dataset including photos belonging to family albums assembled at the University of Bologna's Rimini campus since 2004. Following a deep learning-based approach, the IMAGO dataset has offered the opportunity of experimenting with photos taken between year 1845 and year 2009, with the goals of assessing the dates and the socio-historical contexts of the images, without use of any other sources of information. Exceeding our initial expectations, such analysis has revealed its merit not only in terms of the performance of the approach adopted in this work, but also in terms of the foreseeable implications and use for the benefit of socio-historical research. To the best of our knowledge, this is the first work that moves along this path in literature.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. W. Yin, T. Mei, C. W. Chen, and S. Li, “Socialized mobile photography: Learning to photograph with social context via mobile devices,” IEEE Transactions on Multimedia, vol. 16, no. 1, pp. 184–200, 2013.
  2. J. Chen and H. Wang, “Guest editorial: Big data infrastructure i,” IEEE Transactions on Big Data, vol. 4, no. 2, pp. 148–149, 2018.
  3. E. Borcoci, D. Negru, and C. Timmerer, “A novel architecture for multimedia distribution based on content-aware networking,” in 2010 Third International Conference on Communication Theory, Reliability, and Quality of Service.   IEEE, 2010, pp. 162–168.
  4. B. Rainer, S. Petscharnig, C. Timmerer, and H. Hellwagner, “Statistically indifferent quality variation: An approach for reducing multimedia distribution cost for adaptive video streaming services,” IEEE Transactions on Multimedia, vol. 19, no. 4, pp. 849–860, 2016.
  5. J. Lemley, S. Bazrafkan, and P. Corcoran, “Deep learning for consumer devices and services: Pushing the limits for machine learning, artificial intelligence, and computer vision.” IEEE Consumer Electronics Magazine, vol. 6, no. 2, pp. 48–56, 2017.
  6. Y. Li, T. Yao, Y. Pan, H. Chao, and T. Mei, “Deep metric learning with density adaptivity,” IEEE Transactions on Multimedia, vol. 22, no. 5, pp. 1285–1297, 2019.
  7. X. Chen, D. Liu, Z. Xiong, and Z.-J. Zha, “Learning and fusing multiple user interest representations for micro-video and movie recommendations,” IEEE Transactions on Multimedia, 2020.
  8. F. Vaccaro, M. Bertini, T. Uricchio, and A. Del Bimbo, “Image retrieval using multi-scale cnn features pooling,” in Proceedings of the 2020 International Conference on Multimedia Retrieval, 2020, pp. 311–315.
  9. M. Roccetti, L. Casini, G. Delnevo, V. Orrù, and N. Marchetti, “Potential and limitations of designing a deep learning model for discovering new archaeological sites: A case with the mesopotamian floodplain,” in Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, 2020, pp. 216–221.
  10. MoMA, “Vernacular photography,” 2020.
  11. M. Sandbye, “Looking at the family photo album: a resumed theoretical discussion of why and how,” Journal of Aesthetics & Culture, vol. 6, no. 1, p. 25419, 2014.
  12. D. Calanca, “Italians posing between public and private. theories and practices of social heritage,” Almatourism-Journal of Tourism, Culture and Territorial Development, vol. 2, no. 3, pp. 1–9, 2011.
  13. B. Fernando, D. Muselet, R. Khan, and T. Tuytelaars, “Color features for dating historical color images,” in 2014 IEEE International Conference on Image Processing (ICIP).   IEEE, 2014, pp. 2589–2593.
  14. S. Ginosar, K. Rakelly, S. Sachs, B. Yin, and A. A. Efros, “A century of portraits: A visual historical record of american high school yearbooks,” in Proceedings of the IEEE International Conference on Computer Vision Workshops, 2015, pp. 1–7.
  15. T. Salem, S. Workman, M. Zhai, and N. Jacobs, “Analyzing human appearance as a cue for dating images,” in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).   IEEE, 2016, pp. 1–8.
  16. E. Müller, M. Springstein, and R. Ewerth, ““When was this picture taken?”–image date estimation in the wild,” in European Conference on Information Retrieval.   Springer, 2017, pp. 619–625.
  17. P. Sorcinelli, “imago: Laboratorio di ricerca storica e di documentazione iconografica sulla condizione giovanile nel xx secolo,” 2005.
  18. Thanh Nguyen, “Yolo face implementation,” https://github.com/sthanhng/yoloface, 2018, online; accessed 3 August 2020.
  19. Joseph Redmon, “YOLO: Real Time Object Detection,” https://github.com/pjreddie/darknet/wiki/YOLO:-Real-Time-Object-Detection, 2019, online; accessed 3 August 2020.
  20. Zhang, Kai, Zuo, Wangmeng, and L. Zhang, “Ffdnet: Toward a fast and flexible solution for cnn-based image denoising,” IEEE Transactions on Image Processing, 2018.
  21. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand, “A gentle introduction to bilateral filtering and its applications,” in ACM SIGGRAPH 2007 Courses, ser. SIGGRAPH ’07.   New York, NY, USA: Association for Computing Machinery, 2007, p. 1–es. [Online]. Available: https://doi.org/10.1145/1281500.1281602
  22. X. Wang, K. Yu, S. Wu, J. Gu, Y. Liu, C. Dong, C. C. Loy, Y. Qiao, and X. Tang, “Esrgan: Enhanced super-resolution generative adversarial networks,” 2018.
  23. K. Zhang, “Image restoration toolbox,” https://github.com/cszn/KAIR, 2019.
  24. J. Deng, W. Dong, R. Socher, L. Li, Kai Li, and Li Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 248–255.
  25. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” 2015.
  26. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” 2015.
  27. G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” 2018.
  28. C. Coleman, D. Kang, D. Narayanan, L. Nardi, T. Zhao, J. Zhang, P. Bailis, K. Olukotun, C. Re, and M. Zaharia, “Analysis of dawnbench, a time-to-accuracy machine learning performance benchmark,” 2019.
  29. R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-cam: Visual explanations from deep networks via gradient-based localization,” International Journal of Computer Vision, vol. 128, no. 2, p. 336–359, Oct 2019. [Online]. Available: http://dx.doi.org/10.1007/s11263-019-01228-7
  30. N. Mehrabi, F. Morstatter, N. Saxena, K. Lerman, and A. Galstyan, “A survey on bias and fairness in machine learning,” 2019.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Dice Question Streamline Icon: https://streamlinehq.com

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
Lightbulb Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now
List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up