Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Deep Ensemble Art Style Recognition (2405.11675v1)

Published 19 May 2024 in cs.CV and cs.AI

Abstract: The massive digitization of artworks during the last decades created the need for categorization, analysis, and management of huge amounts of data related to abstract concepts, highlighting a challenging problem in the field of computer science. The rapid progress of artificial intelligence and neural networks has provided tools and technologies that seem worthy of the challenge. Recognition of various art features in artworks has gained attention in the deep learning society. In this paper, we are concerned with the problem of art style recognition using deep networks. We compare the performance of 8 different deep architectures (VGG16, VGG19, ResNet50, ResNet152, Inception-V3, DenseNet121, DenseNet201 and Inception-ResNet-V2), on two different art datasets, including 3 architectures that have never been used on this task before, leading to state-of-the-art performance. We study the effect of data preprocessing prior to applying a deep learning model. We introduce a stacking ensemble method combining the results of first-stage classifiers through a meta-classifier, with the innovation of a versatile approach based on multiple models that extract and recognize different characteristics of the input, creating a more consistent model compared to existing works and achieving state-of-the-art accuracy on the largest art dataset available (WikiArt - 68,55%). We also discuss the impact of the data and art styles themselves on the performance of our models forming a manifold perspective on the problem.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (37)
  1. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, and et al., “Imagenet large scale visual recognition challenge,” Int. J. Comput. Vision, vol. 115, p. 211–252, Dec. 2015.
  2. E. C. Fernie, Art History and its Methods: A critical anthology. 1995.
  3. K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into rectifiers: Surpassing human-level performance on imagenet classification,” 2015.
  4. C. S. Rodriguez, M. Lech, and E. Pirogova, “Classification of style in fine-art paintings using transfer learning and weighted image patches,” in 2018 12th International Conference on Signal Processing and Communication Systems (ICSPCS), pp. 1–7, Dec 2018.
  5. C. Sandoval, E. Pirogova, and M. Lech, “Two-stage deep learning approach to the classification of fine-art paintings,” IEEE Access, vol. 7, pp. 41770–41781, 2019.
  6. A. van den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, and K. Kavukcuoglu, “Wavenet: A generative model for raw audio,” 2016.
  7. A. Huang and R. Wu, “Deep learning for music,” 2016.
  8. G. Polatkan, S. Jafarpour, A. Brasoveanu, S. Hughes, and I. Daubechies, “Detection of forgery in paintings using supervised learning,” in 2009 16th IEEE International Conference on Image Processing (ICIP), pp. 2921–2924, Nov 2009.
  9. L. A. Gatys, A. S. Ecker, and M. Bethge, “A neural algorithm of artistic style,” 2015.
  10. J. Johnson, A. Alahi, and L. Fei-Fei, “Perceptual losses for real-time style transfer and super-resolution,” 2016.
  11. Jia Li and J. Z. Wang, “Studying digital imagery of ancient paintings by mixtures of stochastic models,” IEEE Transactions on Image Processing, vol. 13, pp. 340–353, March 2004.
  12. B. Gunsel, S. Sariel, and O. Icoglu, “Content-based access to art paintings,” vol. 2, pp. II – 558, 10 2005.
  13. S. Jiang, Q. Ye, and W. Gao, “An effective method to detect and categorize digitized traditional chinese paintings,” Pattern Recognition Letters, vol. 27, pp. 734–746, 05 2006.
  14. B. Siddiquie, S. N. Vitaladevuni, and L. S. Davis, “Combining multiple kernels for efficient image classification,” in 2009 Workshop on Applications of Computer Vision (WACV), pp. 1–8, Dec 2009.
  15. L. Shamir, T. Macura, N. Orlov, D. M. Eckley, and I. G. Goldberg, “Impressionism, expressionism, surrealism: Automated recognition of painters and schools of art,” ACM Trans. Appl. Percept., vol. 7, pp. 8:1–8:17, Feb. 2010.
  16. F. S. Khan, S. Beigpour, J. van de Weijer, and M. Felsberg, “Painting-91: a large scale database for computational painting categorization,” Machine Vision and Applications, vol. 25, pp. 1385–1397, Aug 2014.
  17. R. S. Arora and A. M. Elgammal, “Towards automated classification of fine-art painting style: A comparative study,” Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3541–3544, 2012.
  18. S. Karayev, M. Trentacoste, H. Han, A. Agarwala, T. Darrell, A. Hertzmann, and H. Winnemoeller, “Recognizing image style,” 2013.
  19. Y. Bar, N. Levy, and L. Wolf, “Classification of artistic styles using binarized features derived from a deep neural network,” in ECCV Workshops, 2014.
  20. K. Peng and T. Chen, “Cross-layer features in convolutional neural networks for generic classification tasks,” in 2015 IEEE International Conference on Image Processing (ICIP), pp. 3057–3061, Sep. 2015.
  21. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell, “Decaf: A deep convolutional activation feature for generic visual recognition,” 2013.
  22. C. Florea, C. Toca, and F. Gieseke, “Artistic movement recognition by boosted fusion of color structure and topographic description,” in 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 569–577, March 2017.
  23. A. Krizhevsky, I. Sutskever, and G. Hinton, “Imagenet classification with deep convolutional neural networks,” Neural Information Processing Systems, vol. 25, 01 2012.
  24. A. Lecoutre, B. Négrevergne, and F. Yger, “Recognizing art style automatically in painting with deep learning,” in ACML, 2017.
  25. W. R. Tan, C. S. Chan, H. Aguirre, and K. Tanaka, “Improved artgan for conditional synthesis of natural image and artwork,” IEEE Transactions on Image Processing, vol. PP, pp. 1–1, 08 2018.
  26. F. Chollet et al., “Keras.” https://github.com/fchollet/keras, 2015.
  27. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M. Wattenberg, M. Wicke, Y. Yu, and X. Zheng, “TensorFlow: Large-scale machine learning on heterogeneous systems,” 2015. Software available from tensorflow.org.
  28. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 2014.
  29. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” 2015.
  30. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” 2015.
  31. C. Szegedy, S. Ioffe, V. Vanhoucke, and A. Alemi, “Inception-v4, inception-resnet and the impact of residual connections on learning,” 2016.
  32. G. Huang, Z. Liu, L. van der Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” 2016.
  33. C. Florea and F. Gieseke, “Artistic movement recognition by consensus of boosted svm based experts,” Journal of Visual Communication and Image Representation, vol. 56, pp. 220 – 233, 2018.
  34. B. Saleh and A. Elgammal, “Large-scale classification of fine-art paintings: Learning the right metric on the right feature,” 2015.
  35. W. R. Tan, C. S. Chan, H. E. Aguirre, and K. Tanaka, “Ceci n’est pas une pipe: A deep convolutional network for fine-art paintings classification,” in 2016 IEEE International Conference on Image Processing (ICIP), pp. 3703–3707, Sep. 2016.
  36. E. Cetinic, T. Lipic, and S. Grgic, “Fine-tuning convolutional neural networks for fine art classification,” Expert Systems with Applications, vol. 114, pp. 107 – 118, 2018.
  37. S.-h. Zhong, X. Huang, and Z. Xiao, “Fine-art painting classification via two-channel dual path networks,” International Journal of Machine Learning and Cybernetics, May 2019.
Citations (8)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now