Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
175 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
47 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Image Collage on Arbitrary Shape via Shape-Aware Slicing and Optimization (2401.02435v1)

Published 17 Nov 2023 in cs.CV and cs.GR

Abstract: Image collage is a very useful tool for visualizing an image collection. Most of the existing methods and commercial applications for generating image collages are designed on simple shapes, such as rectangular and circular layouts. This greatly limits the use of image collages in some artistic and creative settings. Although there are some methods that can generate irregularly-shaped image collages, they often suffer from severe image overlapping and excessive blank space. This prevents such methods from being effective information communication tools. In this paper, we present a shape slicing algorithm and an optimization scheme that can create image collages of arbitrary shapes in an informative and visually pleasing manner given an input shape and an image collection. To overcome the challenge of irregular shapes, we propose a novel algorithm, called Shape-Aware Slicing, which partitions the input shape into cells based on medial axis and binary slicing tree. Shape-Aware Slicing, which is designed specifically for irregular shapes, takes human perception and shape structure into account to generate visually pleasing partitions. Then, the layout is optimized by analyzing input images with the goal of maximizing the total salient regions of the images. To evaluate our method, we conduct extensive experiments and compare our results against previous work. The evaluations show that our proposed algorithm can efficiently arrange image collections on irregular shapes and create visually superior results than prior work and existing commercial tools.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (36)
  1. Adobe. Photo collage. Available: https://www.adobe.com/express/create/photo-collage, 2021.
  2. C. B. Atkins. Blocked recursive image composition. In Proceedings of the 16th ACM international conference on Multimedia, pages 821–824, 2008.
  3. Shape matching and object recognition using shape contexts. IEEE transactions on pattern analysis and machine intelligence, 24(4):509–522, 2002.
  4. V. Cheung. Shape collage. Available: http://www.shapecollage.com/, 2013.
  5. Mathematical theory of medial axis transform. pacific journal of mathematics, 181(1):57–88, 1997.
  6. J. De Winter and J. Wagemans. Segmentation of object outlines into parts: A large-scale integrative study. Cognition, 99(3):275–325, 2006.
  7. Centroidal voronoi tessellations: Applications and algorithms. SIAM review, 41(4):637–676, 1999.
  8. Tree-based visualization and optimization for image collection. IEEE Transactions on Cybernetics, 46(6):1286–1300, 2015.
  9. Deep learning with topological signatures. Advances in neural information processing systems, 30, 2017.
  10. Parts of recognition. Cognition, 18(1-3):65–96, 1984.
  11. D. D. Hoffman and M. Singh. Salience of visual parts. Cognition, 63(1):29–78, 1997.
  12. L. J. Latecki and R. Lakämper. Convexity rule for shape decomposition based on discrete contour evolution. Computer Vision and Image Understanding, 73(3):441–454, 1999.
  13. Shape descriptors for non-rigid shapes with a single closed contour. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662), volume 1, pages 424–429. IEEE, 2000.
  14. A generic framework and library for exploration of small multiples through interactive piling. IEEE Transactions on Visualization and Computer Graphics, 27(2):358–368, 2020.
  15. Approximate convex decomposition of polygons. Computational Geometry, 35(1-2):100–123, 2006.
  16. Correlation-preserving photo collage. IEEE transactions on visualization and computer graphics, 24(6):1956–1968, 2017a.
  17. Trcollage: efficient image collage using tree-based layer reordering. In 2017 International Conference on Virtual Reality and Visualization (ICVRV), pages 454–455. IEEE, 2017b.
  18. A computational model of the short-cut rule for 2d shape decomposition. IEEE Transactions on Image Processing, 24(1):273–283, 2014.
  19. G. P. Nguyen and M. Worring. Interactive access to large image collections using similarity-based visualization. Journal of Visual Languages & Computing, 19(2):203–224, 2008.
  20. R. L. Ogniewicz and M. Ilg. Voronoi skeletons: theory and applications. In CVPR, volume 92, pages 63–69, 1992.
  21. Content-based visual summarization for image collections. IEEE Transactions on Visualization and Computer Graphics, 27(4):2298–2312, 2019.
  22. Multi-scale interactive network for salient object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9413–9422, 2020.
  23. Revisiting the medial axis for planar shape decomposition. Computer Vision and Image Understanding, 179:66–78, 2019.
  24. Reasyze. Shapex. Available: https://www.reasyze.com/shapex/.
  25. Autocollage. ACM transactions on graphics (TOG), 25(3):847–852, 2006.
  26. SilkenMermaid. Figrcollage. Available: https://www.figrcollage.com/.
  27. M. Singh and D. D. Hoffman. Part-based representations of visual shape and implications for visual cognition. In Advances in psychology, volume 130, pages 401–459. Elsevier, 2001.
  28. Parsing silhouettes: The short-cut rule. Perception & Psychophysics, 61(4):636–660, 1999.
  29. Balance-aware grid collage for small image collections. IEEE Transactions on Visualization and Computer Graphics, 2021.
  30. H. Talebi and P. Milanfar. Nima: Neural image assessment. IEEE transactions on image processing, 27(8):3998–4011, 2018.
  31. Imagehive: Interactive content-aware image summarization. IEEE Computer Graphics and Applications, 32(1):46–55, 2011.
  32. D. Wong and C. Liu. A new algorithm for floorplan design. In 23rd ACM/IEEE Design Automation Conference, pages 101–107, 1986. doi: 10.1109/DAC.1986.1586075.
  33. Z. Wu and K. Aizawa. Picwall: Photo collage on-the-fly. In 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, pages 1–10. IEEE, 2013.
  34. Invariant multi-scale descriptor for shape representation, matching and retrieval. Computer Vision and Image Understanding, 145:43–58, 2016.
  35. Softcollage: A differentiable probabilistic tree generator for image collage. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3729–3738, 2022.
  36. 2d shape decomposition based on combined skeleton-boundary features. In International Symposium on Visual Computing, pages 682–691. Springer, 2008.
Citations (1)

Summary

We haven't generated a summary for this paper yet.