Exploring Interactive Color Palettes for Abstraction-Driven Exploratory Image Colorization (2403.02202v1)
Abstract: Color design is essential in areas such as product, graphic, and fashion design. However, current tools like Photoshop, with their concrete-driven color manipulation approach, often stumble during early ideation, favoring polished end results over initial exploration. We introduced Mondrian as a test-bed for abstraction-driven approach using interactive color palettes for image colorization. Through a formative study with six design experts, we selected three design options for visual abstractions in color design and developed Mondrian where humans work with abstractions and AI manages the concrete aspects. We carried out a user study to understand the benefits and challenges of each abstraction format and compare the Mondrian with Photoshop. A survey involving 100 participants further examined the influence of each abstraction format on color composition perceptions. Findings suggest that interactive visual abstractions encourage a non-linear exploration workflow and an open mindset during ideation, thus providing better creative affordance.
- SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. on pattern analysis and machine intelligence 34, 11 (2012), 2274–2282.
- Histogan: Controlling colors of gan-generated and real images via color histograms. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. IEEE, New York, USA, 7941–7950.
- Rudolf Arnheim. 2004. Visual thinking.
- Malcolm Barnard. 2013. Graphic design as communication. Routledge, Abingdon, Oxfordshire.
- Affective color in visualization. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, New York, USA, 1364–1374.
- Art expertise in construing meaning of representational and abstract artworks. Acta psychologica 192 (2019), 11–22.
- Kenneth E Burchett. 1991. Color harmony attributes. Color Research & Application 16, 4 (1991), 275–278.
- Erin Cherry and Celine Latulipe. 2014. Quantifying the creativity support of digital tools through the creativity support index. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 4 (2014), 1–25.
- Histomages: fully synchronized views for image editing. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, New York, USA, 281–286.
- Roger H Clark and Michael Pause. 2012. Precedents in architecture: analytic diagrams, formative ideas, and partis. John Wiley & Sons, Hoboken, NJ, USA.
- Tomás Dorta. 2008. Design flow and ideation. International Journal of Architectural Computing 6, 3 (2008), 299–316.
- Claudia Eckert and Martin Stacey. 2000. Sources of inspiration: a language of design. Design studies 21, 5 (2000), 523–538.
- Leatrice Eiseman. 2000. Pantone’s guide to communicating with color. Adams Media, Avon, MA, USA.
- Evelyn Fix and Joseph Lawson Hodges. 1989. Discriminatory analysis. Nonparametric discrimination: Consistency properties. International Statistical Review/Revue Internationale de Statistique 57, 3 (1989), 238–247.
- Jorge Frascara. 2004. Communication design: principles, methods, and practice. Allworth Communications, Inc., New York, USA.
- Determining key colors from a design perspective using dE-means color clustering. Color Research & Application 48 (2022), 69–87.
- Gabriela Goldschmidt. 2011. Avoiding design fixation: transformation and abstraction in mapping from source to target. The Journal of creative behavior 45, 2 (2011), 92–100.
- Kurt Goldstein. 1942. Some experimental observations concerning the influence of colors on the function of the organism. American Journal of Physical Medicine & Rehabilitation 21, 3 (1942), 147–151.
- Linda Holtzschue. 2012. Understanding color: an introduction for designers. John Wiley & Sons, Hoboken, NJ, USA.
- Laura Hummell. 2006. Synectics for creative thinking in technology education. Technology and Engineering Teacher 66, 3 (2006), 22.
- Johannes Itten. 1970. The elements of color. Vol. 4. John Wiley & Sons, Hoboken, NJ, USA.
- Color portraits: From color picking to interacting with color. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, USA, 4207–4216.
- EunJin Kim and Hyeon-Jeong Suk. 2017. Thoughts and tools for crafting colors: Implications from designers’ behavior. In Proceedings of the 2017 Conference on Designing Interactive Systems. ACM, New York, USA, 321–331.
- Timothy D King. 2005. Human color perception, cognition, and culture: why red is always red. In Color imaging X: processing, hardcopy, and applications, Vol. 5667. SPIE, Bellingham, Washington, USA, 234–242.
- Discovering harmony: A hierarchical colour harmony model for aesthetics assessment. In Computer Vision–ACCV 2014: 12th Asian Conference on Computer Vision, Singapore, Singapore, November 1-5, 2014, Revised Selected Papers, Part III 12. Springer, Berlin, Heidelberg, 452–467.
- Interactive color palette tools. IEEE Computer Graphics and Applications 24, 3 (2004), 64–72.
- Parry Moon and Domina Eberle Spencer. 1944. Geometric formulation of classical color harmony. JOSA 34, 1 (1944), 46–59.
- Building fast to think faster: exploiting rapid prototyping to accelerate ideation during early stage design. In international design engineering technical conferences and computers and information in engineering conference, Vol. 55928. American Society of Mechanical Engineers, New York, NY, USA, V005T06A022.
- Jakob Nielsen. 1994. Enhancing the explanatory power of usability heuristics. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 152–158.
- Aesthetic quality classification of photographs based on color harmony. In CVPR 2011. IEEE, New York, NY, USA, 33–40.
- Color compatibility from large datasets. In ACM SIGGRAPH 2011 papers. ACM, New York, NY, USA, 1–12.
- Dan R Olsen Jr. 2007. Evaluating user interface systems research. In Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, New York, NY, USA, 251–258.
- Stephen E Palmer. 1999. Vision science: Photons to phenomenology.
- Massimiliano Palmiero. 2020. The relationships between abstraction and creativity. In Creativity and the Wandering Mind. Elsevier, Amsterdam, The Netherlands, 73–90.
- Juxtaform: interactive visual summarization for exploratory shape design. ACM Transactions on Graphics (TOG) 42, 4 (2023), 1–14.
- Charles Parkhurst and Robert L Feller. 1982. Who invented the color wheel? Color Research & Application 7, 3 (1982), 217–230.
- Co-3Deator: A team-first collaborative 3D design ideation tool. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, New York, NY, USA, 6581–6592.
- The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and psychopathology 17, 3 (2005), 715–734.
- Prolific. 2023. Prolific. https://www.prolific.co/
- Robert Root-Bernstein and Michele Root-Bernstein. 2004. Artistic Scientists and Scientific Artists: The Link Between Polymathy and Creativity.
- De-Stijl: Facilitating Graphics Design with Interactive 2D Color Palette Recommendation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 19 pages. https://doi.org/10.1145/3544548.358107
- Nonlinear color triads for approximation, learning and direct manipulation of color distributions. ACM Transactions on Graphics (TOG) 39, 4 (2020), 97–1.
- Playful palette: an interactive parametric color mixer for artists. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–10.
- Color builder: A direct manipulation interface for versatile color theme authoring. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–12.
- Color crafting: Automating the construction of designer quality color ramps. IEEE transactions on visualization and computer graphics 26, 1 (2019), 1215–1225.
- Johann Wolfgang Von Goethe. 1970. Theory of colours.
- The role of specificity and abstraction in creative idea generation. Creativity Research Journal 16, 1 (2004), 1–9.
- Colin Ware. 2010. Visual thinking for design. Elsevier, Amsterdam, The Netherlands.
- Hans Welling. 2007. Four mental operations in creative cognition: The importance of abstraction. Creativity research journal 19, 2-3 (2007), 163–177.
- TW Whitfield and TJ Whiltshire. 1990. Color psychology: a critical review. Genetic, social, and general psychology monographs 116, 4 (1990), 385–411.
- Günther Wyszecki and Walter Stanley Stiles. 2000. Color science: concepts and methods, quantitative data and formulae. Vol. 40. John Wiley & Sons, Hoboken, NJ, USA.
- Real-Time User-Guided Image Colorization with Learned Deep Priors. ACM Trans. on Graphics 36, 4, Article 119 (2017), 11 pages. https://doi.org/10.1145/3072959.3073703
- Xinyu Shi (16 papers)
- Mingyu Liu (30 papers)
- Ziqi Zhou (46 papers)
- Ali Neshati (3 papers)
- Ryan Rossi (67 papers)
- Jian Zhao (218 papers)