Towards Metrics for Evaluating Creativity in Visualisation Design
Abstract: Creativity in visualisation design is essential for designers and data scientists who need to present data in innovative ways. It is often achieved through sketching or drafting low-fidelity prototypes. However, judging this innovation is often difficult. A creative visualisation test would offer a structured approach to enhancing visual thinking and design skills, which are vital across many fields. Such a test can facilitate objective evaluation, skill identification, benchmarking, fostering innovation, and improving learning outcomes. In developing such a test, we propose focusing on four criteria: Quantity, Correctness, Novelty, and Feasibility. These criteria integrate into a test that is easy to administer. We name it the Rowen Test of Creativity in Visualisation Design; We introduce the test, scoring system and results from using eight visualisation experts.
- An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction, 24(6):574–594, 2008. doi: 10 . 1080/10447310802205776
- Branch. Instructional Design: The ADDIE Approach. Springer New York, NY, 2009. doi: 10 . 1007/978-0-387-09506-6
- E. De Bono. Six Thinking Hats. Penguin UK, 2009.
- Guilford. The structure of intellect. Psy. bull., 53(4):267, 1956.
- Johnson. Where good ideas come from: The seven patterns of innovation. Penguin, 2011.
- VLAT: Development of a Visualization Literacy Assessment Test. TVCG, 23(1):551–560, 2017.
- M. Meyer and J. Dykes. Criteria for rigor in visualization design study. TVCG, 2020.
- Inspire and create: Unveiling the potential of visdice in visualization design. In N. Cao, B. Kozlikova, J. Xia, and W. Willett, eds., VIS 2023 Posters. IEEE Computer Society Press, 2023.
- M. Ozyaprak. The Effectiveness of SCAMPER Technique on Creative Thinking Skills. Education of Gifted, 4(1):31 – 40, 2015.
- Sketching designs using the five design-sheet methodology. TVCG, 22(1):419–428, 2016. doi: 10 . 1109/TVCG . 2015 . 2467271
- Shneiderman. Creating creativity: User interfaces for supporting innovation. HCI, 7(1):114–138, Mar. 2000. doi: 10 . 1145/344949 . 345077
- Thrash and Elliot. Inspiration as a psychological construct. Journal of personality and social psychology, 84(4):871, 2003. doi: 10 . 1037/0022-3514 . 84 . 4 . 871
- AVONET: morphological, ecological and geographical data for all birds. Ecology Letters, 25:581–597, 2022. doi: 10 . 1111/ele . 13898
- E. P. Torrance. Torrance tests of creative thinking. Educational and psychological measurement, 1966.
- G. Wallas. The art of thought. J. Cape, London, 1926.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.