Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Context Matters: A Theory of Semantic Discriminability for Perceptual Encoding Systems (2108.03685v4)

Published 8 Aug 2021 in cs.HC

Abstract: People's associations between colors and concepts influence their ability to interpret the meanings of colors in information visualizations. Previous work has suggested such effects are limited to concepts that have strong, specific associations with colors. However, although a concept may not be strongly associated with any colors, its mapping can be disambiguated in the context of other concepts in an encoding system. We articulate this view in semantic discriminability theory, a general framework for understanding conditions determining when people can infer meaning from perceptual features. Semantic discriminability is the degree to which observers can infer a unique mapping between visual features and concepts. Semantic discriminability theory posits that the capacity for semantic discriminability for a set of concepts is constrained by the difference between the feature-concept association distributions across the concepts in the set. We define formal properties of this theory and test its implications in two experiments. The results show that the capacity to produce semantically discriminable colors for sets of concepts was indeed constrained by the statistical distance between color-concept association distributions (Experiment 1). Moreover, people could interpret meanings of colors in bar graphs insofar as the colors were semantically discriminable, even for concepts previously considered "non-colorable" (Experiment 2). The results suggest that colors are more robust for visual communication than previously thought.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Affective congruence in visualization design: Influences on reading categorical maps. IEEE Transactions on Visualization and Computer Graphics, 2021.
  2. Affective color in visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 1364–1374. ACM, 2017.
  3. B. Berlin and P. Kay. Basic Color Terms: Their Universality and Evolution. University of California Press, 1969.
  4. J. Bertin. Semiology of graphics: Diagrams, Networks, Maps. University of Wisconsin Press, Madison, 1983.
  5. R. J. Brockmann. The unbearable distraction of color. IEEE Transactions on Professional Communication, 34(3):153–159, 1991.
  6. Assignment Problems: revised reprint. SIAM, 2012.
  7. Bare skin, blood and the evolution of primate colour vision. Biology Letters, 2(2):217–221, 2006.
  8. B. R. Conway. Color vision, cones, and color-coding in the cortex. The Neuroscientist, 15(3):274–290, 2009.
  9. J. R. De Leeuw. jspsych: A javascript library for creating behavioral experiments in a web browser. Behavior Research Methods, 47(1):1–12, 2015.
  10. Color and psychological functioning: the effect of red on performance attainment. Journal of Experimental Psychology: General, 136(1):154, 2007.
  11. Categorical colormap optimization with visualization case studies. IEEE Transactions on Visualization and Computer Graphics, 23(1):871–880, 2017.
  12. Paradoxical impact of memory on color appearance of faces. Nature Communications, 10:1–10, 2019.
  13. Automated color selection using semantic knowledge. In 2010 AAAI Fall Symposium Series, 2010.
  14. N. Humphrey. The colour currency of nature. In T. Porter and B. Mikellides, editors, Colour for Architecture Today, pages 95–98. Taylor & Francis, 1976.
  15. Colors–messengers of concepts: Visual design mining for learning color semantics. ACM Transactions on Computer-Human Interaction, 24(1):2, 2017.
  16. The sun is no fun without rain: Physical environments affect how we feel about yellow across 55 countries. Journal of Environmental Psychology, 66:101350, 2019.
  17. A machine learning approach to quantify the specificity of colour–emotion associations and their cultural differences. Royal Society Open Science, 6(9):190741, 2019.
  18. The Linguistics of Color Terms. Citeseer, 2001.
  19. H. W. Kuhn. The hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1-2):83–97, 1955.
  20. Selecting semantically-resonant colors for data visualization. In Computer Graphics Forum, volume 32, pages 401–410. Eurographics Conference on Visualization, 2013.
  21. What is the color of chocolate?–extracting color values of semantic expressions. In Conference on Colour in Graphics, Imaging, and Vision, volume 2012, pages 355–361. Society for Imaging Science and Technology, 2012.
  22. A large-scale multi-lingual color thesaurus. In Color and Imaging Conference, volume 2012, pages 30–35. Society for Imaging Science and Technology, 2012.
  23. J. Munkres. Algorithms for the assignment and transportation problems. Journal of the Society for Industrial and Applied Mathematics, 5(1):32–38, 1957.
  24. F. Nielsen and R. Bhatia. Matrix Information Geometry. Springer Berlin Heidelberg, 2012.
  25. A study of colour emotion and colour preference. Part I: Colour emotions for single colours. Color Research & Application, 29(3):232–240, 2004.
  26. Visual aesthetics and human preference. Annual Review of Psychology, 64:77–107, 2013.
  27. Estimating color-concept associations from image statistics. IEEE Transactions on Visualization and Computer Graphics, 26(1):1226–1235, 2020.
  28. A. H. Robinson. The Look of Maps. University of Wisconsin Press, Madison, 1952.
  29. K. B. Schloss. A color inference framework. In . G. V. P. L. MacDonald, C. P. Biggam, editor, Progress in Colour Studies: Cognition, Language, and Beyond. John Benjamins, Amsterdam, 2018.
  30. Mapping color to meaning in colormap data visualizations. IEEE Transactions on Visualization and Computer Graphics, 25(1):810–819, 2019.
  31. Semantic discriminability for visual communication. IEEE Transactions on Visualization and Computer Graphics, 27(2):1022–1031, 2021.
  32. Color inference in visual communication: the meaning of colors in recycling. Cognitive Research: Principles and Implications, 3(1):5, 2018.
  33. V. Setlur and M. C. Stone. A linguistic approach to categorical color assignment for data visualization. IEEE Transactions on Visualization and Computer Graphics, 22(1):698–707, 2016.
  34. P. Shah and J. Hoeffner. Review of graph comprehension research: Implications for instruction. Educational Psychology Review, 14(1):47–69, 2002.
  35. The relation between color and spatial structure for interpreting colormap data visualizations. Journal of Vision, 20(12):7–7, 2020.
  36. An engineering model for color difference as a function of size. In Color and Imaging Conference, volume 2014, pages 253–258. Society for Imaging Science and Technology, 2014.
  37. Color diagnosticity in object recognition. Perception & Psychophysics, 61(6):1140–1153, 1999.
  38. A systematic investigation of conceptual color associations. Journal of Experimental Psychology: General, 149(7):1311–1332, 2020.
  39. Emotion-color associations in the context of the face. Emotion, 18(7):1032–1042, 2018.
  40. Object knowledge modulates colour appearance. i-Perception, 2(1):13–49, 2011.
  41. G. Wyszecki and W. S. Stiles. Color Science. Wiley New York, 1982.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (5)
  1. Kushin Mukherjee (9 papers)
  2. Brian Yin (3 papers)
  3. Brianne E. Sherman (1 paper)
  4. Laurent Lessard (59 papers)
  5. Karen B. Schloss (7 papers)
Citations (16)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now