Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

VisQuiz: Exploring Feedback Mechanisms to Improve Graphical Perception (2207.09534v3)

Published 19 Jul 2022 in cs.HC

Abstract: Graphical perception studies are a key element of visualization research, forming the basis of design recommendations and contributing to our understanding of how people make sense of visualizations. However, graphical perception studies typically include only brief training sessions, and the impact of longer and more in-depth feedback remains unclear. In this paper, we explore the design and evaluation of feedback for graphical perception tasks, called VisQuiz. Using a quiz-like metaphor, we design feedback for a typical visualization comparison experiment, showing participants their answer alongside the correct answer in an animated sequence in each trial. We extend this quiz metaphor to include summary feedback after each stage of the experiment, providing additional moments for participants to reflect on their performance. To evaluate VisQuiz, we conduct a between-subjects experiment, including three stages of 40 trials each with a control condition that included only summary feedback. Results from n = 80 participants show that once participants started receiving trial feedback (Stage 2) they performed significantly better with bubble charts than those in the control condition. This effect carried over when feedback was removed (Stage 3). Results also suggest an overall trend of improved performance due to feedback. We discuss these findings in the context of other visualization literacy efforts, and possible future work at the intersection of visualization, feedback, and learning. Experiment data and analysis scripts are available at the following repository https://osf.io/jys5d/

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize File Document Download Save Streamline Icon: https://streamlinehq.com PDF File Document Download Save Streamline Icon: https://streamlinehq.com Markdown Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (27)
  1. Guess the Correlation. http://guessthecorrelation.com/. Online; accessed: 2022-04-20.
  2. Visualization literacy at elementary school. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, p. 5485–5497. Association for Computing Machinery, New York, NY, USA, 2017.
  3. Useful junk? the effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 2573–2582, 2010.
  4. A principled way of assessing visualization literacy. IEEE transactions on visualization and computer graphics, 20(12):1963–1972, 2014.
  5. W. S. Cleveland and R. McGill. Graphical perception: Theory, experimentation, and application to the development of graphical methods. Journal of the American statistical association, 79(387):531–554, 1984.
  6. Treemap literacy: A classroom-based investigation. In Eurographics Proceedings, 2020.
  7. Uncertainty displays using quantile dotplots or CDFs improve transit decision-making. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2018.
  8. Interactive visualization literacy: The state-of-the-art. Information Visualization, p. 14738716221081831, 2021.
  9. The science of visual data communication: What works. Psychological Science in the Public Interest, 22(3):110–161, 2021.
  10. J. Heer and M. Bostock. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’10, p. 203–212. Association for Computing Machinery, New York, NY, USA, 2010. doi: 10 . 1145/1753326 . 1753357
  11. The impact of social information on visual judgments. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 1461–1470, 2011.
  12. M. Kay and J. Heer. Beyond weber’s law: A second look at ranking visualizations of correlation. IEEE Transactions on Visualization and Computer Graphics, 22(1):469–478, 2016.
  13. Toward a model of learning data representations. In Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society, Mahwah, NJ: Erlbaum, pp. 45–50, 2001.
  14. Perceptual guidelines for creating rectangular treemaps. IEEE transactions on visualization and computer graphics, 16(6):990–998, 2010.
  15. R. Kosara. Evidence for area as the primary visual cue in pie charts. In 2019 IEEE Visualization Conference (VIS), pp. 101–105. IEEE, 2019.
  16. Vlat: Development of a visualization literacy assessment test. IEEE transactions on visualization and computer graphics, 23(1):551–560, 2016.
  17. Rethinking the ranks of visual channels. IEEE Transactions on Visualization and Computer Graphics, 28(1):707–717, 2021.
  18. Assessing the effect of visualizations on bayesian reasoning through crowdsourcing. IEEE transactions on visualization and computer graphics, 18(12):2536–2545, 2012.
  19. D. R. Montello. Cognitive map-design research in the twentieth century: Theoretical and empirical approaches. Cartography and Geographic Information Science, 29(3):283–304, 2002.
  20. Evaluating multivariate network visualization techniques using a validated design and crowdsourcing approach. In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1–12, 2020.
  21. Improving bayesian reasoning: The effects of phrasing, visualization, and spatial ability. IEEE transactions on visualization and computer graphics, 22(1):529–538, 2015.
  22. Juvenile graphical perception: A comparison between children and adults. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–17, 2022.
  23. K. Reinecke and K. Z. Gajos. Quantifying visual preferences around the world. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 11–20, 2014.
  24. Design and comparative evaluation of visualization onboarding methods. In The 14th International Symposium on Visual Information Communication and Interaction, pp. 1–5, 2021.
  25. Four experiments on the perception of bar charts. IEEE Transactions on Visualization and Computer Graphics, 20(12):2152–2160, 2014.
  26. Biased average position estimates in line and bar graphs: Underestimation, overestimation, and perceptual pull. IEEE Transactions on Visualization and Computer Graphics, 26(1):301–310, 2020.
  27. Correlation judgment and visualization features: A comparative study. IEEE transactions on visualization and computer graphics, 25(3):1474–1488, 2018.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (9)
  1. Ryan Birchfield (1 paper)
  2. Maddison Caten (1 paper)
  3. Errica Cheng (1 paper)
  4. Madyson Kelly (1 paper)
  5. Truman Larson (1 paper)
  6. Hoan Phan Pham (1 paper)
  7. Yiren Ding (4 papers)
  8. Noëlle Rakotondravony (3 papers)
  9. Lane Harrison (8 papers)
Citations (2)
View on Semantic Scholar