Papers
Topics
Authors
Recent
Search
2000 character limit reached

Probablement, Wahrscheinlich, Likely ? A Cross-Language Study of How People Verbalize Probabilities in Icon Array Visualizations

Published 20 Jul 2022 in cs.HC | (2207.09608v3)

Abstract: Visualizations today are used across a wide range of languages and cultures. Yet the extent to which language impacts how we reason about data and visualizations remains unclear. In this paper, we explore the intersection of visualization and language through a cross-language study on estimative probability tasks with icon-array visualizations. Across Arabic, English, French, German, and Mandarin, n = 50 participants per language both chose probability expressions - e.g. likely, probable - to describe icon-array visualizations (Vis-to-Expression), and drew icon-array visualizations to match a given expression (Expression-to-Vis). Results suggest that there is no clear one-to-one mapping of probability expressions and associated visual ranges between languages. Several translated expressions fell significantly above or below the range of the corresponding English expressions. Compared to other languages, French and German respondents appear to exhibit high levels of consistency between the visualizations they drew and the words they chose. Participants across languages used similar words when describing scenarios above 80% chance, with more variance in expressions targeting mid-range and lower values. We discuss how these results suggest potential differences in the expressiveness of language as it relates to visualization interpretation and design goals, as well as practical implications for translation efforts and future studies at the intersection of languages, culture, and visualization. Experiment data, source code, and analysis scripts are available at the following repository: https://osf.io/g5d4r/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (50)
  1. Let’s Gamble: Uncovering the Impact of Visualization on Risk Perception and Decision-Making. Computing Research Repository (CoRR), abs/1910.09725, 2019.
  2. S. Barclay et al. Handbook for decisions analysis. 1977.
  3. Do Cross-Cultural Differences in Visual Attention Patterns Affect Search Efficiency on Websites? In CHI ’21: CHI Conference on Human Factors in Computing Systems, Virtual Event / Yokohama, Japan, May 8-13, 2021, pp. 362:1–362:12. ACM, 2021. doi: 10 . 1145/3411764 . 3445519
  4. Do You Mean What You Say? The Effect of Uncertainty Avoidance on the Interpretation of Probability Expressions-A Comparative Study between Spanish and German. In Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 35. cognitivesciencesociety.org, 2013.
  5. Communicating Numerical Risk: Human Factors That Aid Understanding in Health Care. Reviews of Human Factors and Ergonomics, 8(1):235–276, 2013. doi: 10 . 1177/1557234X13492980
  6. The Interpretation of IPCC Probabilistic Statements around the World. Nature Climate Change, 4(6):508–512, 2014. doi: 10 . 1038/nclimate2194
  7. Consistency in Interpretation of Probabilistic Phrases. Organizational behavior and human decision processes, 36(3):391–405, 1985.
  8. W. S. Cleveland and R. McGill. Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. Journal of the American statistical association, 79(387):531–554, 1984.
  9. The Influence of Conservatism and Secrecy on the Interpretation of Verbal Probability Expressions in the Anglo and Latin Cultural Areas. The International Journal of Accounting, 41(3):237–261, 2006.
  10. T. S. Doupnik and M. Richter. Interpretation of Uncertainty Expressions: a Cross-national Study. Accounting, Organizations and Society, 28(1):15–35, 2003. doi: 10 . 1016/S0361-3682(02)00010-7
  11. T. S. Doupnik and M. Richter. The Impact of Culture on the Interpretation of “In Context” Verbal Probability Expressions. Journal of International Accounting Research, 3(1):1–20, 2004. doi: 10 . 2308/jiar . 2004 . 3 . 1 . 1
  12. P. Dragicevic. Fair Statistical Communication in HCI. In Modern statistical methods for HCI, pp. 291–330. Springer, 2016.
  13. V. Evers. Cross-Cultural Understanding of Metaphors in Interface Design. Proceedings CATAC’98, Cultural Attitudes towards Technology and Communication, pp. 1–11, 1998.
  14. J. L. Fleiss. Measuring Nominal Scale Agreement among Many Raters. Psychological bulletin, 76(5):378, 1971.
  15. O. Fuhrman and L. Boroditsky. Cross-Cultural Differences in Mental Representations of Time: Evidence from an Implicit Nonlinguistic Task. Cognitive science, 34(8):1430–1451, 2010.
  16. Using Icon Arrays to Communicate Medical Risks: Overcoming Low Numeracy. Health Psychology, 28(2):210–216, 2009. doi: 10 . 1037/a0014474
  17. R. Garcia-Retamero and M. Galesic. Communicating Treatment Risk Reduction to People with Low Numeracy Skills: A Cross-Cultural Comparison. American Journal of Public Health, 99(12):2196–2202, 2009. doi: 10 . 2105/AJPH . 2009 . 160234
  18. R. Garcia-Retamero and M. Galesic. Who Profits from Visual Aids: Overcoming Challenges in People’s Understanding of Risks. Social Science and Medicine, 70(7):1019–1025, 2010. doi: 10 . 1016/j . socscimed . 2009 . 11 . 031
  19. Color Naming Across Languages Reflects Color Use. Proceedings of the National Academy of Sciences, 114(40):10785–10790, 2017.
  20. G. Gigerenzer and U. Hoffrage. How to Improve Bayesian Reasoning without Instruction: Frequency Formats. Psychological Review, 102(4):684–704, 1995. doi: 10 . 1037/0033-295X . 102 . 4 . 684
  21. R. Henkin and C. Turkay. Words of Estimative Correlation: Studying Verbalizations of Scatterplots. CoRR, abs/1911.12793, 2019.
  22. When (ish) is my Bus? User-Centered Visualizations of Uncertainty in Everyday, Mobile Predictive Systems. Conference on Human Factors in Computing Systems - Proceedings, pp. 5092–5103, 2016. doi: 10 . 1145/2858036 . 2858558
  23. S. Kent. Words of Estimative Probability. Journal of the American Intelligence Professional, 8(4):49–65, 1964.
  24. Color Names Across Languages: Salient Colors and Term Translation in Multilingual Color Naming Models. In EuroVis (Short Papers), pp. 31–35, 2019.
  25. Frames and slants in titles of visualizations on controversial topics. In Proceedings of the 2018 CHI conference on human factors in computing systems, pp. 1–12, 2018.
  26. High Numerates Count Icons and Low Numerates Process Large Areas in Pictographs: Results of an Eye-Tracking Study. Risk Analysis, 36(8):1599–1614, 2016. doi: 10 . 1111/risa . 12531
  27. D. Leclercq. J’en Suis Aussi Sûr que Vous, Mais pas avec le Même Pourcentage de Chances, que ce Soit Hors Contexte ou En Contexte. Journal international de Recherche en Education et Formation Evaluer. Journal international de Recherche en Education et Formation, 2(21):89–125, 2016.
  28. World Color Survey Color Naming Reveals Universal Motifs and their Within-Language Diversity. Proceedings of the National Academy of Sciences of the United States of America, 106(47):19785–19790, 2009. doi: 10 . 1073/pnas . 0910981106
  29. Reliability and Inter-Rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 2019. doi: 10 . 1145/3359174
  30. F. Mosteller and C. Youtz. Quantifying Probabilistic Expressions. Statistical Science, 5(1):2–12, 1990. doi: 10 . 1214/ss/1177012242
  31. Improving Risk Understanding across Ability Levels: Encouraging Active Processing with Dynamic Icon Arrays. Journal of Experimental Psychology: Applied, 21(2):178–194, 2015. doi: 10 . 1037/xap0000045
  32. Improving Bayesian Reasoning: The Effects of Phrasing, Visualization, and Spatial Ability. IEEE Transactions on Visualization and Computer Graphics, 22(1):529–538, 2016. doi: 10 . 1109/TVCG . 2015 . 2467758
  33. A Review of Uncertainty Visualization Errors: Working Memory as an Explanatory Theory. The Psychology of Learning and Motivation, p. 275, 2021.
  34. Uncertainty Visualization. Handbook of Computational Statistics and Data Science, 2020.
  35. Data is Personal: Attitudes and Perceptions of Data Visualization in Rural Pennsylvania. arXiv, pp. 1–12, 2019.
  36. Quantitative Meanings of Verbal Probability Expressions. Journal of Applied Psychology, 74(3):433–442, 1989. doi: 10 . 1037/0021-9010 . 74 . 3 . 433
  37. K. Reinecke and K. Z. Gajos. LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, CSCW 2015, Vancouver, BC, Canada, March 14 - 18, 2015, pp. 1364–1378. ACM, 2015. doi: 10 . 1145/2675133 . 2675246
  38. S. Renooij and C. Witteman. Talking probabilities: Communicating probabilistic information with words and numbers. International Journal of Approximate Reasoning, 22(3):169–194, 1999. doi: 10 . 1016/S0888-613X(99)00027-4
  39. C. A. Sanne Willems and I. S. Verbal. Variability in the Interpretation of Probability Phrases Used in Dutch News Articles — a Risk for Miscommunication. Orphanet Journal of Rare Diseases, 21(1):1–9, 2020.
  40. Frequency or Probability? A Qualitative Study of Risk Communication Formats Used in Health Care. Medical Decision Making, 21(6):459–467, 2001.
  41. Visualizing Uncertainty about the Future. Science, 333(6048):1393–1400, 2011. doi: 10 . 1126/science . 1191181
  42. How WEIRD is HCI? Extending HCI Principles to Other Countries and Cultures. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, vol. 18, pp. 2425–2428, 2015. doi: 10 . 1145/2702613 . 2702656
  43. Four Experiments on the Perception of Bar Charts. IEEE transactions on visualization and computer graphics, 20(12):2152–2160, 2014.
  44. C. Till. Fostering Risk Literacy in Elementary School. International Electronic Journal of Mathematics Education, 9(1-2):85–98, 2014.
  45. Probability Information in Risk Communication: A Review of the Research Literature. Risk Analysis, 29(2):267–287, 2009. doi: 10 . 1111/j . 1539-6924 . 2008 . 01137 . x
  46. Measuring the Vague Meanings of Probability Terms. Journal of Experimental Psychology: General, 115(4):348–365, 1986. doi: 10 . 1037/0096-3445 . 115 . 4 . 348
  47. H. Winschiers-Theophilus and N. J. Bidwell. Toward an Afro-Centric Indigenous HCI Paradigm. International Journal of Human-Computer Interaction, 29(4):243–255, 2013.
  48. Verbal Probabilities: Very Likely to be Somewhat More Confusing than Numbers. PLoS ONE, 14(4):1–18, 2019. doi: 10 . 1371/journal . pone . 0213522
  49. Investigating perceptual biases in icon arrays. In CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2022.
  50. Blocks, Ovals, or People? Icon Type affects Risk perceptions and Recall of Pictographs. Medical Decision Making, 34(4):443–453, 2014. doi: 10 . 1177/0272989X13511706
Citations (4)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up